What Is a Computer Program?

What Is Implementation?

1. Chalmers, David J. (1993a), "A Computational Foundation for the Study of Cognition" (unpublished).
   • §2 was published (in slightly different form) as "On Implementing a Computation", Minds and Machines 4 (1994): 391-402.

2. Chalmers, David J. (1993b), "Does a Rock Implement Every Finite-State Automaton?", Synthese 108 (1996): 309-333.
   • This is a reply to an argument similar to Searle's (1990) argument about the wall behind me implementing Wordstar, but much more detailed, due to Hilary Putnam:
     Putnam, Hilary (1988), Appendix to Representation and Reality (Cambridge, MA: MIT Press): 121-125.
     • "Theorem. Every ordinary open system is a realization of every abstract finite automaton."

3. Suber, Peter (1997), "Formal Systems and Machines: An Isomorphism".
   Also see:
   • Suber, Peter (2002), "Sample Formal System S"

4. Rapaport, William J. (1999), "Implementation Is Semantic Interpretation" [PDF], The Monist 82(1): 109-130.
   • The online version differs from the published version in being a bit longer and going into a bit more detail.
   • This article was based on a longer chapter (which it alludes to as "in preparation"), which has since been published as:
     Rapaport, William J. (2005), "Implementation Is Semantic Interpretation: Further Thoughts", Special Issue on Theoretical Cognitive Science, Journal of Experimental and Theoretical Artificial Intelligence 17(4) (December): 385-417.

1. Simon, Herbert A. & Newell, Allen (1956), "Models: Their Uses and Limitations", in Leonard D. White (ed.), The State of the Social Sciences (Chicago: University of Chicago Press): 66-83.

2. Weizenbaum, Joseph (1976), Computer Power and Human Reason: From Judgment to Calculation (New York: W.H. Freeman).
   • Ch. 5 ("Theories and Models"), pp. 132-153.
   • Ch. 6 ("Computer Models in Psychology"), pp. 154-181.
   • Complete PDF version of the above two chapters (not missing any pages that we know of!)
   • Original PDF version of the above two chapters, which is missing two pages (see below).
     • 
       Missing pages 138-139!
     • Missing pages 142-143!!

3. Moor, James H. (1978), "Three Myths of Computer Science" British Journal for the Philosophy of Science 29(3) (September): 213-222.

4. Johnson-Laird, Philip N. (1981), "Mental Models in Cognitive Science", in Donald A. Norman (ed.), Perspectives on Cognitive Science (Norwood, NJ: Ablex), Ch. 7 (pp. 147-191):
   • "Computer programming is too useful to cognitive science to be left solely in the hands of the artificial intelligenzia [sic]. There is a well established list of advantages that programs bring to a theorist: they concentrate the mind marvelously; they transform mysticism into information processing, forcing the theorist to make intuitions explicit and to translate vague terminology into concrete proposals; they provide a secure test of the consistency of a theory and thereby allow complicated interactive components to be safely assembled; they are "working models" whose behavior can be directly compared with human performance. Yet, many research workers look on the idea of developing their theories in the form of computer programs with considerable suspicion. The reason...[i]n part...derives from the fact that any large-scale program intended to model cognition inevitably incorporates components that lack psychological plausibility.... The remedy...is not to abandon computer programs, but to make a clear distinction between a program and the theory that it is intended to model. For a cognitive scientist, the single most important virtue of programming should come...from the business of developing [the program]. Indeed, the aim should be neither to simulate human behavior...nor to exercise artificial intelligence, but to force the theorist to think again." (pp. 185-186.)

5. Pylyshyn, Zenon W. (1984), Computation and Cognition: Toward a Foundation for Cognitive Science (Cambridge, MA: MIT Press), Ch. 3 ("The Relevance of Computation"), pp. 48-86, esp. the section "The Role of Computer Implementation" (pp. 74-78):
   • "[T]he...requirement—that we be able to implement [a cognitive] process in terms of an actual, running program that exhibits tokens of the behaviors in question, under the appropriate circumstances—has far-reaching consequences. One of the clearest advantages of expressing a cognitive-process model in the form of a computer program is, it provides a remarkable intellectual prosthetic for dealing with complexity and for exploring both the entailments of a large set of proposed principles and their interactions." (p. 76.)

6. Johnson-Laird, Philip N. (1988), The Computer and the Mind: An Introduction to Cognitive Science (Cambridge, MA: Harvard University Press), Ch. 3 ("Computability and Mental Processes"), pp. 37-53:
   • "[T]heories of mind should be expressed in a form that can be modelled in a computer program. A theory may fail to satisfy this criterion for several reasons: it may be radically incomplete; it may rely on a process that is not computable; it may be inconsistent, incoherent, or, like a mystical doctrine, take so much for granted that it is understood only by it adherents. These flaws are not always so obvious. Students of the mind do not always know that they do not know what they are talking about. The surest way to find out is to try to devise a computer program that models the theory." (p. 52.)

7. Partridge, Derek; & Wilks, Yorick (eds.) (1990), The Foundations of Artificial Intelligence: A Sourcebook (Cambridge, UK: Cambridge University Press).
   • Lockwood & SEL: Q335 .F68 1990
   Especially the following two sections, containing the articles listed (many of which are available elsewhere, some online):
   • §3 ("Levels of Theory", pp. 95-118), containing:
     1. Marr, David (1977), "Artificial Intelligence: A Personal View", pp. 97-107; reprinted from Artificial Intelligence 9: 37-48.

     2. Boden, Margaret A., "Has AI Helped Psychology?", pp. 108-111.

     3. Partridge, Derek, "What's in an AI Program?", pp. 112-118.

   • §4 ("Programs and Theories", pp. 119-164), containing:
     1. Wilks, Yorick, "One Small Head: Models and Theories", pp. 121-134.

     2. Bundy, Alan; & Ohlsson, Stellan (198?), "The Nature of AI Principles", pp. 135-154; reprinted from AISB Quarterly ##47-50.

     3. Simon, Thomas W., "Artificial Methodology Meets Philosophy", pp. 155-164.

8. Daubert v. Merrell Dow Pharmaceuticals (92-102), 509 U.S. 579 (1993).
   • A Supreme Court case concerning what counts as "generally accepted" reliability by the scientific community. Prof. Srihari (personal communication) wonders if certain computer programs would pass muster.

9. Simon, Herbert A. (1996), The Sciences of the Artificial, Third Edition (Cambridge, MA: MIT Press), Ch. 1 ("Understanding the Natural and Artificial Worlds"), pp. 1-24 [PDF].
   • This is a really good chapter that I probably should have had you read back when we were discussing whether computer science is a science. So read it now; it's never too late :-)

10. Scheutz, Matthias; & Peschl, Markus (2000), "Some Thoughts on Computation and Simulation in Cognitive Science" [PDF], in Proceedings of the 6th Congress of the Austrian Philosophical Society: 534-540.

11. Winsberg, Eric (2001), "Simulations, Models, and Theories: Complex Physical Systems and Their Representations", Proceedings of the 2000 Biennial Meeting of the Philosophy of Science Association, Part I: Contributed Papers, Philosophy of Science 68(3) (September) Supplement: S442-S454.

12. Coward, L. Andrew; & Sun, Ron (2001??), "Some Criteria for an Effective Scientific Theory of Consciousness and Examples of Preliminary Attempts at Such a Theory" [PDF].

13. Peschl, Markus F.; & Scheutz, Matthias (2001), "Explicating the Epistemological Role of Simulation in the Development of Theories of Cognition" [PDF], in Proceedings of the 7th Colloquium on Cognitive Science (ICCS-01): 274-280.

14. Lane, Peter C.R.; & Gobet, Fernand (2003), "Developing Reproducible and Comprehensible Computational Models" [PDF], Artificial Intelligence 144: 251-263.

15. Humphreys, Paul (2002), "Computational Models", Philosophy of Science 69 (September): S1-S11.

16. Green, Christopher D. (2004), "(How) Do Connectionist Networks Model Cognition?" (forthcoming and unpublished Ph.D. dissertation, Dept. of Philosophy, University of Toronto), Ch. 3 ("Philosophical Approaches to Explanation and Scientific Models, and Their Relations to Connectionist Cognitive Science") [.doc].

1. Moor, James H. (1978), "Three Myths of Computer Science" British Journal for the Philosophy of Science 29(3) (September): 213-222.
   • Moor discusses different "levels" from which to understand things like computers and programs; this notion is reminiscent of Dennett's 1971 theory of "stances": Dennett, Daniel C. (1971), "Intentional Systems", Journal of Philosophy 68: 87-106; reprinted in Daniel C. Dennett, Brainstorms (Montgomery, VT: Bradford Books): 3-22.
     • For some interesting followups to Dennett's paper, see:
       Miller, Christopher A. (guest ed.) (2004), "Human-Computer Etiquette: Managing Expectations with Intentional Agents", Communications of the ACM 47(4) (April): 31-34.

2. Suber, Peter (1988), "What Is Software?", Journal of Speculative Philosophy 2(2): 89-119.

3. Colburn, Timothy R. (1999), "Software, Abstraction, and Ontology" [PDF], The Monist 82(1): 3-19.
   • Reprinted (in slightly different form) as:
     Colburn, Timothy R. (2000), Philosophy and Computer Science (Armonk, NY: M.E. Sharpe), Ch. 12 ("Software, Abstraction, and Ontology"), pp. 198-209.

   • On the case of the exportable software text and its non-exportable hardware implementation, see:
     Wallich, Paul (1997), "Cracking the U.S. Code", Scientific American (April): 42.

   • On the various theories that Colburn discusses concerning the mind-body problem, see: Roderick Chisholm's cartoon