A theory-driven testing methodology for developing scientific software

Journal of Experimental and Theoretical Artificial Intelligence

Volumn 24, Issue 4, 2012, Pages 421-456

  Lane, Peter C R ^a,b   Gobet, Fernand ^b  

^a UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

^b BRUNEL UNIVERSITY   (United Kingdom)

Author keywords

agile development; CHREST; cognitive architectures; scientific software; test driven development

Indexed keywords

AGILE DEVELOPMENT; CHREST; COGNITIVE ARCHITECTURES; SCIENTIFIC SOFTWARES; TEST DRIVEN DEVELOPMENT;

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

SOFTWARE TESTING;

EID: 84867053718     PISSN: 0952813X     EISSN: 13623079     Source Type: Journal    
DOI: 10.1080/0952813X.2012.695443     Document Type: Conference Paper

References (66)

1. Anderson, J.R., Bothell, D., Byrne, M.D., Douglass, S., Lebiére, C., and Qin, Y.L. (2004), 'An Integrated Theory of the Mind', Psychological Review, 111, 1036-1060.
2. Beck, K. (1999), Extreme Programming Explained: Embrace Change, Reading, MA: Addison-Wesley.
3. Beck, K. (2003), Test-Driven Development: By Example, Boston, MA: Pearson Education, Inc.
4. Biegon, D. (2006), Project Store: Biosciences Report. http://hdl.handle.net/1842/1414.
5. Bugelski, B.R. (1962), 'Presentation Time, Total Time, and Mediation in Paired-associate Learning', Journal of Experimental Psychology, 63, 409-412.
6. Chase, W.G., and Simon, H.A. (1973), 'Perception in Chess', Cognitive Psychology, 4, 55-81.
7. Cooper, R.P. (2007), 'The Role of Falsification in the Development of Cognitive Architectures: Insights from a Lakatosian Analysis', Cognitive Science, 31, 509-533.
8. Cooper, R.P., and Shallice, T. (1995), 'Soar and the Case for Unified Theories of Cognition', Cognition, 55, 115-49.
9. Cragin, M.H., Palmer, C.L., Carlson, J.R., and Witt, M. (2010), 'Data Sharing, Small Science and Institutional Repositories', Philosophical Transactions of the Royal Society A, 368, 4023-4038.
10. Curtis, B., Krasner, H., and Iscoe, N. (1988), 'A Field Study of the Software Design Process for Large Systems', Communications of the ACM, 31, 1268-87.
11. de Groot, A.D., and Gobet, F. (1996), Perception and Memory in Chess: Heuristics of the Professional Eye, Assen, The Netherlands: Van Gorcum.
12. Feigenbaum, E.A. (1959), An Information Processing Theory of Verbal Learning, Report No. P-1817, The RAND Corporation Mathematics Division, Santa Monica, CA.
13. Feigenbaum, E.A., and Simon, H.A. (1962), 'A Theory of the Serial-position Effect', British Journal of Psychology, 53, 307-320.
14. Feigenbaum, E.A., and Simon, H.A. (1984), 'EPAM-like Models of Recognition and Learning', Cognitive Science, 8, 305-336.
15. Fowler, M. (1999), Refactoring: Improving the Design of Existing Code, Reading, MA: Addison-Wesley.
16. Freudenthal, D., Pine, J.M., Aguado-Orea, J., and Gobet, F. (2007), 'Modelling the Developmental Patterning of Finiteness Marking in English, Dutch, German and Spanish Using MOSAIC', Cognitive Science, 31, 311-341.
17. Frias-Martinez, E., and Gobet, F. (2007), 'Automatic Generation of Cognitive Theories Using Genetic Programming', Minds and Machines, 17, 287-309.
18. Gluck, K.A., and Pew, R.W. (eds.) (2005), Modeling Human Behavior With Integrated Cognitive Architectures: Comparison, Evaluation, and Validation, Mahwah, NJ: Lawrence Erlbaum.
19. Gluck, K.A., Staszewski, J.J., Richman, H., Simon, H.A., and Delahanty, P. (2001), 'The Right Tool for the Job: Information-processing Analysis in Categorization', in Proceedings of the Twenty-third Annual Conference of the Cognitive Science Society, eds. Moore, J.D., and Stenning, K., Mahwah, NJ: Erlbaum, pp. 330-335.
20. Gobet, F. (1996), 'Discrimination Nets, Production Systems and Semantic Networks: Elements of a Unified Framework', in Proceedings of the Second International Conference of the Learning Sciences, Evanston, IL: Northwestern University, pp. 398-403.
21. Gobet, F. (1997), 'A Pattern-recognition Theory of Search in Expert Problem Solving', Thinking and Reasoning, 3, 291-313.
22. Gobet, F. (1998), 'Expert Memory: A Comparison of Four Theories', Cognition, 66, 115-52.
23. Gobet, F., and Clarkson, G. (2004), 'Chunks in Expert Memory: Evidence for the Magical Number Four.. . or Is It Two?' Memory, 12, 732-47.
24. Gobet, F., and Lane, P.C.R. (2005), 'The CHREST Architecture of Cognition: Listening to Empirical Data', in Visions of Mind: Architectures for Cognition and Affect, ed. D.N. Davis, Hershey, PA: Information Science Publishing, pp. 204-224.
25. Gobet, F., Lane, P.C.R., Croker, S.J., Cheng, P.C.-H., Jones, G., Oliver, I., and Pine, J.M. (2001), 'Chunking Mechanisms in Human Learning', Trends in Cognitive Sciences, 5, 236-243.
26. Gobet, F., Richman, H., Staszewski, J., and Simon, H.A. (1997), 'Goals, Representations, and Strategies in a Concept Attainment Task: The EPAM Model', The Psychology of Learning and Motivation, 37, 265-290.
27. Gobet, F., and Ritter, F.E. (2000), 'Individual Data Analysis and Unified Theories of Cognition: A Methodological Proposal', in Proceedings of the Third International Conference on Cognitive Modelling, eds. N. Taatgen and J. Aasman, Veenendaal, The Netherlands: Universal Press, pp. 150-57.
28. Gobet, F., and Simon, H.A. (1996), 'Templates in Chess Memory: A Mechanism for Recalling Several Boards', Cognitive Psychology, 31, 1-40.
29. Gobet, F., and Simon, H.A. (2000), 'Five Seconds Or Sixty? Presentation Time in Expert Memory', Cognitive Science, 24, 651-82.
30. Gobet, F., and Waters, A.J. (2003), 'The Role of Constraints in Expert Memory', Journal of Experimental Psychology: Learning, Memory & Cognition, 29, 1082-1094.
31. Gravemeijer, K. (1997), 'Mediating Between Concrete and Abstract', in Learning and Teaching Mathematics: An International Perspective, eds. T. Nunes and P. Bryant, Hove, UK: Psychology Press, pp. 315-45.
32. Jones, G.A., Gobet, F., and Pine, J.M. (2007), 'Linking Working Memory and Long-term Memory: A Computational Model of the Learning of New Words', Developmental Science, 10, 853-873.
33. Kuhn, T. (1962), The Structure of Scientific Revolutions, Chicago: University of Chicago Press.
34. Laird, J., Newell, A., and Rosenbloom, P. (1987), 'Soar: an Architecture for General Intelligence', Artificial Intelligence, 33, 1-64.
35. Lakatos, I. (1970), 'Falsification and the Methodology of Scientific Research Programmes', in Criticism and the Growth of Knowledge, eds. I. Lakatos and A. Musgrave, Cambridge: Cambridge University Press.
36. Lane, P.C.R., Cheng, P.C.-H., and Gobet, F. (2000), 'CHREST+: Investigating How Humans Learn to Solve Problems with Diagrams', AISB Quarterly, 103, 24-30.
37. Lane, P.C.R., and Gobet, F. (2003), 'Developing Reproducible and Comprehensible Computational Models', Artificial Intelligence, 144, 251-63.
38. Lane, P.C.R., and Gobet, F. (2005a), 'Discovering Predictive Variables When Evolving Cognitive Models', in Proceedings of the Third International Conference on Advances in Pattern Recognition, Part I, eds. S. Singh, M. Singh, C. Apte, and P. Perner, Berlin: Springer-Verlag, pp. 108-117.
39. Lane, P.C.R., and Gobet, F. (2005b), 'Multi-task Learning and Transfer: The Effect of Algorithm Representation', in Proceedings of the ICML-2005 Workshop on Meta-learning, eds. C. Giraud-Carrier, R. Vilalta and P. Brazdil, Bonn, Germany.
40. Lane, P.C.R., and Gobet, F. (2007), 'Developing and Evaluating Cognitive Architectures with Behavioural Tests', in Proceedings of the AAAI-07 Workshop on Evaluating Cognitive Architectures, Vancouver, Canada. Boston, MA: AAAI Press, pp. 36-39.
41. Lane, P.C.R., Sykes, A.K., and Gobet, F. (2003), 'Combining Low-level Perception with Expectations in CHREST', in Proceedings of EuroCogsci, eds. F. Schmalhofer, R.M. Young and G. Katz, Mahwah, NJ: Lawrence Erlbaum Associates, pp. 205-210.
42. Langley, P., and Choi, D. (2006), 'A Unified Cognitive Architecture for Physical Agents', in Proceedings of the American Association of Artificial Intelligence, Boston, MA: AAAI Press.
43. Langley, P., Laird, J.E., and Rogers, S. (2009), 'Cognitive Architectures: Research Issues and Challenges', Cognitive Systems Research, 10, 141-160.
44. Licata, D.R., Harris, C.D., and Krishnamurthi, S. (2003), 'The Feature Signatures of Evolving Programs', in IEEE International Symposium on Automated Software Engineering, Montreal, Canada. New York: IEEE Press.
45. Lubers, M., Potts, C., and Richter, C. (1993), 'A Review of the State of the Practice in Requirements Modeling', in Proceedings of the Third IEEE International Requirements Engineering Symposium, San Diego, CA, Los Alamitos, CA: IEEE Press.
46. McLeod, P., Plunkett, K., and Rolls, E.T. (1998), Introduction to Connectionist Modelling of Cognitive Processes, Oxford, UK: Oxford University Press.
47. Medin, D.L., and Schaffer, M.M. (1978), 'Context Theory of Classification Learning', Psychological Review, 85, 207-238.
48. Medin, D.L., and Smith, E.E. (1981), 'Strategies and Classification Learning', Journal of Experimental Psychology: Human Learning and Memory, 7, 241-253.
49. Milewski, B. (2001), C++ in Action: Industrial-strength Programming Techniques, Upper Saddle River, NJ: Addison Wesley.
50. Myung, I.J., and Pitt, M.A. (2010), 'Cognitive Modeling Repository', in Proceedings of the Thirty-second Annual Meeting of the Cognitive Science Society, Portland, OR: Erlbaum Press, p. 556.
51. Naur, P. (1985), 'Programming As Theory Building', Microprocessing and Microprogramming, 15, 253-261.
52. Newell, A. (1990), Unified Theories of Cognition, Cambridge, MA: Harvard University Press.
53. Newell, A., and Simon, H.A. (1972), Human Problem Solving, Englewood Cliffs, NJ: Prentice-Hall.
54. Pew, R.W., and Mavor, A.S. (eds.) (1998), Modeling Human and Organizational Behavior: Applications to Military Simulations, Washington, DC: National Academy Press.
55. Pitt-Francis, J., Benabeu, M.O., Cooper, J., Garny, A., Momtahan, L., Osborne, J., Pathmanathan, P., Rodriguez, B., Whiteley, J.P., and Gavaghan, D.J. (2008), 'Chaste: Using Agile Programming Techniques to Develop Computational Biology Software', Philosophical Transactions of the Royal Society A, 366, 3111-3136.
56. Ritter, F.E. (2004), 'Choosing and Getting Started with a Cognitive Architecture to Test and Use Human-machine Interfaces', MMI-Interaktiv, 7, 17-37.
57. Roberts, S., and Pashler, H. (2000), 'How Persuasive Is a Good Fit? A Comment on Theory Testing', Psychological Review, 107, 358-367.
58. Royce, W. (1970), 'Managing the Development of Large Software Systems', in Proceedings of IEEE WESCON 26, Los Angeles, USA: TRW, 1-9.
59. Samsonovich, A. (2010), 'Toward a Unified Catalog of Implemented Cognitive Architectures', in Proceedings of the 2010 Conference on Biologically Inspired Cognitive Architectures, Amsterdam: IOS Press, pp. 195-244.
60. Simon, H.A. (2000), 'Discovering Explanations', in Explanation and Cognition, eds. F.C. Keil and R.A. Wilson, Cambridge, MA: The MIT Press, pp. 21-59.
61. Simon, H.A., and Gobet, F. (2000), 'Expertise Effects in Memory Recall: Comments on Vicente and Wang', Psychological Review, 107, 593-600.
62. Smith, R.L., Gobet, F., and Lane, P.C.R. (2007), 'An Investigation Into the Effect of Ageing on Expert Memory with CHREST', in Proceedings of The Seventh UK Workshop on Computational Intelligence, London: UK.
63. Smith, J.D., and Minda, J.P. (2000), 'Thirty Categorization Results in Search of a Model', Journal of Experimental Psychology: Learning, Memory and Cognition, 26, 3-27.
64. Stott, W. (2003), 'Extreme Programming: Turning the World Upside Down', IEE Computing and Control Engineering, 14, 18-23.
65. Sun, R., Merrill, E., and Peterson, T. (2001), 'From Implicit Skills to Explicit Knowledge: A Bottom-up Model of Skill Learning', Cognitive Science, 25, 203-244.
66. Waters, A.J., and Gobet, F. (2008), 'Mental Imagery and Chunks: Empirical and Computational Findings', Memory and Cognition, 36, 505-517.