Improving requirements elicitation: An empirical investigation of procedural prompts

Information Systems Journal

Volumn 17, Issue 1, 2007, Pages 89-110

  Pitts, Mitzi G ^a   Browne, Glenn J ^b  

^a Client Services   (United States)

^b TEXAS TECH UNIVERSITY   (United States)

Author keywords

Cognitive challenges; Elicitation methods; Information systems development; Prompting techniques; Requirements determination

Indexed keywords

EID: 33846233838     PISSN: 13501917     EISSN: 13652575     Source Type: Journal    
DOI: 10.1111/j.1365-2575.2006.00240.x     Document Type: Article

References (79)

1. Adelson, B. & Soloway, E. (1985) The role of domain experience in software design. IEEE Transactions on Software Engineering, November, 1351-1360.
2. Agarwal, R. & Tannini, M.R. (1990) Knowledge acquisition using structured interviewing: an empirical investigation. Journal of Management Information Systems, 7, 123-140.
3. Anderson, J.R. (1990) Cognitive Psychology and its Implications, 3rd edn. W.H. Freeman, New York NY, USA.
4. Baddeley, A.D., Thompson, N. & Buchanan, M. (1975) Word length and the structure of short-term memory. Journal of Verbal Learning and Verbal Behavior, 14, 575-589.
5. Baskerville, R. & Pries-Heje, J. (2004) Short cycle time system development. Information Systems Journal, 14, 237-264.
6. Beynon-Davtes, P., Mackay, H. & Tudhope, D. (2000) 'It's lots of bits of paper and ticks and post-it notes and things ...': a case study of a rapid application development project. Information Systems Journal, 10, 195-216.
7. Boehm, B. & Turner, R. (2004) Balancing Agility and Discipline. Addison-Wesley, Boston, MA, USA.
8. Boland, R.J., Jr (1978) The processing and product of system design. Management Science, 24, 887-898.
9. Boland, R.J., Jr (1984) Sense-making of accounting data as a technique of organizational diagnosis. Management Science, 30, 868-882.
10. Brainerd, C. & Reyna, V. (1992) Explaining 'memory-free" reasoning. Psychological Science, 3, 332-339.
11. Brody, R. (1982) Problem Solving. Human Sciences Press, New York, NY, USA.
12. Browne, G.J. & Ramesh, V. (2002) Improving information requirements determination: a cognitive perspective. Information and Management, 39, 625-645.
13. Browne, G.J. & Rogich, M.B. (2001) An empirical investigation of user requirements elicitation: comparing the effectiveness of prompting techniques. Journal of Management Information Systems, 17, 223-249.
14. Browne, G.J., Curtey, S.P. & Benson, P.G. (1997) Evoking information in probability assessment: knowledge maps and reasoning-based directed questions. Management Science, 43, 1-14.
15. Browne, G.J., Curtey, S.P. & Benson, P.G. (1999) The effects of subject-defined categories on judgmental accuracy in confidence assessment tasks. Organizational Behavior and Human Decision Processes, 80, 134-154.
16. Byrd, T.A., Cossick, K.L. & Zmud, R.W. (1992) A synthesis of research on requirements analysis and knowledge acquisition techniques. MIS Quarterly, 16, 117-138.
17. Cerveny, R.P., Garrity, E.J. & Sanders, G.L. (1990) A problem-solving perspective on systems development. Journal of Management Information Systems, 6, 103-122.
18. Conrad, R. (1964) Acoustic confusions in immediate memory. British Journal of Psychology, 55, 75-84.
19. Couger, J.D. (1996) Creativity and Innovation in Information Systems Organizations. Boyd and Fraser Publishing Co, Danvers, MA, USA.
20. Coughlan, J., Lycett, M. & Macredie, R.D. (2003) Communications issues in requirements elicitation: a content analysis of stakeholder experiences. Information and Software Technology, 45, 525-537.
21. Curley, S.P., Browne, G.J., Smith, G.F. & Benson, P.G. (1995) Arguments in the practical reasoning underlying constructed probability responses. Journal of Behavioral Decision Making, 8, 1-20.
22. Davis, G.B. (1982) Strategies for information requirements determination. IBM Systems Journal, 21, 4-30.
23. Epley, H. & Gilovich, T. (2006) The anchoring and adjustment heuristic. Psychological Science, 17, 311-318.
24. Erickson, J., Lyytinen, K. & Siau, K. (2005) Agile modeling, agile software development, and extreme programming: the state of research. Journal of Database Management, 16, 88-100.
25. Everitt, B.S. (1996) Making Sense of Statistics in Psychology. Oxford University Press, Oxford, UK.
26. Fischhoff, B. (1989) Eliciting knowledge for analytical representations IEEE Transactions on Systems, Man, and Cybernetics, 19, 448-461.
27. Gallivan, M.J. & Keil, M. (2003) The user-developer communication process: a critical case study. Information Systems Journal, 13, 37-68.
28. Graesser, A.C., Person, N. & Huber, J. (1992) Mechanisms that generate questions. In: Questions and Information Systems, Lauer, T.W., Peacock, E. & Graesser, A.C. (eds), pp. 167-187. Lawrence Eribaum Associates, Hillsdale, NJ, USA.
29. Mickey, A.M. & Davis, A.M. (2004) A unified model of requirements elicitation. Journal of Management Information Systems, 20, 65-84.
30. Jeffries, R., Turner, A, Poison, P. & Atwood, M. (1981) The process involved in designing software. In: Cognitive Skills and Their Acquisition, Anderson, J.R. (ed.), pp. 255-283. Lawrence Erlbaum Associates, Hillsdale, NJ, USA
31. Johnson, P.E., Jamal, K. & Berryman, R.G. (1991) Effects of framing on auditor decisions. Organizational Behavior and Human Decision Processes, 50, 75-105.
32. Kahneman, D. & Frederick, S. (2002) Representativeness revisited: attribute substitution in intuitive judgment. In: Heuristics and Biases: the Psychology of Intuitive Judgment, Gilovich, T., Griffin, D. & Kahneman, D. (eds), pp. 49-81. Cambridge University Press, Cambridge, UK.
33. Kahneman, D. & Tversky, A. (1982) The simulation heuristic. In: Judgment Under Uncertainty: Heuristics and Biases, Kahneman, D., Slovic, P. & Tversky, A. (eds), pp. 201-208. Cambridge University Press, Cambridge, MA USA.
34. Kepner, C.H. & Tregoe, B.B. (1981) The New Rational Manager. Princeton University Press, Princeton, NJ, USA
35. Klayman, J. & Ha, Y. (1987) Confirmation, disconfirmation, and information in hypothesis testing. Psychological Review, 94, 211-228.
36. Klayman, J., Soll, J.B., Gonzales-Vallejo, C. & Barlas, S. (1999) Overconfidence: it depends on how, what, and whom you ask. Organizational Behavior and Human Decision Processes, 79, 216-247.
37. Koriat, A., Lichtenstein, S. & Fischhoff. B. (1980) Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6, 107-118.
38. Kuhn, D. (1991) The Skills of Argument. Cambridge University Press, Cambridge, UK.
39. Landis, J.R. & Koch, G.C. (1977) The measurement of observer agreement for categorical data. Biometrics, 33, 1089-1091.
40. Larman, C. (2004) Agile and Iterative Development. Addison-Wesley, Boston, MA USA
41. Larsen, T.J. & Naumann, J.D. (1992) An experimental comparison of abstract and concrete representations in systems analysis. Information and Management, 22, 29-40.
42. Lauer, T.W., Peacock, E. & Jacobs, S.M. (1992) Question generation and the systems analysis process. In: Questions and Information Systems, Lauer, T.W., Peacock, E. & Graesser, A.C. (eds), pp. 47-61. Lawrence Erlbaum, Hillsdale, NJ, USA.
43. Lehnert, W.G. (1978) The Process of Question Answering. Lawrence Erlbaum, Hillsdale, NJ, USA
44. Lichtenstein, S., Fischhoff, B. & Phillips, L.D. (1982) Calibration of probabilities: state of the art to 1980. In: Judgment Under Uncertainty: Heuristics and Biases, Kahneman, D., Slovic, P. & Tversky, A (eds), pp. 306-334. Cambridge University Press, Cambridge, MA USA
45. Marakas, G. & Elam, J. (1998) Semantic structuring in analyst acquisition and representation of facts in requirements analysis. Information Systems Research, 9, 37-63.
46. Miller, G.A. (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Review, 63, 81-97.
47. Moody, J.W., Blanton, J.E. & Cheney, P.H. (1998) A theoretically grounded approach to assist memory recall during information requirements determination. Journal of Management Information Systems, 15, 79-98.
48. Mumford, E. (2000) A socio-technical approach to systems design. Requirements Engineering, 5, 125-133.
49. Mynatt, C.R., Doherty, M.E. & Tweney, R.D. (1977) Confirmation bias in a simulated research environment: an experimental study of scientific inference. Quarterly Journal of Experimental Psychology, 29, 85-95.
50. Mynatt, C.R., Doherty, M.E. & Tweney, R.D. (1978) Consequences of confirmation and disconfirmation in a simulated research environment. Quarterly Journal of Experimental Psychology, 30, 395-406.
51. Nickerson, R.S. & McGoldrick, C.C. (1965) Confidence ratings and level of performance on a judgmental task. Perceptual Motor Skills, 20, 311-316.
52. Ocker, R., Fjermestad, J., Hiltz, S.R. & Johnson, K. (1998) Effects of four modes of group communication on the outcomes of software requirements determination. Journal of Management Information Systems, 15, 99-118.
53. Pan, G.S.C. (2005) Information system project abandonment: a stakeholder analysis. International Journal of Information Management, 25, 174-184.
54. Perkins, D.N., Allen, R. & Hafner, J. (1983) Difficulties in everyday reasoning. In: Thinking: the Expanding Fron tier, Maxwell, W. (ed.), pp. 177-189. Franklin University Press, Philadelphia, PA, USA.
55. Pitts, M.G. & Browne, G.J. (2004) Stopping behavior of systems analysts during information requirements elicitation. Journal of Management Information Systems, 21, 213-236.
56. Potts, C., Takahashi, K. & Anton, A.I. (1994) Inquiry-based requirement analysis. IEEE Software, 11, 21-32.
57. Reichman-Adar, R. (1984) Extended person-machine interface. Artificial Intelligence, 22, 157-218.
58. Reisberg, D. (2005) Cognition: Exploring the Science of the Mind. W.W. Norton Co, New York, NY, USA.
59. Rogich, M.B. (1997) An empirical evaluation of context-independent prompting tools for requirements determination. Doctoral dissertation. University of Maryland, Baltimore. Dissertation Abstracts International, 58, 4481.
60. Schwarz, N. & Vaughn, L.A. (2002) The availability heuristic revisited: ease of recall and the content of recall as distinct sources of information. In: Heuristics and Biases: the Psychology of Intuitive Judgment, Gilovich, T., Griffin, D. & Kahneman, D. (eds), pp. 103-119. Cambridge University Press, Cambridge, UK.
61. Simon, H.A. (1957) Models of Man: Social and Rational. Wiley and Sons, New York, NY, USA.
62. Simon, HA (1978) Information processing theory of human problem solving. In: Handbook of Learning and Cognitive Processes, Vol. 5, Estes, W.K. (ed.), pp. 271-295. Lawrence Erlbaum, Hillsdale, NJ, USA.
63. Slovic, P. & Lichtenstein, S. (1971) Comparison of Bayesian and regression approaches in the study of information processing in judgment. Organizational Behavior and Human Performance, 6, 649-744.
64. Spetzler, C.S. & Stael von Holstein, C.S. (1975) Probability encoding in decision analysis. Management Science, 22, 340-358.
65. Stacy, W. & Macmillan, J. (1995) Cognitive bias in software engineering. Communications of the ACM, 38, 57-63.
66. Tan, M. (1994) Establishing mutual understanding in systems design: an empirical study. Journal of Management Information Systems, 10, 159-182.
67. Turk, D., France, R. & Rumpe, B. (2005) Assumptions underlying agile software-development processes. Journal of Database Management, 16, 62-87.
68. Tversky, A. & Kahneman, D. (1973) Availability: a heuristic for judging frequency and probability. Cognitive Psychology, 5, 207-232.
69. Tversky, A. & Kahneman, D. (1974) Judgment under uncertainty: heuristics and biases. Science, 185, 1124-1131.
70. Vessey, I. & Conger, S. (1993) Learning to specify information requirements: the relationship between application and methodology. Journal of Management Information Systems, 10, 177-201.
71. Vitalari, N.P. (1992) Structuring the requirements analysis process for information systems: a prepositional viewpoint. In: Challenges and Strategies for Research in Systems Development, Cotterman, W.W. & Senn, JA. (eds), pp. 163-179. Wiley and Sons, New York, NY, USA.
72. Vitalari, N.P. & Dickson, G.W. (1983) Problem solving for effective systems analysis: an exploration. Communications of the ACM, 26, 948-956.
73. Walz, D.B., Elam, J.J. & Curtis, B. (1993) Inside a software design team: knowledge acquisition, sharing, and integration. Communications of the ACM, 36, 63-77.
74. Wason, P.C. (1971) Problem solving and reasoning. British Medical Bulletin, 27, 206-210.
75. Wason, P.C. & Johnson-Laird, P.N. (1972) Psychology of Reasoning: Structure and Content. Harvard University Press, Cambridge, MA, USA.
76. Watson, H.J. & Frolick, M.N. (1993) Determining information requirements for an EIS. MIS Quarterly, 17, 255-269.
77. Wetherbe, J.C. (1991) Executive information requirements: getting it right. MIS Quarterly, 15, 51-65.
78. Zahedi, F.M. (1999) Requirements analysis and maintenance: where the rubber hits the road in the systems-development cycle. Information Resources Management Journal, 12, 3-4.
79. Zmud, R.W., Anthony, W.P. & Stair, R.M., Jr (1993) The use of mental imagery to facilitate information identification in requirements analysis. Journal of Management Information Systems, 9, 175-191.