Using the focus group method in software engineering: Obtaining practitioner and user experiences

Proceedings - 2004 International Symposium on Empirical Software Engineering, ISESE 2004

Volumn , Issue , 2004, Pages 271-280

  Kontio, Jyrki ^a   Lehtola, Laura ^a   Bragge, Johanna ^b  

^a AALTO UNIVERSITY   (Finland)

^b HELSINKI SCHOOL OF ECONOMICS   (Finland)

Author keywords

Empirical research; Focus group method; Group support systems; Qualitative research methods; Requirements prioritization; Risk management; Usability

Indexed keywords

EMPIRICAL RESEARCH; FOCUS GROUP METHOD; GROUP SUPPORT SYSTEMS; QUALITATIVE RESEARCH METHODS; REQUIREMENTS PRIORITIZATION;

COMPUTER SOFTWARE SELECTION AND EVALUATION; DECISION SUPPORT SYSTEMS; QUALITY CONTROL; REQUIREMENTS ENGINEERING; RESEARCH; RISK MANAGEMENT; USABILITY ENGINEERING;

SOFTWARE ENGINEERING;

EID: 11244315261     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISESE.2004.1334914     Document Type: Conference Paper

References (49)

1. V.R.Basili, 'The Role of Experimentation in Software Engineering: Past, Current, and Future', in: Proceedings of the 18th International Conference on Software Engineering, (Mar, 1996), IEEE Computer Society, 442-449, 1996.
2. W.F.Tichy, 'Should Computer Scientists Experiment More?', IEEE Computer, 31, 32-40, (1998).
3. M.V.Zelkowitz and D.R.Wallace, 'Experimental Models for Validating Technology', IEEE Computer, 31, 23-31, (1998).
4. W.F.Tichy, P.Lukowicz, L.Prechelt, and E.A.Heinz, 'Experimental Evaluation in Computer Science: A Quantitative Study', Journal of Systems and Software, 28, 9-18, (1995).
5. N.Juristo and A.M.Moreno, Basics of Software Engineering Experimentation, Kluwer Academic Publishers, 2001.
6. C.Wohlin, P.Runeson, M.Host, and M.C.Ohlsson, Experimentation in Software Engineering: An Introduction, Kluwer Academic Pub, 1999.
7. I.Benbasat, 'Rethinking Diversity in Information Systems Research', Information Systems Research, 7, 389-399, (1996).
8. R.D.Galliers, 'Choosing appropriate information systems research approaches: A revised taxonomy', in: Information Systems Research: Contemporary Approaches and Emerging Traditions, H.-E.Nissen, H.K.Klein and R.Hirschheim, eds. Elsevier Science Publishers, 327-345, 1991.
9. P.Ghauri, K.Grønhaug, and I.Kristianslund, Research Methods in Business Studies, Prentice Hall, 1995.
10. N.E.Fenton, S.L.Pfleeger, and R.A.Glass, 'Science and Substance: A Challenge to Software Engineers', IEEE Software, 11, 86-95, (1994).
11. D.R.Jeffery and L.G.Votta, 'Empirical Software Engineering', IEEE Transactions on Software Engineering, 25, 435-437, (1999).
12. J.F.Templeton, The Focus Group: A Strategic Guide to Organizing, Conducting and Analyzing the Focus Group Interview, McGraw-Hill Professional Publishing, 1994.
13. J.Langford and D.McDonaugh, Focus Groups. Supporting Effective Product Development, Taylor and Francis, 2003.
14. R.Widdows, T.A.Hensler, and M.H.Wyncott, 'The Focus Group Interview: A Method for Assessing User's Evaluation of Library Service', College and Research Libraries, 352-359, (1991).
15. C.M.Judd, E.R.Smith, and L.H.Kidder, Research Methods in Social Relations, Harcourt Brace Jovanovich College Publishers, 1991.
16. S.L.Baker, 'Improving Business Services through the Use of Focus Groups', Reference Quarterly, 30, 377-385, (1991).
17. H.Edmunds. The Focus Group Research Handbook, Ntc Business Books, 1991.
18. D.L.Morgan, Focus Groups as Qualitative Research, Sage Publications, 1997.
19. J.Neter and J.Waksberg, 'A Study of Response Errors in Expenditure Data from Household Interviews', Journal of the American Statistical Association, 59, 18-55, (1964).
20. D.W.Stewart and P.N.Shamdasani, Focus Groups: Theory and Practice, Sage, 1990.
21. J.Rubin, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, John Wiley & Sons, 1994.
22. M.Lindvall, V.R.Basili, B.W.Boehm, et al, 'Empirical Findings in Agile Methods', in: Proceedings of Extreme Programming and Agile Methods - XP/Agile universe 2002, 197-207, 2002.
23. Anonymous, Focus Group Kit (Focus Group Kit, Vol 1-6), Sage Publications, 1997.
24. B.Feig, 'How to Run a Focus Group', American Demographics, 11, 36-37, (1989).
25. R.A.Krueger and M.A.Casey, Focus Groups: A Practical Guide for Applied Research, Sage Publications, 2000.
26. J.Nielsen, 'The Use and Misuse of Focus Groups', IEEE Software, 94-95, (1997).
27. E.F.McQuarrie, 'New books in review: The handbook for focus group research & Successful focus groups: advancing the state of the art', Journal of Marketing Research, 31, 377-380, (1994).
28. E.F.McQuarrie, 'New Books in Review: The mirrored window: focus groups from a moderator's point of view & Advanced focus group research', Journal of Marketing Research, 38, 515-516, (2001).
29. M.Adler and E.Ziglio, Gazing into the Oracle: The Delphi Method and Its Application to Social Policy and Public Health, Jessica Kingsley Pub, 1996.
30. R.C.Bogdan and S.K.Biklen, Qualitative Research for Education: An Introduction to Theory and Methods, Allyn and Bacon Inc., 1982.
31. M.B.Miles and A.M.Huberman, Qualitative data analysis: a sourcebook of new methods, Sage Publications, 1984.
32. M.Q.Patton, Qualitative Evaluation and Research Methods, SAGE Publications, 1990.
33. S.J.Taylor and R.Bogdan, Introduction to Qualitative Research Methods, John Wiley and Sons, 1984.
34. M.Myers. Qualitative Research in Information Systems. ISWorld. 2004.
35. J.Kontio, Software Engineering Risk Management: A Method, Improvement Framework, and Empirical Evaluation. Doctoral dissertation.(2001). Helsinki University of Technology, publisher: Center of Excellence, ISBN: 952-5136-22-1: Ph.D.
36. L.Lehtola, M.Kauppinen, and S.Kujala. 'Requirements Prioritization Challenges in Practice', in: 5th International Conference on Product Focused Software Process Improvement, 2004.
37. A.Sunikka, Usability evaluation of the Helsinki School of Economics Website. Master's thesis.(2004). Helsinki School of Economics: 94 p.
38. J.Kontio, The Riskit Method for Software Risk Management, version 1.00. (College Park, MD, University of Maryland, 1997) CS-TR-3782 / UMIACS-TR-97-38, Computer Science Technical Reports.
39. M.Brassard and D.Ritter, The Memory Jogger, GOAL/QPC, 1994.
40. R.K. Yin, Case Study Research: Design and Methods, SAGE Publications, 1994.
41. D.L.Clapper and A.P.Massey, 'Electronic focus groups: A framework for exploration', Information & Management, 30, 43-50, (1996).
42. G.Easton, A.Easton, and M.Belch, 'An experimental investigation of electronic focus groups', Information & Management, 40, 717-727, (2003).
43. M.Parent, R.B.Gallupe, W.D.Salisbury, and J.M.Handelman, 'Knowledge creation in focus groups: can group technologies help?', Information & Management, 38, 47-58, (2000).
44. J.Nunamaker, R.O.Briggs, D.D.Mittleman, D.R.Vogel, and P.A.Balthazard, 'Lessons from a Dozen Yeas of Group Support Systems Research: A Discussion of Lab and Field Findings', Journal of Management Information Systems, 13, 163-207, (1997).
45. J.F.Nunamaker, A.R.Dennis, J.S.Valacich, D.R.Vogel, and J.F.George, 'Electronic Meeting Systems to Support Group Work', Communications of the ACM, 34, 40-61, (1991).
46. E.F.McQuarrie and S.H.McIntyre, 'Focus groups and the development of new products by technologically driven companies: some guidelines', Journal of Product Innovation Management, 1, 40-47, (1986).
47. S.Nambisan and D.Wilemon, 'Software development and new product development: Potentials for cross-domain knowledge sharing', IEEE Transactions on Engineering Management, 47, 211-220, (2000).
48. S.Nambisan, 'Information Systems as a Reference Discipline for New Product Development', MIS Quarterly, 27, 1-18, (2003).
49. R.O.Briggs, G.J.De Vreede, and J.F.Nunamaker, 'Collaboration Engineering with ThinkLets to Pursue Sustained Success with Group Support Systems', Journal of Management Information Systems, 19, 31-64, (2003).