Empirical evaluation of a process to increase consensus in group architectural decision making

Information and Software Technology

Volumn 72, Issue , 2016, Pages 31-47

  Tofan, Dan ^a   Galster, Matthias ^b   Lytra, Ioanna ^c   Avgeriou, Paris ^a   Zdun, Uwe ^c   Fouche, Mark Anthony ^d   De Boer, Remco ^e   Solms, Fritz ^d  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b UNIVERSITY OF CANTERBURY   (New Zealand)

^c UNIVERSITY OF VIENNA   (Austria)

^d UNIVERSITY OF PRETORIA   (South Africa)

^e XLandKnowledge ^*  (Netherlands)

Author keywords

Decision making; Group architecture decisions; Software architecture

Indexed keywords

EQUIPMENT; SOFTWARE ARCHITECTURE;

ARCHITECTURAL DECISION; ARCHITECTURAL DECISION MAKINGS; ARCHITECTURE DECISIONS; EMPIRICAL EVALUATIONS; EMPIRICAL STUDIES; EXPLORATORY CASE STUDIES; POTENTIAL OUTCOMES; SOFTWARE ARCHITECTURAL;

DECISION MAKING;

EID: 84958620080     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2015.12.002     Document Type: Article

References (57)

1. A. Jansen, J. Bosch Software architecture as a set of architectural design decisions Fifth Working IEEE/IFIP Conference on Software Architecture 2005 109 120
2. O. Zimmermann Architectural decisions as reusable design assets IEEE Softw. 28 2011 64 69
3. D. Tofan, M. Galster, P. Avgeriou Difficulty of architectural decisions - a survey with professional architects Seventh European Conference on Software Architecture 2013 Springer 192 199
4. C. Miesbauer, R. Weinreich Classification of design decisions - an expert survey in practice K. Drira Software Architecture 2013 Springer Berlin, Heidelberg 130 145
5. D. Tofan, M. Galster, P. Avgeriou, W. Schuitema Past and future of software architectural decisions - a systematic mapping study Inf. Softw. Technol. 56 2014 850 872
6. M. Svahnberg An industrial study on building consensus around software architectures and quality attributes Inf. Softw. Technol. 46 2004 805 818
7. W.J. Tastle, M.J. Wierman Consensus and dissention: a measure of ordinal dispersion Int. J. Approximate Reasoning 45 2007 531 545
8. D. Tofan, P. Avgeriou, M. Galster Validating and improving a knowledge acquisition approach for architectural decisions Int. J. Softw. Eng. Knowl. Eng. 24 2014 553 589
9. D. Tofan, M. Galster, P. Avgeriou Capturing tacit architectural knowledge using the repertory grid technique (NIER track) 33rd International Conference on Software Engineering 2011 916 919
10. D. Tofan, M. Galster, P. Avgeriou Reducing architectural knowledge vaporization by applying the repertory grid technique Fifth European Conference on Software Architecture 2011 Springer Germany 244 251
11. H. Linstone, M. Turoff The Delphi Method: Techniques and Applications 2002
12. D. Jankowicz The Easy Guide to Repertory Grids 2003 Wiley
13. M. Hassenzahl, R. Wessler Capturing design space from a user perspective: the repertory grid technique revisited Int. J. Hum.-Comput. Interact. 12 2000 441 459
14. A.F. Osborn Applied Imagination; Principles and Procedures of Creative Problem-solving: Principles and Procedures of Creative Problem-solving 1963
15. A.L. Delbecq, A.H. Van de Ven A group process model for problem identification and program planning J. Appl. Behav. Sci. 7 1971 466 492
16. P. Runeson, M. Host, A. Rainer, B. Regnell Case Study Research in Software Engineering: Guidelines and Examples 2012 John Wiley & Sons
17. P. Runeson, M. Höst Guidelines for conducting and reporting case study research in software engineering Empirical Softw. Eng. 14 2009 131 164
18. K. Krippendorff Content Analysis: An Introduction to Its Methodology 2004 Sage Publications, Inc
19. D. Tofan, Appendix. http://www.cs.rug.nl/∼dan/GADGETexperiment/, 2015 (accessed September).
20. D. Tofan, M. Galster Capturing and making architectural decisions: an open source online tool Proceedings of the 2014 European Conference on Software Architecture Workshops 2014 ACM Vienna, Austria 1 4
21. R.K. Yin Case Study Research: Design and Methods 2003 Sage Publications
22. A. Jedlitschka, M. Ciolkowski, D. Pfahl Reporting experiments in software engineering F. Shull J. Singer D. Sjøberg Guide to Advanced Empirical Software Engineering 2008 Springer 201 228
23. V. Venkatesh, F.D. Davis A theoretical extension of the technology acceptance model: four longitudinal field studies Manage. Sci. 46 2000 186 204
24. M. Kubickova, H. Ro Are students "Real People"? The Use of Student Subjects in Hospitality Research 2011
25. P. Runeson Using students as experiment subjects - an analysis on graduate and freshmen student data Proceedings of the Seventh International Conference on Empirical Assessment in Software Engineering 2003 Keele University UK 95 102
26. M. Svahnberg, A. Aurum, C. Wohlin Using students as subjects - an empirical evaluation Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement 2008 ACM Kaiserslautern, Germany 288 290
27. P. Berander Using students as subjects in requirements prioritization Proceedings of the International Symposium on Empirical Software Engineering 2004 167 176
28. J.C. Carver, L. Jaccheri, S. Morasca, F. Shull A checklist for integrating student empirical studies with research and teaching goals Empirical Softw. Eng. 15 2009 35 59
29. M. Galster, D. Tofan, P. Avgeriou On integrating student empirical software engineering studies with research and teaching goals Proceeding of the Evaluation and Assessment in Software Engineering 2012
30. K. Tselios, P. Avgeriou, D. Tofan Two Empirical Studies on Decision-making Processes in Software Architecture 2012 University of Groningen Master's thesis
31. C. Wohlin, P. Runeson, M. Hst, M.C. Ohlsson, B. Regnell, A. Wessln Experimentation in Software Engineering 2012 Springer Publishing Company, Incorporated
32. D.M. Schweiger, W.R. Sandberg, J.W. Ragan Group approaches for improving strategic decision making: a comparative analysis of dialectical inquiry, devil's advocacy, and consensus Acad. Manage. J. 29 1986 51 71
33. R.T. Hartwig Facilitating problem solving: a case study using the devil's advocacy technique Group Facilitation: Res. Appl. J. 10 2010 17
34. A. Jansen, J. van der Ven, P. Avgeriou, D.K. Hammer Tool support for architectural decisions Proceedings of Working IEEE/IFIP Conference on Software Architecture WICSA '07 2007 pp. 4-4
35. A. Tang, H. van Vliet Software architecture design reasoning Software Architecture Knowledge Management 2009 Springer 155 174
36. V.S. Lai, B.K. Wong, W. Cheung Group decision making in a multiple criteria environment: a case using the AHP in software selection Eur. J. Oper. Res. 137 2002 134 144
37. B.C. Hardgrave, F.D. Davis, C.K. Riemenschneider Investigating determinants of software developers' intentions to follow methodologies J. Manage. Inf. Syst. 20 2003 123 151
38. B. Kitchenham, S.L. Pfleeger, L.M. Pickard, P.W. Jones, D.C. Hoaglin, K. El Emam, J. Rosenberg Preliminary guidelines for empirical research in software engineering IEEE Trans. Softw. Eng. 28 2002 721 734
39. E. Herrera-Viedma, F. Herrera, F. Chiclana A consensus model for multiperson decision making with different preference structures IEEE Trans. Syst. Man Cybern. - Part A: Syst. Hum. 32 2002 394 402
40. E. Herrera-Viedma, L. Martinez, F. Mata, F. Chiclana A consensus support system model for group decision-making problems with multigranular linguistic preference relations IEEE Trans. Fuzzy Syst. 13 2005 644 658
41. C. Zannier, M. Chiasson, F. Maurer A model of design decision making based on empirical results of interviews with software designers Inf. Softw. Technol. 49 2007 637 653
42. R. Kazman, M. Klein Quantifying the costs and benefits of architectural decisions Proceedings of the International Conference on Software Engineering 2001 IEEE 297 306
43. R. Kazman, H.P. In, H.-M. Chen From requirements negotiation to software architecture decisions Inf. Softw. Technol. 47 2005 511 520
44. S. Rekha, H. Muccini A study on group decision-making in software architecture 11th Working IEEE/IFIP Conference on Software Architecture (WICSA 2014) 2014
45. M. Nowak, C. Pautasso Team situational awareness and architectural decision making with the software architecture warehouse K. Drira Software Architecture 2013 Springer Berlin, Heidelberg 146 161
46. P. Gaubatz, I. Lytra, U. Zdun Automatic enforcement of constraints in real-time collaborative architectural decision making J. Syst. Softw. 103 2015 128 149
47. I. Groher, R. Weinreich Collecting requirements and ideas for architectural group decision-making based on four approaches Proceedings of the Ninth European Conference on Software Architecture 2015 181 192
48. M.A. Babar, B. Kitchenham, L. Zhu, I. Gorton, R. Jeffery An empirical study of groupware support for distributed software architecture evaluation process J. Syst. Softw. 79 2006 912 925
49. T. Al-Naeem, I. Gorton, M.A. Babar, F. Rabhi, B. Benatallah A quality-driven systematic approach for architecting distributed software applications Proceedings of the International Conference on Software Engineering 2005 ACM New York, USA 244 253
50. A. Nakakawa, P. Bommel, E. Proper Towards a theory on collaborative decision making in enterprise architecture R. Winter J.L. Zhao S. Aier Global Perspectives on Design Science Research 2010 Springer Berlin, Heidelberg 538 541
51. K. Sousa, H. Mendonça, E. Furtado Applying a multi-criteria approach for the selection of usability patterns in the development of DTV applications Proceedings of VII Brazilian Symposium on Human Factors in Computing Systems 2006 ACM Natal, RN, Brazil 91 100
52. D. Falessi, G. Cantone, M. Becker Documenting design decision rationale to improve individual and team design decision making: an experimental evaluation Proceedings of the 2006 ACM/IEEE International Symposium on Empirical Software Engineering 2006 ACM 134 143
53. K. Mohan, B. Ramesh Traceability-based knowledge integration in group decision and negotiation activities Decis. Support Syst. 43 2007 968 989
54. O. Zimmermann, J. Koehler, F. Leymann, R. Polley, N. Schuster Managing architectural decision models with dependency relations, integrity constraints, and production rules J. Syst. Softw. 82 2009 1249 1267
55. A. Tang Software designers, are you biased? Proceeding of the Sixth International Workshop on SHAring and Reusing Architectural Knowledge 2011 1 8
56. R. Kazman, M. Barbacci, M. Klein, S. Jeromy Carriere, S.G. Woods Experience with performing architecture tradeoff analysis 21st International Conference on Software Engineering 1999 IEEE 54 63
57. R. Wojcik, F. Bachmann, L. Bass, P. Clements, P. Merson, R. Nord, B. Wood, Attribute-driven Design (ADD), Version 2.0, 2006.