Experimenting with software testbeds for evaluating new technologies

Empirical Software Engineering

Volumn 12, Issue 4, 2007, Pages 417-444

  Lindvall, Mikael ^b   Rus, Ioana ^b   Donzelli, Paolo ^a   Memon, Atif ^a,b   Zelkowitz, Marvin ^a,b   Betin Can, Aysu ^d   Bultan, Tevfik ^c   Ackermann, Chris ^b   Anders, Bettina ^b   Asgari, Sima ^a   Basili, Victor ^a,b   Hochstein, Lorin ^e   Fellmann, Jörg ^b   Shull, Forrest ^b   Tvedt, Roseanne ^b   Pech, Daniel ^b   Hirschbach, Daniel ^a  

^a UNIVERSITY OF MARYLAND   (United States)

^b Fraunhofer USA Inc   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

^e UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Empirical study; Software testbed; Technology evaluation

Indexed keywords

EMPIRICAL STUDY; SOFTWARE TESTBEDS; TECHNOLOGY EVALUATION;

COST EFFECTIVENESS; DEFECTS; MATHEMATICAL MODELS; STANDARDS;

SOFTWARE ENGINEERING;

EID: 34547197840     PISSN: 13823256     EISSN: 15737616     Source Type: Journal    
DOI: 10.1007/s10664-006-9034-0     Document Type: Article

References (26)

1. Asgari S, Basili V, Costa P, Donzelli P, Hochstein L, Lindvall M, Rus I, Shull I, Tvedt R, Zelkowitz M (2004) Empirical-based estimation of the effect on software dependability of a technique for architecture conformance verification, ICSE/DSN 2004 twin workshop on architecting dependable systems (WADS 2004), Edinburgh, Scotland
2. Basili V, Donzelli P, Asgari S (2004) A unified model of dependability: capturing dependability in context. IEEE Softw 21(6): 19-25
3. Bhansali S, Nii HP (1992) Software design by reusing architectures. Proceedings of the Seventh Knowledge-Based Software Engineering Conference, McLean, Virginia, USA, pp 100-109
4. BetinCan A, Bultan T, Lindvall M, Lux B, Topp S (2005) Application of design for verification with concurrency controllers to air traffic control software. In: Proceedings of 20th IEEE/ACM international conference on automated software engineering, pp 14-23
5. Boehm B, Huang L, Jain A, Madachy R (2003) The nature of information system dependability - a stakeholder/value approach. USC Technical Report
6. Brat G, Havelund K, Park S, Visser W (2000) Java PathFinder - a second generation of a Java model checker. In: Proceedings of the workshop on advances in verification, July 2000, Chicago, USA
7. Brooks FP (1995) The mythical man-month. Addison Wesley, Reading, MA
8. Bultan T, Yavuz-Kahveci T (2001) Action language verifier. In: Proc. 16th IEEE international conference on automated software engineering, San Diego, USA, 382-386
9. Dennis G (2003) TSAFE: building a trusted computing base for air traffic control software. Masters Thesis, Computer Science Dept., Massachusetts Inst. Technology
10. Donzelli P, Basili V (2006) A practical framework for eliciting and modeling system dependability requirements: experience from the NASA high dependability computing project. J Syst Softw 79(1):107-119
11. Erzberger H (2001) The automated airspace concept. In: 4th USA/Europe air traffic management R&D seminar, Santa Fe, New-Mexico, USA
12. Erzberger H (2004) Transforming the NAS: the next generation air traffic control system. In: 24th International Congress of the Aeronautical Sciences, Yokohama, Japan
13. Godfrey MW, Lee EHS (2000) Secrets from the Monster: extracting Mozilla's software architecture. In: Proc 2nd symp. constructing software engineering tools (CoSET00), Limerick, Ireland, June. ACM Press, New York
14. Huynh D, Zelkowitz MV, Basili VR, Rus I (2003) Modeling dependability for a diverse set of stakeholders (Fast abstracts), Distributed Systems and Networks, San Francisco, CA, June, B6-B7
15. International Federation for Information Processing (IFIP WG-10.4) http://www.dependability.org
16. Laprie J-C (1992) Dependability: basic concepts and terminology, dependable computing and fault tolerance. Springer-Verlag, Vienna, Austria
17. Lehman MM (1996) Laws of software evolution revisited. In: European Workshop Software Process Technology, Nancy, France, October 1996. Springer, Berlin Heidelberg New York, pp 108-124
18. Lehman MM, Belady LA (1985) Program evolution: processes of software change. Harcourt Brace Jovanovich, London
19. Lindvall M, Rus I, Shull F, Zelkowitz MV, Donzelli P, Memon A, Basili VR, Costa P, Tvedt RT, Hochstein L, Asgari S, Ackermann C, Pech D (2005) An evolutionary testbed for software technology evaluation. NASA Journal of Innovations in Systems and Software Engineering 1:3-11
20. Memon A, Soffa M, Pollack ME (2001) Coverage criteria for GUI testing. 8th European software engineering conference (ESEC) and 9th ACM SIGSOFT international symposium on the foundations of software engineering (FSE-9). Vienna University of Technology, Austria, pp 256-267
21. Memon A, Banerjee I, Nagarajan A. (2003) What test oracle should I use for effective GUI testing? In: IEEE international conference on automated software engineering (ASE'03), Montreal, Canada, pp 164-173
22. Memon A, Nagarajan A, Xie Q (2005) Automating regression testing for evolving GUI software. Journal of Software Maintenance and Evolution: Research and Practice 17:27-64
23. Miodonski P, Forster T, Knodel J, Lindvall M, Muthig D (2004) Evaluation of software architechtures with eclipse, Institute for Empirical Software Engineering (IESE)-Report 107.04/E, Kaiserslautern, Germany
24. Randel B (1998) Dependability, a unifying concept. In: Proceedings of computer security, dependability and assurance: from needs to solutions, Williamsburg, VA. IEEE, Computer Society Press, Los Alamitos, CA, pp 16-25
25. Rus I, Basili V, Zelkowitz M, Boehm B (2002) Empirical evaluation techniques and methods used for achieving and assessing high dependability. Workshop on dependability benchmarking, The international conference of dependable systems & networks , June, Washington , DC, pp F19-F20
26. Tvedt RT, R Costa P, Lindvall M (2002) Does the code match the design? A process for architecture evaluation. In: IEEE, Proceedings of the international conference on software maintenance. Montreal, Canada, pp 393-401