Evaluating computer-supported cooperative work: Models and frameworks

Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

Volumn , Issue , 2004, Pages 112-121

  Neale, Dennis C ^a   Carroll, John M ^b   Rosson, Mary Beth ^b  

^a Virginia Polytechnic Institute and State University   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Awareness; Common ground; CSCW evaluation; Models

Indexed keywords

ASYNCHRONOUS INTERACTION; COMMON GROUND; COMPUTER-SUPPORTED COOPERATIVE WORK EVALUATION; MULTIFACETED EVALUATION;

AUTOMATION; COGNITIVE SYSTEMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; FAILURE ANALYSIS; HUMAN COMPUTER INTERACTION; PROBLEM SOLVING; RESEARCH;

COMPUTER SUPPORTED COOPERATIVE WORK;

EID: 21644457969     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (50)

1. Arrow, H., McGrath, J. E., and Berdahi, J. L. (2000). Small Groups as Complex Systems: Formation, Coordination, Development, and Adaptation. Thousand Oaks, CA: Sage.
2. Borghoff, U. M., and Schlichter, J. H. (2000). Computer-Supported Cooperative Work: Introduction to Distributed Applications: Springer.
3. Brooks, F. P. (1995). The Mythical Man-Mouth. Reading, Massachusetts: Addison-Wesley.
4. Carroll, J. M., Neale, D. C., Isenhour, P. L., Rosson, M. B., and McCrickard, D. S. (2003). Notification and awareness: synchronizing task-oriented collaborative activity. International Journal of Human-Computer Studies, 58, 605-632.
5. Carroll, J. M., Chin, G., Rosson, M. B., & Neale, D. C. (2000). The development of cooperation: Five years of participatory design in the virtual school. In Proceedings on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (pp. 239-251), New York: Association for Computing Machinery
6. Clark, H. H. (1996). Using Language. New York: Cambridge University Press.
7. Convertino, G., Neale, D. C., Hobby, L., Carroll, J. M., and Rosson, M. B. (2004). A laboratory method for studying activity awareness. In NordiCHI 2004 (to appear). Tampere, Finland: Association of Computing Machinery.
8. Damianos, L., Hirschman, L., Kozierok, R., Kurtz, J., Greenberg, A., Walls, K., Laskowski, S., and Scholtz, J. (1999). Evaluation for collaborative systems. ACM Computing Surveys, 31(2).
9. Dourish, P., and Bellotti, V. (1992). Awareness and coordination in shared workspaces. In Proceedings of the ACM CSCW '92 Conference on Computer Supported Cooperative Work (pp. 107-113). New York: Association for Computing Machinery.
10. Ganoe, C. H., Somervell, J. P., Neale, D. C., Isenhour, P. L., Carroll, J. M., Rosson, M. B., and McCrickard, D. S. (2003). Classroom BRIDGE: Using collaborative public and desktop timelines to support activity awareness. In Proceedings of the ACM '03 Symposium on User Interface Software and Technology (UIST) (pp. 21 -30). New York: Association for Computing Machinery.
11. Greene, J. C., Caracelli, V. J., and Graham, W. F. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11, 255-274.
12. Grudin, J. (1988). Why groupware applications fail: Problems in design and evaluation. Office: Technology and People, 4(3), 245-264.
13. Grudin, J. (2002). Group dynamics and ubiquitous computing. Communications of the ACM, 45(12), 74-78.
14. Hare, A. P. (1992). Groups, teams, and social interaction: Theories and applications. New York: Praeger.
15. Hartswood, M., and Procter, R. (2000). Design guidelines for dealing with breakdowns and repairs in collaborative work settings. International Journal of Human-Computer Studies, 53, 91-120.
16. Helms, J., Neale, D. C., and Carroll, J. M. (2000). Data logging: Higher-level capturing and multi-level abstracting of user activities. In Proceedings of the 40th Annual Meeting of the Human Factors and Ergonomics Society (pp. 303-306). Santa Monica, CA: Human Factors and Ergonomics Society.
17. Hendrick, H. W., and Kleiner, B. M. (2000). Macroergonomics: An introduction to work system design. (Vol. 2). Santa Monica, CA: Human Factors and Ergonomics Society.
18. Humphries, W., Neale, D. C., McCrickard, D. S., and Carroll, J. M. (2004). Laboratory Simulation Methods for Studying Complex Collaborative Tasks, In Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society. Human Factors and Ergonomics Society (to appear). Santa Monica, CA.
19. Isenhour, P. L., Carroll, J. M., Neale, D. C., Rosson, M. B., and Dunlap, D. R. (2000). The virtual school: An integrated collaborative environment for the classroom. Educational Technology and Society, Special Issue on "On-Line Collaborative Learning Environments", 3(3), http://ifets.ieee.org/periodical/.
20. Klein, G. (2001). Features of team coordination. In M. McNeese, E. Salas, and M. Endsley (Eds.), New Trends in Cooperative Activities: Understanding System Dynamics in Complex Environments (pp. 68-95). Santa Monica, CA: Human Factors and Ergonomics Society.
21. Malone, T. W., and Crowston, K. (1994). The interdisciplinary study of coordination. ACM Computing Surveys, 26(1), 87-119.
22. McGrath, J. E. (1984). Groups: Interaction and performance. Englewoods Cliffs, NJ: Prentice-Hall.
23. McGrath, J. E. (1990). Time matters in groups. In J. Galegher, R. E. Kraut, and C. Egido (Eds.), Intellectural Teamwork: Social and Technological Foundations of Cooperative Work (pp. 23-61). Hillsdale, N. J.: Lawrence Erlbaum.
24. McGrath, J. E. (1994). Methodology matters: Doing research in the behavioral and social sciences. In R. M. Baecker, J. Grudin, W. A. S. Buxton, and S. Greenberg (Eds.), Readings in human-computer interaction: Toward the year 2000 (pp. 152-169). San Francisco, CA: Morgan Kaufmann.
25. Miles, M. B., and Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook. Thousand Oaks, CA: Sage.
26. Nardi, B. A. E. (Ed.). (1996). Context and consciousness: Activity theory and human-computer interaction. Cambridge, MA: MIT Press.
27. Neale, D. C., and Carroll, J. M. (1999). Multi-faceted evaluation for complex, distributed activities. In Proceedings of CSCL'99 Computer Supported Cooperative Learning (pp. 425-433). Mahwah, New Jersy: Lawrence Erlbaum.
28. Neale, D. C., Dunlap, D. R., Isenhour, P., and Carroll, J. M. (2000). Collaborative critical incident development. In Proceedings of the 44th Annual Meeting of the Human Factors and Ergonomics Society (pp. 598-601). Santa Monica, CA: Human Factors and Ergonomics Society.
29. Olson, G. M., and Olson, J. S. (1997). Research on computer supported cooperative work. In M. Helander, T. K. Landauer, and P. Prablu (Eds.), Handbook of Human-Computer Interaction (pp. 1433-1456). Amsterdam, The Netherlands: Elsevier Science.
30. Olson, G. M., and Olson, J. S. (2000). Distance matters. Human-Computer Interaction, 15, 139-178.
31. Olson, G. M., and Olson, J. S. (2001). Technology support for collaborative workgroups. In G. M. Olson, T. W. Malone, and J. B. Smith (Eds.), Coordination Theory and Collaboration Technology (pp. 559-584). Mahwah, N. J.: Lawrence Erlbaum.
32. Pedhazur, E. J. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, New Jersey: Lawrence Erlbaum.
33. Pinelle, D., and Gutwin, C. (2000). A review of groupware evaluations. In Proceedings of the 9th IEEE WETICE (pp. 86-91).
34. Pinelle, D., Gutwin, C., and Greenberg, A. (2003). Task analysis for groupware usability evaluation: Modeling shared-workspace tasks with the mechanics of collaboration. Transactions on Computer-Human Interaction, 10(4), 281-311.
35. Pinsonneault, A., and Kraemer, K. L. (1989). The impact of technological support on groups: An assessment of the empirical research. Decision Support Systems, 5(2), 197-211.
36. Plowman, L., Rogers, Y., and Ramage, M. (1995). What are workplace studies for?. In Proceedings of ECSCW '95 European Conference on Computer-Supported Cooperative Work (pp. 309-324). Dordrecht: Kluwer.
37. Ross, S., Ramage, M., and Rogers, Y. (1995). PETRA: Participatory evaluation through redesign and analysis. Interacting with Computers, 7(4), 335-360.
38. Ruhleder, K., and Jordan, B. (1998). Video-based interaction analysis (VBIA) in distributed settings: A tool for analyzing multiple-site, technology-supported interactions. In Proceeding of the Participatory Design Conference (pp. 195-196). Seattle, WA.
39. Salvador, T., Scholtz, J., and Larson, J. (1996). The denver model for groupware design. SIGCHI Bulletin, 28(1), 52-58.
40. Sproull, L., and Kiesler, S. (1991). Connections: New ways of working in the networked organization. London: MIT Press.
41. Stanney, K. M., and Maxey, J. (1997). Socially centered design. In G. Salvendy (Ed.), Handbook of Human Factors and Ergonomics (2nd Edition) (pp. 637-656). New York: Wiley.
42. Suchman, L. (1987). Plans and situated actions. New York: Cambridge University Press.
43. Tashakkori, A., and Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: SAGE.
44. Thomas, P. J. (Ed.). (1996). CSCW Requirements and Evaluation. London: Springer.
45. Twidale, M., Randall, D., and Bentley, R. (1994). Situated evaluation for cooperative systems. In Proceedings of the ACM CSCW '94 Conference on Computer Supported Cooperative Work (pp. 441-452). New York: Association for Computing Machinery.
46. Vicente, K. J. (1997). Heeding the legacy of Meister, Brunswik, & Gibson: Toward a broader view of human factors research. Human Factors, 39(2), 323-328.
47. Watts, L., and Monk, A. (1996). Inter-personal awareness and synchronization: Assessing the value of communication technologies. International Journal of Human-Computer Studies, 44, 849-873.
48. Whittaker, S., and Schwarz, H. (1999). Meetings of the board: The impact of scheduling medium on long term group coordination in software development. Computer Supported Cooperative Work, 8, 175-205.
49. Woods, D. D. (2003). Discovering how distributed cognitive systems work. In E. Hollnagel (Ed.), Handbook of cognitive task design (pp. 37-53). Mahwah, N.J.: Lawarence Erlbaum.
50. Xiao, Y., and Vicente, K. J. (2000). A framework for epistemological analysis in empirical (laboratory and field) studies. Human Factors, 42(1), 87-101.