Development of a work sampling methodology for behavioral observations: Application to teamwork

Journal of Engineering Education

Volumn 96, Issue 4, 2007, Pages 347-357

  Besterfield Sacre, Mary ^a,b   Shuman, Larry J ^a,b   Wolfe, Harvey ^a,b   Clark, Renee M ^a,b   Yildirim, Pinar ^a,b  

^a PA 15260   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Behavioral observation; Teamwork; Work sampling

Indexed keywords

ECONOMIC ANALYSIS; ENGINEERING EDUCATION; LEARNING SYSTEMS; PROBLEM SOLVING; ROBUSTNESS (CONTROL SYSTEMS); STATISTICAL METHODS; STUDENTS;

BEHAVIORAL OBSERVATION; TEAMWORK; UNDERSTANDING PROCESSES; WORK SAMPLING;

BEHAVIORAL RESEARCH;

EID: 35948984781     PISSN: 10694730     EISSN: None     Source Type: Journal    
DOI: 10.1002/j.2168-9830.2007.tb00944.x     Document Type: Conference Paper

References (44)

1. "Criteria for Accrediting Engineering Programs Effective for Evaluations During the 2006-2007 Accreditation Cycle," www.abet.org/forms. shtml.
2. Besterfield-Sacre, M.E., C.J. Atman, and L.J. Shuman, "Engineering Student Attitudes Assessment," Journal of Engineering Education, Vol. 87, No. 2, 1998, pp. 133-141.
3. McGourty, J.M., L.J. Shuman, M. Besterfield-Sacre, C.J. Atman, R. Miller, B. Olds, G. Rogers, and H. Wolfe, "Preparing for ABET EC 2000: Research-Based Assessment Methods and Processes," International Journal of Engineering Education, Vol. 18, No. 2, 2002, pp. 157-167.
4. McGourty, J.M., and K. De Meuse, The Team Developer: An Assessment and Skill Building Program, New York, NY: J. Wiley and Company, 2000.
5. Bennett, M.J., "A Developmental Approach to Training for Intercultural Sensitivity," International Journal of Intercultural Relations, Vol. 10, No. 2, 1986, pp. 179-95.
6. Bennett, M.J., "Towards Ethnorelativism: A Developmental Model of Intercultural Sensitivity," in M. Paige (Ed.), Education for the Intercultural Experience, Yarmoudi, ME: Intercultural Press, 1993.
7. Litzinger, T.A., S.H. Lee, and J.C. Wise, "Assessing Readiness for Self-Directed Learning," (Web) Proceedings, 2004 American Society for Engineering Education Conference and Exposition, www.asee.org/acPapers/2004- 649_Final.pdf.
8. Litzinger, T.A., J.C. Wise, and S.H. Lee, "Self-directed Learning Readiness Among Undergraduate Engineering Students," Journal of Engineering Education, Vol. 94, No. 2, 2005, pp. 215-221.
9. Lattuca, L., P.T. Terenzini, and J.F. Volkwein, Engineering Change: A Study of the Impact of EC2000, Executive Summary, Baltimore, MD: ABET, Inc., 2006, www.abet.org/papers.shtml.
10. Besterfield-Sacre, M, and LJ Shuman, "The Future of Assessment," in J. Spurlin, S. Rajala, and J. Lavelle (Eds.), Constructing and Sustaining Effective Assessment of Engineering Education, Herndon, VA: Stylus Publishing, LLC., forthcoming August 2007.
11. Pandy, MG, AJ Petrosino, BA Austin, and RE Barr, "Assessing Adaptive Expertise in Undergraduate Biomechanics," Journal of Engineering Education, Vol. 93, No. 3, 2004, pp. 211-222.
12. Steering Committee of the National Engineering Education Research Colloquies, "The Research Agenda for the New Discipline of Engineering Education," Journal of Engineering Education, Vol. 95, No. 4, 2006, pp. 259-261.
13. Brereton, M., J. Greeno, J. Lewis, C. Linde, and L. Leifer, "An Exploration of Engineering Learning, Proceedings of the 1993 ASME Design Theory and Methodology Conference, pp. 195-206.
14. Bucciarelli, L.L., Designing Engineers, Cambridge, MA: The MIT Press, 1994.
15. Aft, L., Work Measurement and Methods Improvement, New York, NY: John Wiley & Sons, Inc., 2000.
16. Chapanis, A., Research Techniques in Human Engineering, Baltimore, MD: The Johns Hopkins Press, 1959.
17. Wolfe, H., and J.P. Young, "Staffing the Nursing Unit: Part I - Controlled Variable Staffing," Nursing Research, Vol. 14, No. 3, 1965, pp. 236-242.
18. Wolfe, H., and J.P. Young, "Staffing the Nursing Unit: Part II - Multiple Assignment Technique," Nursing Research, Vol. 14, No. 4, 1965, pp. 299-303.
19. Hendricks, G.C. et al., "Effects of Behavioral Self Observation on Elementary Teachers and Students," Technical Report No. 121, Stanford Center for Research and Development in Teaching. Stanford University, 1974.
20. Juran, J.M., and F. Gryna, Jr., Quality Planning and Analysis from Product Development Through Use, New York, NY: McGraw-Hill Publishing Company, 1980, pp. 377.
21. Seat, E., and S.M. Lord, "Enabling Effective Engineering Teams: A Program for Teaching Interaction Skills," Journal of Engineering Education, Vol. 89, No. 4, 1999, pp. 385-390.
22. Robillard, P.N., "Measuring Team Activities in a Process-Oriented Software Engineering Course," Proceedings, 11th Conference on Software Engineering Education, Feb. 22-25, 1998, pp. 90-101.
23. Thompson, R.S., "A Repeated Measures Design for Assessment of Critical Team Skills in Multidisciplinary Teams," Proceedings, 2000 ASEE Annual Conference and Exposition, St. Louis, MO,June 18-22, 2000.
24. Schmidt, L., J. Schmidt, D. Bigio, P. Smith, and L. Harper, "Engineering Students and Training in Teamwork How Effective?" (CD) Proceedings, 2003 ASEE Annual Conference and Exposition; Nashville, TN; June 22-25, 2003.
25. Tonso, K.L., "Teams that Work: Campus Culture, Engineer Identity, and Social Interactions," Journal of Engineering Education, Vol. 95, No. 1, 2006, pp. 25-37.
26. Whitman, L.E., D.E. Malzahn, B.S. Chaparro, M. Russell, R. Langrall, and B.A. Mohler, "A Comparison of Group Processes, Performance, and Satisfaction in Face-to-Face Versus Computer-Mediated Engineering Student Design Teams," Journal of Engineering Education, Vol. 94, No. 3, 2005, pp. 327-333.
27. Davis, D.C., K.L. Gentili, M.S. Trevisan, and D.E. Calkins, "Engineering Design Assessment Processes and Scoring Scales for Program Improvement and Accountability," Journal of Engineering Education, Vol. 91, No. 2, 2002, pp. 211-221.
28. Dominick, P.G., P.G. Reilly, and J. McGourty, "The Effects of a Peer Feedback Instrument on Team Member Behavior," Group and Organization Management, Vol. 22, No. 4, 1997, pp. 508-520.
29. Tziner, A., and R. Kopelman, "Effects of Rating Format on Goal-Setting Dimensions: A Field Experiment," Journal of Applied Psychology, Vol. 73, No. 2, 1988, pp. 323-326.
30. Shuman, L.J., M. Besterfield-Sacre, H. Wolfe, C.J. Atman, J. McGourty, R.L. Miller, B.M. Olds, and G.M. Rogers, "Matching Assessment Methods to Outcomes: Definitions and Research Questions," Proceedings, American Society for Engineering Education Conference and Exposition, St. Louis, MO, 2000.
31. Besterfield-Sacre, M., L.J. Shuman, H. Wolfe, C.J. Atman, J. McGourty, R.L. Miller, B.M. Olds, and G.M. Rogers, "Defining the Outcomes: A framework for EC 2000," IEEE Transactions on Engineering Education, Vol. 43, No. 2, 2000, pp. 100-110.
32. Bloom, B.S., M.D. Englehart, E.J. Furst, W.H. Hill, and D.R. Krathwohl, Taxonomy of Educational Objectives Handbook 1: Cognitive Domain, New York, NY: Longman, 1956.
33. Krathwohl, D.R., B.S. Bloom, and B.B. Masia, Taxonomy of Educational Objectives: The Classification of Educational Goals Handbook II: Affective Domain, New York, NY: McKay Company Inc., 1956.
34. McBeath, R., (Ed.), Instructing and Evaluating in Higher Education: A Guidebook for Planning Learning Outcomes, Englewood Cliffs, NJ: Educational Technology Publications Inc., 1992.
35. McGourty, J., "Using Multisource Feedback in the Classroom: A Computer-based Approach," IEEE Transactions on Education, Vol. 43, No. 2, 2000, pp. 120-124.
36. McGourty, J., and K.P. DeMeuse, The Team Developer: A Skill Building and Feedback Program, New York, NY: Wiley, 2000.
37. Dominick, P.G., P.G. Reilly, and J. McGourty, 1997, op. cit.
38. Thompson, 2000, op. cit.
39. Atman, C.J., and K.M. Bursic, "Documenting a Process: The Use of Verbal Protocol Analysis to Study Engineering Student Design, Journal of Engineering Education, Special Issue on Assessment, Vol. 87, No. 2, 1998, pp. 121-132.
40. Anderson, V.L., and R.A. McLean, Design of Experiments a Realistic Approach, New York, NY: Marcel Dekker Inc., 1974, pp. 24-25.
41. Richardson, W.J., and E.S. Pape, "Work Sampling," in Salvendy, G. (Ed.). Handbook of Industrial Engineering, New York, NY: John Wiley, 1982.
42. Bucciarelli, L., "Design Delta Design: Seeing/Seeing As," Proceedings,Design Thinking Research Symposium 5: Design Representation, MIT, April, 1999.
43. Yildirim, T.P., M. Besterfield-Sacre, L.J. Shuman, R. Clark, and M. Bailey, "Markov Chain Approach for Analyzing the Teamwork Process," working paper, 2007.
44. Yildirim, T.P., M. Besterfield-Sacre, L.J. Shuman, and R. Clark, "An Analysis of Engineering Design Using Markov Chains," working paper, 2007.