Comparing design team self-reports with actual performance: Cross-validating assessment instruments

ASEE Annual Conference Proceedings

Volumn , Issue , 2002, Pages 5783-5798

  Adams, Robin ^a   Punnakanta, Pimpida ^a   Atman, Cynthia J ^a   Lewis, Craig D ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ENGINEERING DESIGNS; MID-PROGRAM ASSESSMENT INSTRUMENTS;

CURRICULA; INFORMATION DISSEMINATION; INSTRUMENT ERRORS; STRUCTURAL DESIGN; STUDENTS; TECHNICAL PRESENTATIONS;

ENGINEERING EDUCATION;

EID: 8744274207     PISSN: 01901052     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. American Society of Engineering Education (1994). Engineering education for a changing world. Engineering Deans Council and Corporate Roundtable of ASEE.
2. National Research Council (1995). Engineering Education: Designing an Adaptive System. Washington, DC: National Academy Press.
3. National Science Foundation (1995). Restructuring engineering education: a focus on change. Washington DC: National Science Foundation.
4. Accreditation Board for Engineering and Technology, (1998). Engineering Criteria 2000: Criteria for accrediting programs in engineering in the United States (2nd edition). Engineering Accreditation Commission, Accreditation Board for Engineering and Technology, http://www.abet.org
5. Campbell, S. & C. L. Colbeck (1998). Teaching and Assessing Engineering Design: A Review of the Research. Proceedings of the Annual Conference of the American Society of Engineering Education, Seattle, WA.
6. Shaeiwitz, J.A. (1996). Outcomes assessment in engineering education. Journal of Engineering Education, 85 (3), pp. 239-246.
7. Terenzini, P.T., Cabrera, A.F., Colbeck, C.L., Parente, J.M. & S.A. Bjorklund (2001). Collaborative Learning vs. Lecture/Discussion: Students' Reported Learning Gains. Journal of Engineering Education, January, pp. 123-130.
8. Terenzini, P.T., Cabrera, A.F., Parente, J.M., & S.A. Bjorklund (1998). Preparing for ABET 2000: Assessment at the Classroom Level. Proceedings of the Annual ASEE Conference, Seattle, WA.
9. Byrd, J.S. & J.L. Hudgins (1995). Teaming in the design laboratory. Journal of Engineering Education, 84 (4), pp. 335-341.
10. Van Duzer, E. & F. McMartin (2000). Building Better Teamwork Assessments: A Process for Improving the Validity and Sensitivity of Self/Peer Ratings. Proceedings of the Annual Conference of the American Society of Engineering Education, St. Louis, MO.
11. Dym, C. L. (1994). Teaching design to freshman: Style and content. Journal of Engineering Education, 83 (4), pp. 303-310.
12. Miller, R.L. & B.M. Olds (1994). A model curriculum for a capstone course in multidisciplinary engineering design. Journal of Engineering Education, 83 (4), pp. 311-316.
13. Rogers, G.M. & J. M. Williams (1999). Asynchronous Assessment: Using Electronic Portfolios to Assess Student Outcomes. Proceedings of the Annual ASEE Conference, Charlotte, NC.
14. Olds, B.M. & M.J. Pavelich (1996). A Portfolio-Based Assessment Program. Proceedings of the Annual Conference of the American Society of Engineering Education.
15. Davis, D.C., Gentili, K.L., Calkins, D.E. & M.S. Trevisan (1998). Mid-Program Assessment of Team-Based Engineering Design: Concepts, Methods, and Materials. Washington State University, Pullman, WA.
16. Davis, D.C., Gentili, K.L., Trevisan, M.S., Christianson, R.K. & J.F. McCauley (1999). Measuring Learning Outcomes for Engineering Design Education. Proceedings of the Annual Conference of the American Society of Engineering Education, Charlotte, NC.
17. Atman, C.J., Adams, R.S. & J. Turns (2000). Using multiple methods to evaluate a freshmen design course. Proceedings of the Frontiers in Education Annual Conference, Kansas City, KA.
18. Thompson, R. S. (2001). Reliability, Validity, and Bias in Peer Evaluations of Self-Directed Interdependent Work Teams. Proceedings of the Annual Conference of the American Society of Engineering Education, Albuquerque, NM.
19. Le Bold, W. & D. Budny (1995). How do students grade their learning. Proceedings of the Frontiers in Education Annual Conference, Atlanta, GA.
20. Baird, L. L. (1977). Using self-reports to predict student performance. Research Monograph, 72 (4): pp. 33-39.
21. Cronbach, L. J. & F. C. Gleser (1957). Psychological tests and personnel decisions. Urbana, IL: University of Illinois Press.
22. Adams, R.S., Atman, C.J., Nakamura, R., Kalonji, G. & D. Denton (2002). Assessment of an International Freshmen Research and Design Experience: A Triangulation Study. International Journal of Engineering Education, February (in print).
23. Trevisan, M.S., Davis, D., Crain, R.W., Calkins, D.E. & K.L. Gentili (1998). Developing and Assessing Statewide Competencies for Engineering Design. Journal of Engineering Education, April, pp. 185-193.
24. URL: http://www.cea.wsu.edu/TIDEE.
25. Atman, C.J., Chimka, J.R., Bursic, K.M. & H. L. Nachtman (1999). A Comparison of Freshman and Senior Engineering Design Processes. Design Studies, Vol. 20, No., 2, pp. 131-152.
26. Adams, R.S. (2001). Cognitive Processes in Iterative Design Behavior. Dissertation in the College of Education, Seattle, University of Washington.
27. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: The MIT Press.
28. Atman, C. J., & Bursic, K. M. (1998). Verbal protocol analysis as a method to document engineering student design processes. Journal of Engineering Education, April, pp. 121-132.
29. Cross, N., Christiaans, H., & K. Dorst (1996). Analysing design activity, John Wiley & Sons.
30. Mullins, C.A., Atman, C.J., & L. Shuman (1996). Freshmen engineer's strategies and performance when approaching design problems. IEEE Transactions on Education, October.
31. Atman, C.J. & K.M. Bursic (1996). Teaching engineering design: Can reading a textbook make a difference? Research in Engineering Design, 8, pp. 240-250.
32. Bucciarelli, L. L. (1996). Designing engineers. Cambridge: MIT Press.
33. Tang, J. C., & Leifer, L. J. (1991). An observational methodoloy for studying group design activity. Research in Engineering Design, 2, pp. 209-219.
34. Chi, M.T.H. (1997). Quantifying qualitative analyses of verbal data: A practical guide. The Journal of the Learning Sciences, 6 (3), pp. 271-315.
35. Moore, P. L., & C. J. Atman (1995). Do freshmen design texts adequately define the engineering design process. Proceedings of the Annual Conference of the American Society of Engineering Education, Pittsburgh, PA.
36. Sanderson, P.M., Scott, J.J.P., Johnston, T., Mainzer, J, Watanabe, L.M., & J.M. James (1994). MacSHAPA and the enterprise of Exploratory Sequential Data Analysis (ESDA). International Journal of Human-Computer Studies, 41 (5), pp. 633-681.
37. Davis, D., Trevisan, M., L. McKenzie & S. Beyerlein (2001). Enhancing Scoring Reliability in Mid-Program Assessment of Design. Proceedings of the Annual Conference of the American Society of Engineering Education, Albuquerque, NM.
38. Bursic, K. M., & Atman, C. J. (1997). Information gathering: A critical step for quality in the design process. Quality Management Journal, 4(4).