Challenges to informed peer review matching algorithms

Journal of Engineering Education

Volumn 99, Issue 4, 2010, Pages 397-408

  Verleger, Matthew ^a   Diefes Dux, Heidi ^b   Ohland, Matthew W ^b   Besterfield Sacre, Mary ^c   Brophy, Sean ^b  

^a UTAH STATE UNIVERSITY   (United States)

^b PURDUE UNIVERSITY   (United States)

^c UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Calibration; Model eliciting activity; Peer review

Indexed keywords

CALIBRATION; CURRICULA; FEEDBACK;

FIRST YEAR ENGINEERING COURSE; MATCHING ALGORITHM; MODEL ELICITING ACTIVITIES; PEDAGOGICAL TOOLS; PEER REVIEW; RANDOM ASSIGNMENT; RESEARCH UNIVERSITIES; TEACHING ASSISTANTS;

TEACHING;

EID: 77958086310     PISSN: 10694730     EISSN: None     Source Type: Journal    
DOI: 10.1002/j.2168-9830.2010.tb01070.x     Document Type: Review

References (34)

1. American Society of Civil Engineers. 2008. 2007-2008 policies and priorities. Washington, DC: ASCE Washington Office.
2. Ballantyne, R., K. Hughes, and A. Mylonas. 2002. Developing procedures for implementing peer assessment in large classes using an action research process. Assessment and Evaluation in Higher Education 27 (5): 427-441
3. Billington, H.L. 1997. Poster presentations and peer assessment: Novel forms of evaluation and assessment. Journal of Biological Education 31 (3): 218-220
4. Boud, D. 2000. Sustainable assessment: Rethinking assessment for the learning society. Studies in Continuing Education 22 (2): 151-167
5. Bowman, K., and T. Siegmund. 2008. Designing modeling activities for upper-level engineering classes. In Models and modeling in engineering education: Designing experiences for all students, eds. J.S. Zawojewski, H. Diefes-Dux, and K. Bowman. Rotterdam, The Netherlands: Sense Publishers.
6. Chapman, O.L. 2003. Calibrated peer review-The white paper: A description of CPR. http://cpr.molsci.ucla.edu/cpr/resources/documents/misc/CPR-White- Paper.pdf (last accessed, July 2010).
7. Cheng, W., and M. Warren. 1999. Peer and teacher assessment of the oral and written tasks of a group project. Assessment and Evaluation in Higher Education 24 (3): 301-314
8. Crespo, R.M., A. Pardo, and C.D. Kloos. 2004. An adaptive strategy for peer review. In Proceedings of the 34th ASEE/IEEE Frontiers in Education Conference. Savannah, GA.
9. Diefes-Dux, H., K. Bowman, J.S. Zawojewski, and M. Hjalmarson. 2006. Quantifying aluminum crystal size part 1: The model-eliciting activity. Journal of STEM Education 7 (1 & 2): 51-63.
10. Diefes-Dux, H., and P.K. Imbrie. 2008. Modeling activities in a firstyear engineering course. In Models and modeling in engineering education: Designing experiences for all students, eds. J.S. Zawojewski, H. Diefes-Dux, and K. Bowman. Rotterdam, The Netherlands: Sense Publishers.
11. Diefes-Dux, H., T. Moore, J.S. Zawojewski, P.K. Imbrie, and D. Follman. 2004. A framework for posing open-ended engineering problems: Model-eliciting activities. In Proceedings of the Frontiers in Education (FIE) Annual Conference. Savannah, GA.
12. Diefes-Dux, H., and A. Salim. 2009. Problem identification during model-eliciting activities: Characterization of first-year students' responses. In Proceedings for the 2009 Research in Engineering Education Symposium (REES 2009). Queensland, Australia.
13. Diefes-Dux, H., M. Verleger, J.S. Zawojewski, and M. Hjalmarson. 2009. Multi-dimensional tool for assessing student team solutions to model-eliciting activities. In Proceedings for the American Society for Engineering Education National Conference (ASEE 2009). Austin, TX.
14. Diefes-Dux, H., J.S. Zawojewski, and M. Hjalmarson. 2010. Using educational research in the design of evaluation tools for open-ended problems. International Journal of Engineering Education (In Press).
15. Gehringer, E.F. 2001. Electronic peer review and peer grading in computer- science courses. In Proceedings of the Thirty-second SIGCSE Technical symposium on Computer Science Education. Charlotte, North Carolina.
16. Guilford, W.H. 2001. Teaching peer review and the process of scientific writing. Advances in Physiology Education 25 (3): 167-175
17. IEEE. 2009. IEEE envisioned future. 2007 http://www.ieee.org/portal/cms- docs-iportals/iportals/aboutus/envisioned-future.pdf.
18. Lesh, R.A., and H.M. Doerr, eds. 2003. Beyond constructivism: Models and modeling perspectives on mathematics problem solving, learning, and teaching. Mahwah, NJ: Lawrence Erlbaum.
19. Lesh, R.A., M. Hoover, B. Hole, A. Kelly, and T. Post. 2000. Principles for developing thought revealing activities for students and teachers. In Handbook of research design in mathematics and science education, eds. A. Kelly and R.A. Lesh. Mahwah, NJ: Lawrence Erlbaum.
20. Liu, E.Z., S.S. J. Lin, C. Chiu, and S. Yuan. 2001. Web-based peer review: The learner as both adapter and reviewer. IEEE Transactions on Education 44 (3): 246-251
21. Moreira, D.A., and E. Q. Silva. 2003. A method to increase student interaction using student groups and peer review over the internet. Education and Information Technologies 8 (1): 47-54.
22. Ngu, A.H.H., J. Shepherd, and D. Magin. 1995. Engineering peers: Computer-assisted approach to the development of peer assessment system. Paper read at Research and Development in Higher Education 18: Blending Tradition and Technologies, HERDSA 95. Rockhampton, Queensland.
23. Saterbak, A., and T. Volz. 2008. Implementing calibrated peer review(tm) to enhance technical critiquing skills in a bioengineering laboratory. In Proceedings for the American Society for Engineering Education (ASEE) Annual Conference. Pittsburgh, PA.
24. Sitthiworachart, J., and M. Joy. 2003. Deepening computer programming skills by using web-based peer assessment. Paper presented at 4th Annual Conference of the LTSN Centre for Information and Computer Sciences. NUI Galway, Ireland.
25. Sitthiworachart, J., and M. Joy. 2003. Web-based peer assessment in learning computer programming. In Proceedings for the 3rd IEEE International Conference on Advanced Learning Technologies. Athens, Greece.
26. Sitthiworachart, J., and M. Joy. 2004. Effective peer assessment for learning computer programming. In Proceedings of the 9th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education. Leeds, United Kingdom.
27. Topping, K. 1998. Peer assessment between students in colleges and universities. Review of Educational Research 68 (3): 249-276
28. Trahasch, S. 2004. Towards a flexible peer assessment system. In Proceedings of the Fifth International Conference on Information Technology Based Higher Education and Training (ITHET). Istanbul, Turkey.
29. Tsai, C., E.Z. Liu, S.S. J. Lin, and S. Yuan. 2001. A networked peer assessment system based on a Vee Heuristic. Innovations in Education and Teaching International 38 (3): 220-230
30. Verleger, M., and H. Diefes-Dux. 2008. Impact of feedback and revision on student team solutions to model-eliciting activities. Paper presented at the American Society for Engineering Education (ASEE) National Conference. Pittsburgh, PA.
31. Verleger, M., H. Diefes-Dux, C. Liguore, and B. Eick. 2009. Image tiling: Problems: Sgmm: Research-School of Engineering Education, Purdue University 2009. https://engineering.purdue.edu/ENE/Research/ SGMM/Problems/ImageTiling/ SinglePage (last accessed, August 2010).
32. Wood, T., M. Hjalmarson, and G. Williams. 2008. Learning to design in small group mathematical modeling. In Models and modeling in engineering education: Designing experiences for all students, eds. J.S. Zawojewski, H. Diefes-Dux and K. Bowman. Rotterdam, The Netherlands: Sense Publishers.
33. Zawojewski, J.S., H. Diefes-Dux, and K. Bowman, eds. 2008. Models and modeling in engineering education: Designing experiences for all students. Rotterdam, The Netherlands: Sense Publishers.
34. Zawojewski, J.S., M. Hjalmarson, K. Bowman, and R.A. Lesh. 2008. A modeling perspective on learning and teaching engineering education. In Models and modeling in engineering education: Designing experiences for all students, eds. J.S. Zawojewski, H. Diefes-Dux and K. Bowman. Rotterdam, The Netherlands: Sense Publishers.