Assessment beyond performance: Phenomenography in educational evaluation

American Journal of Evaluation

Volumn 28, Issue 4, 2007, Pages 458-476

  Micari, Marina ^a   Light, Gregory ^a   Calkins, Susanna ^a   Streitwieser, Bernhard ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Educational program evaluation; Phenomenography; Qualitative research; Student learning

Indexed keywords

EID: 36549062017     PISSN: 10982140     EISSN: 15570878     Source Type: Journal    
DOI: 10.1177/1098214007308024     Document Type: Article

References (69)

1. Akerlind, G.S. (2003). Growing and developing as a university teacher-Variation in meaning. Studies in Higher Education, 28 (4), 375-390.
2. Akerlind, G.S. (2005). Variation and commonality in phenomenographic research methods. Higher Education Research & Development, 24 (4), 321-334.
3. Arnold, L., & Feighny, K.M. (1995). Students' general learning approaches and performances in medical school: A longitudinal study. Academic Medicine, 70, 715-722.
4. Astin, A., Banta, T., Cross, K., El-Khawas, K., Ewell, P., Hutchings, P., et al. (1993). Principles of good practice for assessing student learning. Leadership Abstracts, 6 (4), 2-3.
5. Barnard, A., & Gerber, R. (1999). Understanding technology in contemporary surgical nursing: A phenomenographic examination. Nursing Inquiry, 6 (3), 157-166.
6. Bowden, J. (1995). Phenomenographic research: Some methodological issues. Nordisk Pedagogik, 3, 145-155.
7. Bowden, J.A. (2000). Experience of phenomenographic research: A personal account. In J. Bowden & E. Walsh (Eds.), Phenomenography (pp. 47-61). Melbourne, Australia: RMIT Publishing.
8. Bowden, J., & Marton, F. (1998). The university of learning. London: Kogan.
9. Bowden, J., & Walsh, E. (Eds.). (2000). Phenomenography. Melbourne, Australia: RMIT University Press.
10. Bruce, C., Pham, B., & Stoodley, I. (2004). Constituting the significance and value of research: Views from information technology academics and industry professionals. Studies in Higher Education, 29 (2), 219-238.
11. Crawford, K., Gordon, S., Nicholas, J., & Prosser, M. (1998). University mathematics students' conceptions of mathematics. Studies in Higher Education, 23 (1), 87-94.
12. Dewey, J. (1938). Experience and education. New York: Collier Books.
13. Drane, D., Smith, H.D., Light, G., Pinto, L., & Swarat, S. (2005). The Gateway Science Workshop Program: Enhancing student performance and retention in the sciences through peer-facilitated discussion. Journal of Science Education and Technology, 14 (3), 337-352.
14. Earl, L., & Fullan, M. (2003). Using data in leadership for learning. Cambridge Journal of Education, 33 (3), 383-394.
15. Eley, M.G. (1992). Differential adoption of study approaches within individual students. Higher Education, 23, 231-254.
16. Entwistle, N. (1997). Introduction: Phenomenography in higher education. Research and Development in Higher Education, 16 (2), 127-134.
17. Entwistle, N.J., & Ramsden, P. (1983). Understanding student learning. New York: Nichols.
18. Enwistle, N.J., & Tait, H. (1994). The revised approaches to studying inventory. Edinburgh, Scotland: University of Edinburgh, Centre for Research into Learning and Instruction.
19. Gow, L., & Kember, D. (1993). Conceptions of teaching and their relationship to student learning. British Journal of Educational Psychology, 63, 20-33.
20. Hambleton, I.R., Foster, W.H., & Richardson, J.T.E. (1998). Improving student learning using the personalised system of instruction. Higher Education, 35 (2), 187-203.
21. House, E.R. (1990). Trends in evaluation. Educational Researcher, 19 (3), 24-28.
22. Hultgren, F.H. (1989). Introduction to interpretive inuiry. In F. H. Hultgren & D. L. Coomer (Eds.), Alternative modes of inquiry (pp. 37-59). Washington, DC: Amercian Home Economics Association, Teacher Education Section.
23. Kember, D. (1997). A reconceptualisation of the research into university academics' conceptions of teaching. Learning and Instruction, 7 (3), 255-275.
24. Kember, D., & Kwan, K.-P. (2000). Lecturers' approaches to teaching and their relationship to conceptions of good teaching. Instructional Science, 28, 469-490.
25. Light, G. (2003). Realizing academic development: Embedding teaching practice in the practice of research. In R. Macdonald & H. Eggins (Eds.), The scholarship of academic development (pp. 152-162). London: Open University Press.
26. Light, G., Calkins, S., & Luna, M. (2005, November). Faculty and the experience of teaching: E fecting change at a research university. Paper presented to the Association for Studies in Higher Education (ASHE) Annual Meeting, Philadelphia, PA.
27. Light, G., & Cox, R. (2001). Learning and teaching in higher education: The reflective professional. London: Paul Chapman.
28. Light, G., Calkins, S., Luna, M., & Drane, D. (in press). Assessing the impact of a year-long faculty development program on faculty approaches to teaching. International Journal of Teaching and Learning in Higher Education.
29. Lincoln, Y., & Guba, E. (1985). Naturalistic inquiry. Beverly Hills, CA: Sage.
30. Linder, C., & Marshall, D. (2003). Reflection and phenomenography: Towards theoretical and educational development possibilities. Learning and Instruction, 13 (3), 271-284.
31. Linkon, S. (2005). How can assessment work for us? Academe, 91 (4), 28-32.
32. Lo, M.L., Chik, P.M., & Pang, M.F. (2006). Patterns of variation in teaching the colour of light to primary 3 students. Instructional Science, 34 (1), 1-19.
33. Marton, F. (1981). Phenomenography: Describing conceptions of the world around us [online version]. Instructional Science, 10, 177-200. Retrieved September 23, 2005, from http://www.ped.gu.se/biorn/phgraph/ misc/constr/phegraph.html.
34. Marton, F. (1988). Phenomenography: A research approach to investigating different understandings of reality. In R. Sherman & R. Webb (Eds.), Qualitative research in education: Focus and methods (pp. 143-161). New York: Falmer Press.
35. Marton, F. (1989). Towards a pedagogy of content. Educational Psychologist, 24, 1-23.
36. Marton, F. (1994). Phenomenography. In T. Husen & T. N. Postlethwaite (Eds.), The international encyclopedia of education (2 nd ed., Vol. 8, pp. 4424-4429). Oxford, UK: Pergamon.
37. Marton, F., & Booth, S. (1997). Learning and awareness. Mahwah, NJ: Lawrence Erlbaum.
38. Marton, F., Runesson, U., & Tsui, A.B. (2004). The space of learning. In F. Marton & A. B. M. Tsui (Eds.), Classroom discourse and the space of learning (pp. 3-40). Mahwah, NJ: Lawrence Erlbaum.
39. Marton, F., & Pong, W.Y. (2005). On the unit of description in phenomenography. Higher Education Research & Development, 24 (4), 335-348.
40. Marton, F., & Trigwell, K. (2000). Variato est mater studiorum. Higher Education Research & Development, 19 (3), 381-395.
41. McKenzie, J. (2002). Variation and relevance structures for university teachers' learning: Bringing about change in ways of experiencing teaching. HERSDA, 434-441.
42. Merleau-Ponty, M. (1968). The visible and the invisible. Evanston, IL: Northwestern University Press.
43. Meyer, J.H.F. (2000, September). An overview of the development and application of the Reflections on Learning Inventory (RoLI). Paper presented at the 1st RoLI Symposium, Imperial College, University of London.
44. Micari, M., Light, G., & Schnierle, C. (2006, April). "Getting through" to "knowing what you don't know": Approaches to learning in peer-led workshops. Poster presented at the American Educational Research Association (AERA) Annual Meeting, San Francisco.
45. Norton, L., & Dickins, T.E. (1995). Do approaches to learning courses improve students' learning strategies? In G. Gibbs (Ed.), Improving student learning through assessment and evaluation (pp. 455-471). Oxford, UK: Oxford Brookes University Press. 455-471).Oxford, UK: Oxford Brookes University Press.
46. Patton, M. (2002). Qualitative research & evaluation methods (3 rd ed.). Thousand Oaks, CA: Sage.
47. Pang, M., & Marton, F. (2005). Learning theory as teaching resource: Enhancing students: Understanding of economic concepts. Instructional Science, 33 (2), 159-191.
48. Pang, M.F. (2003). Two faces of variation-On continuity in the phenomenographic movement. Scandinavian Journal of Educational Research, 47 (2), 145-156.
49. Pellegrino, J., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing what students know: The science and design of educational assessment (Final Report of the Committee on the Foundations of Assessment). Washington, DC: Center for Education, National Research Council.
50. Prosser, M., & Trigwell, K. (1999). Understanding learning and teaching: The experience in higher education. Buckingham, UK: Society for Research into Higher Education and Open University Press.
51. Prosser, M., Trigwell, K., & Waterhouse, F. (2000). Students' experiences of studying physics concepts: The effects of disintegrated perceptions and approaches. European Journal of Psychology of Education, 15 (1), 61-74.
52. Purdie, N., & Hattie, J. (2002). Assessing students' conceptions of learning. Australian Journal of Educational & Developmental Psychology, 2, 17-32.
53. Ramsden, P. (2003). Learning to teach in higher education. London: Routledge.
54. Reid, A., & Petocz, P. (2002). Students' conceptions of statistics: A phenomenographic study. Journal of Statistics Education, 10 (2). Available at www.amstat.org/publications/jse/v10n2/reid.html.
55. Rogers, C. (1961). On becoming a person. Boston: Houghton Mifflin.
56. Rosengren, K., Athlin, E., & Segesten, K. (2007). Presence and availability: Staff conceptions of nursing leadership on an intensive care unit. Journal of Nursing Management, 15 (5), 522-529.
57. Rossouw, P., & Parsons, P. (1995). An exploration of the association between students' approaches to learning and their perceived locus of control. In G. Gibbs (Ed.), Improving student learning through assessment and evaluation (pp. 296-310). Oxford, UK: Oxford Brookes University Press.
58. Sadler Smith, E. (1996). Approaches to studying: Age, gender and academic performance. Educational Studies, 22, 367-379.
59. Säljö, R. (1979). Learning about learning. Higher Education, 8, 443 - 451.
60. Säljö, R. (1994). Minding action. Conceiving of the world versus participating in cultural practices. Nordisk Pedagogik, 14, 71 - 80.
61. Sandberg, J. (2000). Understanding human competence at work: An interpretive approach. Academy of Management Journal, 43 (1), 9-25.
62. Scientifically based evaluation methods. (2005, January 25). Federal Register, 70 (15), 3585-3589 (RIN 1890-ZA00).
63. Swarat, S., Drane, D., Smith, H.D., Light, G., & Pinto, L. (2004). Opening the gateway: Increasing student retention in introductory science courses. Journal of College Science Teaching, 34 (1), 2-7.
64. Tait, H., Entwistle, N.J., & McCune, V. (1997). ASSIST: A reconceptualisation of the Approaches to Studying Inventory. In C. Rust (Ed.), Improving student learning: Improving students as learners (pp. 262 - 271). Oxford, UK: Oxford Brookes University, Oxford Centre for Staff and Learning Development.
65. Trigwell, K. (2000). Phenomenography: Variation and Discernment. In C. Rust (Ed.), Improving student learning. Proceedings of the 1999 7th International Symposium (pp. 75-85). Oxford, UK: Oxford Centre for Staff and Learning Development.
66. Trigwell, K., & Prosser, M. (1996). Congruence between intention and strategy in science teachers' approach to teaching. Higher Education, 32, 77-87.
67. Trigwell, K., & Prosser, M. (2004). Development and use of the approaches to teaching inventory. Educational Psychology Review, 16 (4), 409-424.
68. Van Manen, M. (1990). Researching lived experience. London, Canada: University of Western Ontario Press.
69. Vygotsky, L. (1978). Mind in society. Cambridge, MA: Harvard University Press.