Doing what it says on the tin? A psychometric evaluation of the Assessment Experience Questionnaire

Assessment and Evaluation in Higher Education

Volumn 44, Issue 2, 2019, Pages 309-320

  Batten, John ^a   Jessop, Tansy ^b   Birch, Phil ^c  

^a UNIVERSITY OF WINCHESTER   (United Kingdom)

^b SOUTHAMPTON SOLENT UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF CHICHESTER   (United Kingdom)

Author keywords

Assessment environment; deep learning; questionnaire validity; student experience

Indexed keywords

EID: 85056095475     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2018.1499867     Document Type: Article

References (63)

1. Arum, R., &J., Roksa. 2011. Academically Adrift: Limited Learning on College Campuses. Chicago. University of Chicago Press
2. Ashford-Rowe, K., J., Herrington & C., Brown. 2013. “Establishing the critical elements that determine authentic assessment”. Assessment & Evaluation in Higher Education. 39 (2) 205–222
3. Batten, J., Batey, J., Shafe, L., Gubby, L., & Birch, P.D.J. 2013. “The influence of reputation information on the assessment of undergraduate student work.” Assessment & Evaluation in Higher Education, 38 (4) 417–435
4. Berg, M., & Seeber, B. 2016. The Slow Professor: Challenging the Culture of Speed in the Academy. Toronto. University of Toronto Press
5. Birch, P.D.J., Batten J., & Batey, J. 2016. “The influence of student gender on the assessment of undergraduate student work.” Assessment & Evaluation in Higher Education, 41 (7) 1065–1080
6. Black, P., & D., Wiliam. 1998. Inside the Black Box: Raising Standards through Classroom Assessment. London: Grenada Learning
7. Bloxham, S., & P., Boyd 2007. Developing Effective Assessment in Higher Education. Maidenhead. Open University Press
8. S.Bloxham,. 2016. Personal Correspondence. 5 March 2016
9. Boud, D. 2000. “Sustainable Assessment: Rethinking Assessment for the Learning Society”. Studies in Continuing Education. 22 (2): 151–167
10. Boud, D., & N., Falchikov. 2006. “Aligning Assessment with Long-term Learning”. Assessment & Evaluation in Higher Education. 31 (4): 399–413
11. Byrne, B.M. 2010. Structural Equation Modelling with AMOS: Basic Concepts, Applications, and Programming (2nd Ed.). New York. Routledge
12. A.W.Chickering, & Z.F.Gamson,. 1987. “Seven Principles for Good Practice in Undergraduate Education”. American Association for Higher Education Bulletin. 3–7. March 1987. Available at: https://eric.ed.gov/?id=ED282491
13. Clark, L.A., & D., Watson 1995. “Constructing validity: Basic issues in objective scale development”. Psychological Assessment. 7, 309–319
14. Claxton, G. 1998. Hare Brain, Tortoise Mind. London: Fourth Estate
15. Cousin, G. 2009. Researching Learning in Higher Education: An Introduction to Contemporary Methods and Approaches. Abingdon. Routledge
16. Cumming, J., Clark, S.E., Ste-Marie, D.M., McCullagh, P., & C., Hall 2005. “The functions of observational learning questionnaire”. Psychology of Sport and Exercise. 6. 517–537
17. Comrey, A.L., & H.B., Lee 1992. A First Course in Factor Analysis (2nd Ed.). Mahwah, NJ. Lawrence Erlbaum Associates
18. Fallowfield, J.L., Hale, B.J., & Wilkinson, D.M. 2005. Using Statistics in Sport and Exercise Science Research. Chichester: Lotus Publishing
19. Fink, L.D. 2003. Creating Significant Learning Experiences: An integrated approach to designing college courses. San Francisco. Jossey-Bass
20. Freire, P. 1970. The Pedagogy of the Oppressed. London. Continuum
21. Garson, G.D. 2006. Factor Analysis. Statnotes: Topics in Multivariate Analysis. North Carolina St. University, Quantitative Research in Public Administration. Available at: http://www2.chass.ncus.edu/garson/pa765/factor.htm
22. Gibbs, G., & C., Simpson. 2004. Conditions under which assessment supports students' learning. Learning and Teaching in Higher Education. 1(1) 3–31
23. Gibbs, G. 2006. How Assessment Frames Learning. In Bryan, C., and Clegg, K. (Eds). Innovative Assessment in Higher Education. (23–36). Abingdon. Routledge
24. Gibbs, G., & H., Dunbar-Goddet. 2007. “The effects of programme assessment environments on student learning. Oxfordshire, York. Higher Education Academy
25. Gibbs, G., & H., Dunbar-Goddet. 2009. “Characterising programme-level assessment environments that support learning”. Assessment & Evaluation in Higher Education. 34 (4) 481–489
26. G.Gibbs, & Y.El Hakim 2011. “Using the Assessment Experience Questionnaire to engage Course Teams in the revision of programme-level assessment regimes”. Paper presented at Higher Education Surveys for Enhancement Conference 2011, Nottingham, UK: The National College for School Leadership. 19 May 2011. Available at: https://www.heacademy.ac.uk/knowledge-hub/using-assessment-experience-questionnaire-engage-course-teams-revision-programme-level
27. Goodall, H. l. 2000. Writing the New Ethnography. Lanham, Maryland. AltaMira Press
28. Hall, C., D., Mack, A., Paivio, & H., Hausenblas. 1998. “Imagery use by athletes: Development of the Sport Imagery Questionnaire”. International Journal of Sport Psychology. 29, 73–89
29. Harland, T., A., McLean, R., Wass, E., Miller, & K. N., Sim. 2015. “An Assessment Arms Race and Its Fallout: High-stakes Grading and the Case for Slow Scholarship.” Assessment & Evaluation in Higher Education. 40 (4): 528–541
30. Harland, T., & N., Wald. 2018. “Curriculum, teaching and powerful knowledge”. Higher Education. 1–14
31. Hattie, J., & H., Timperley. 2007. “The Power of Feedback”. Review of Educational Research. 77:1. 81–112
32. Higgins, R., P., Hartley & A., Skelton 2002. “The conscientious consumer: Reconsidering the role of assessment feedback in student learning”. Studies in Higher Education, 27 (1) 53–64
33. Hutcheson, G., & N., Sofroniou. 1999. The Multivariate Social Scientist. London: Sage Publications Ltd
34. Jessop, T., Y., El Hakim, & G., Gibbs. 2014a. “The Whole is Greater Than the Sum of Its Parts: A Large-scale Study of Students’ Learning in Response to Different Programme Assessment Patterns.” Assessment & Evaluation in Higher Education 39 (1): 73–88
35. Jessop, T., Y., El Hakim, & G., Gibbs. 2014b. “TESTA 2014: A way of thinking about assessment and feedback. Educational Developments. 15(2): 21–23
36. Jessop, T., & B., Maleckar. 2016. “The Influence of Disciplinary Assessment Patterns on Student Learning: A Comparative Study.” Studies in Higher Education 41 (4): 696–711
37. Jessop, T. 2017. "Inspiring Transformation through TESTA’s Programme Approach." In Scaling up Assessment for Learning in Higher Education, edited by D., Carless, S., Bridges, C.K.W. Chan, and R., Glofcheski, 49–64. Sydney: Springer
38. Jessop, T., & C., Tomas. 2017. “The Implications of Programme Assessment Patterns for Student Learning.” Assessment & Evaluation in Higher Education 42 (6): 990–999
39. Innis, K. 1996. “Diary Survey: How undergraduate full-time students spend their time”. Leeds. Leeds Metropolitan University
40. Kline, P. 2000. The Handbook of Psychological Testing (2nd Ed.). London. Routledge
41. Knight, P., & Yorke, M. 2003. Assessment, Learning and Employability. Maidenhead: Open University Press
42. MacKenzie, S.B., P.M., Podsakoff & N.P., Podsakoff. 2011. “Construct measurement and validation procedures in MIS and behavioural research: Integrating new and existing techniques”. MIS Quarterly, 35, 293–334
43. Marton, F., & R., Saljo. 1976. “On Qualitative Differences in Learning I: Outcome and Process.” British Journal of Educational Psychology 46: 4–11
44. Meyer, J.H.F., & P., Parsons 1989. “Approaches to studying and course perceptions using the Lancaster inventory - A comparative study”. Studies in Higher Education.14:2, 137–153
45. Meyers, N.M., & D. D., Nulty 2009. “How to use (five) curriculum design principles to align authentic learning environments, assessment, students’ approaches to thinking and learning outcomes”. Assessment & Evaluation in Higher Education. 34:5, 565–577
46. Nicol, D. J. 2010. "From Monologue to Dialogue: Improving Written Feedback Processes in Mass Higher Education." Assessment & Evaluation in Higher Education 35 (5):501–517
47. Nicol, D. J., & D., Macfarlane-Dick. 2006. "Formative Assessment and Self-regulated Learning: A Model and Seven Principles of Good Feedback Practice." Studies in Higher Education 31 (2):99–218
48. J.C.Nunnally, & I.H.Bernstein. 1994. Psychometric Theory (3rd Ed.). New York: McGraw Hill
49. O'Donovan, B., M., Price, & C., Rust. 2008. “Developing student understanding of assessment standards: a nested hierarchy of approaches”. Teaching in Higher Education, 13 (2) 205–217
50. Orr, S. 2007. “Assessment moderation: constructing the marks and constructing the students”. Assessment & Evaluation in Higher Education. 32 (6) 645–656
51. E.Pitt, & N.Winstone 2018. “The impact of anonymous marking on students’ perceptions of fairness, feedback and relationships with lecturers”. Assessment & Evaluation in Higher Education. 1–12
52. P.Ramsden,. 2003. Learning to Teach in Higher Education. London, UK: Routledge
53. Sadler, D. R. 1989. "Formative Assessment and the Design of Instructional System." Instructional Science 18: 119–144
54. Schmitt, N. 1996. “Uses and abuses of coefficient alpha”. Psychological Assessment, 8, 350–353
55. Shay, S. 2005. “The assessment of complex tasks: A double reading”. Studies in Higher Education. 30(6). 663–679
56. Stevens, J. 1996. Applied Multivariate Statistics for the Social Sciences. Mahwah, NJ: Lawrence Erlbaum
57. Tabachnick, B.G, & L.S., Fidell. 2001. Using Multivariate Statistics (4th Ed.). MA: Allyn and Bacon
58. Vaughn, B.K., H., Lee, & Kamata, A. 2012. Measurement basics, methods, and issues. In G., Tenenbaum, R.C., Eklund, & A., Kamata (Eds.), Measurement in Sport and Exercise Psychology (25–32). Champaign, IL: Human Kinetics
59. Wass, R., T., Harland, A., McLean, E., Miller, & K.N., Sim. 2015. “Will press lever for food: behavioural conditioning of students through frequent high-stakes assessment”. Higher Education Research and Development 34 (6) 1324–1326
60. Wheelahan, L. 2010. Why Knowledge Matters in Curriculum: A Social Realist Argument. Abingdon. Routledge
61. Williams, S.E., & Cumming, J. 2011. “Measuring athlete imagery ability: The Sport Imagery Ability Questionnaire”. Journal of Sport & Exercise Psychology, 33, 416–440
62. Wilson, K.L., A., Lizzio, & P., Ramsden 1997. “The development, validation and application of the Course Experience Questionnaire”. Studies in Higher Education. 22:1, 33–53, DOI: 10.1080/03075079712331381121
63. Q.Wu, & T.Jessop,. 2018. “Formative assessment: missing in action in both research-intensive and teaching focused universities?” Assessment & Evaluation in Higher Education. 1–14