Simpson's Paradox and confounding factors in university rankings: a demonstration using QS 2011–12 data

European Journal of Higher Education

Volumn 2, Issue 4, 2012, Pages 389-402

  Soh, Kay Cheng ^a  

^a NONE   (Singapore)

Author keywords

academic excellence; confounding factors; Simpson's Paradox; university ranking

Indexed keywords

EID: 85005953075     PISSN: 21568235     EISSN: 21568243     Source Type: Journal    
DOI: 10.1080/21568235.2012.743223     Document Type: Article

References (16)

1. Ambrus, S., May 20, 2012. “ Educators Debate Negative Effects of International Rankings on Latin American Universities.” The Chronicle of Higher Education. http://chronicle.com/article/Educators-Debate-Rankings/131933/
2. Hare, J., September 5, 2011. “ Rankings Are Useless and, Well, Rank.” The Australian, Higher Education. http://www.theaustralian.com.au/higher-education/opinion/rankings-are-useless-and-well-rank/story-e6frgcko-1226129304027
3. Hazelkorn, E., November 11, 2007. “ OECD: Consumer Concept Becomes a Policy Instrument.” University World News, Issue No. 5. http://www.universityworldnews.com/article.php?story=20071108144018483&query=university+ranking
4. Marshall, J., November 23, 2008. “ New Ranking Scheme for Universities.” University World News, Issue No. 54. http://www.universityworldnews.com/article.php?story=2008112015513946&query=university+ranking
5. Morgan, J., May 31, 2012. “ THE 100 Under 50 University Rankings: Results.” http://www.timeshighereducation.co.uk/story.asp?storycode=419908
6. Mumby, D. G., June 25, 2012. “ Choosing a University for an Undergraduate Degree? Ignore the Ranking Lists.” My Graduate School. http://mygraduateschool.wordpress.com/2012/06/25/choosing-a-university-for-an-undergraduate-degree-ignore-the-rankings-lists/
7. QS Top Universities. 2012. “ QS Top 50 Under 50.” http://www.topuniversities.com/university-rankings/qs-top-50-under-50/
8. Rauhvargers, A., 2011. Global University Ranking and Their Impact. EUA Report on Rankings 2011. European University Association.
9. Rogers, T., 2001. “ Simpsons's Paradox–When Big Data Sets Go Bad.” http://www.intuitor.com/statistics/SimpsonsParadox.html
10. Saisana, M., and B., D'Hombres. 2008. “ Higher Education Rankings: Robustness Issues and Critical Assessment: How Much Confidence Can We Have in Higher Education Rankings? ” European Commission Joint Research Centre, Institute for the Protection and Security of the Citizen, and Centre for Research on Lifelong Learning.
11. So Far, So Good: Under 50. n.d. http://www.timeshighereducation.co.uk/Journals/THE/THE/31_May_2012/attachments/THE_100_Under_50_.pdf
12. Soh, K. C., 2011. Mirror, mirror on the wall: A closer look at the top ten in university rankings. European Journal of Higher Education 1–7: iFirst: http://dx.doi.org/10.1080/21568235.2011.577179
13. Soh, K. C., 2012. “ What do ARWU and THES university ranking measure? Factor analyses of 2010 and 2011 data.” European Journal of Educational Evaluation and Research.
14. Staff Writers. 5 June 2012. “ Twelve questionable factors behind traditional university ranking.” Online Colleges: http://www.onlinecolleges.net/2012/06/05/12-questionable-factors-behind-traditional-university-rankings/
15. Steiner, J. E., n.d. World University Rankings: A Principal Component Analysis. Instituto de Estudos Avancados da Universitdade de Sao Paulo: www.iea.usp.br/english/articles
16. The Ranking Forum of Swiss Universities. July 2012. Ranking methodology: How are universities ranked? http://www.universityrankings.ch/methodology/on_rankings/ranking_methodology