First in, best dressed: The presence of order-effect bias in journal ranking surveys

Journal of Informetrics

Volumn 7, Issue 1, 2013, Pages 138-144

  Serenko, Alexander ^a   Bontis, Nick ^b  

^a LAKEHEAD UNIVERSITY   (Canada)

^b MCMASTER UNIVERSITY   (Canada)

Author keywords

Journal ranking; Order effect bias; Response order effect; Survey

Indexed keywords

EID: 84870518145     PISSN: 17511577     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.joi.2012.10.005     Document Type: Article

References (36)

1. Adler N., Harzing A.-W. When knowledge wins: Transcending the sense and nonsense of academic rankings. Academy of Management Learning & Education 2009, 8(1):72-95.
2. Ayidiya S.A., McClendon M.J. Response effects in mail surveys. Public Opinion Quarterly 1990, 54(2):229-247.
3. Cronin B., Meho L.I. Applying the Author Affiliation Index to library and information science journals. Journal of the American Society for Information Science and Technology 2008, 59(11):1861-1865.
4. Diaz J., Black R.T., Rabianski J. A note on ranking real estate research journals. Real Estate Economics 1996, 24(4):551-563.
5. Egghe L. The distribution of the uncitedness factor and its functional relation with the impact factor. Scientometrics 2010, 83(3):689-695.
6. Elqayam S., Ohm E., Evans J.S.B.T., Over D.E. First things first: Order bias in deontic disjunctions. Language and Cognitive Processes 2010, 25(3):375-401.
7. Ferber R. Order bias in a mail survey. Journal of Marketing 1952, 17(2):171-178.
8. Garfield E. Citation analysis as a tool in journal evaluation. Science 1972, 178(4060):471-479.
9. Garfield E. Citation indexing: Its theory and application in science, technology, and humanities 1979, Wiley, New York.
10. Grice H.P. Logic and conversation. Perspectives in the philosophy of language: A concise anthology 2000, 271-287. Broadview Press, Peterborough, ON, Canada. R.J. Stainton (Ed.).
11. Hardgrave B.C., Walstrom K.A. Forums for MIS scholars. Communications of the ACM 1997, 40(11):119-124.
12. Holsapple C.W. A Publication Power Approach for identifying premier information systems journals. Journal of the American Society for Information Science and Technology 2008, 59(2):166-185.
13. Israel G.D., Taylor C.L. Can response order bias evaluations?. Evaluation and Program Planning 1990, 13(4):365-371.
14. Kao C., Lin H.-W., Chung S.-L., Tsai W.-C., Chiou J.-S., Chen Y.-L., et al. Ranking Taiwanese management journals: A case study. Scientometrics 2008, 76(1):95-115.
15. Krosnick J.A. Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology 1991, 5(3):213-236.
16. Krosnick J.A., Alwin D.F. An evaluation of a cognitive theory of response-order effects in survey measurement. The Public Opinion Quarterly 1987, 51(1):201-219.
17. Lewison G. Researchers' and users' perceptions of the relative standing of biomedical papers in different journals. Scientometrics 2002, 53(2):229-240.
18. Lowry P.B., Humphreys S., Malwitz J., Nix J. A scientometric study of the perceived quality of business and technical communication journals. IEEE Transactions on Professional Communication 2007, 50(4):352-378.
19. Lowry P.B., Romans D., Curtis A. Global journal prestige and supporting disciplines: A scientometric study of information systems journals. Journal of the Association for Information Systems 2004, 5(2):29-77.
20. Mylonopoulos N.A., Theoharakis V. On site: Global perceptions of IS journals. Communications of the ACM 2001, 44(9):29-33.
21. Peffers K., Ya T. Identifying and evaluating the universe of outlets for information systems research: Ranking the journals. Journal of Information Technology Theory and Application 2003, 5(1):63-84.
22. Perreault W.D. Controlling order-effect bias. The Public Opinion Quarterly 1975, 39(4):544-551.
23. Perrin B.M., Barnett B.J., Walrath L., Grossman J.D. Information order and outcome framing: An assessment of judgment bias in a naturalistic decision-making context. Human Relations 2001, 43(2):227-238.
24. Rogers P.S., Campbell N., Louhiala-Salminen L., Rentz K., Suchan J. The impact of perceptions of journal quality on business and management communication academics. Journal of Business Communication 2007, 44(4):403-426.
25. Saha S., Saint S., Christakis D.A. Impact factor: A valid measure of journal quality?. Journal of the Medical Library Association 2003, 91(1):42-46.
26. Schuman H., Ludwig J. The norm of even-handedness in surveys as in life. American Sociological Review 1983, 48(1):112-120.
27. Schuman H., Presser S. Questions and answers in attitude surveys: Experiments on question form, wording, and context 1996, SAGE Publications, Thousand Oaks, CA.
28. Serenko A., Bontis N. Global ranking of knowledge management and intellectual capital academic journals. Journal of Knowledge Management 2009, 13(1):4-15.
29. Serenko A., Bontis N. What's familiar is excellent: The impact of exposure effect on perceived journal quality. Journal of Informetrics 2011, 5(1):219-223.
30. Serenko A., Dohan M. Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence. Journal of Informetrics 2011, 5(4):629-648.
31. Serenko A., Jiao C. Investigating information systems research in Canada. Canadian Journal of Administrative Sciences 2012, 29(1):3-24.
32. Sudman S., Bradburn N.M., Schwarz N. Thinking about answers: The application of cognitive processes to survey methodology 2010, Jossey-Bass Publishers, San Francisco, CA.
33. Truex D., Cuellar M., Takeda H. Assessing scholarly influence: Using the Hirsch indices to reframe the discourse. Journal of the Association for Information Systems 2009, 10(7):560-594.
34. Walstrom K.A., Hardgrave B.C., Wilson R.L. Forums for management information systems scholars. Communications of the ACM 1995, 38(3):93-107.
35. Whitman M.E., Hendrickson A.R., Townsend A.M. Research commentary. Academic rewards for teaching, research, and service: Data and discourse. Information Systems Research 1999, 10(2):99-109.
36. Wright D.B., Carlucci M.E. The response order effect: People believe the first person who remembers an event. Psychonomic Bulletin & Review 2011, 18(4):805-812.