Factors affecting the effectiveness and acceptance of electronic selection systems

Human Resource Management Review

Volumn 23, Issue 1, 2013, Pages 50-70

  Stone, Dianna L ^a   Lukaszewski, Kimberly M ^b   Stone Romero, Eugene F ^a   Johnson, Teresa L ^a  

^a UNIVERSITY OF TEXAS AT SAN ANTONIO   (United States)

^b STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

Adverse impact; Applicant screening; Electronic selection; Interviewing; Invasion of privacy; Job analysis; Selection; Selection decision making; Testing

Indexed keywords

EID: 84871935795     PISSN: 10534822     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.hrmr.2012.06.006     Document Type: Review

References (104)

1. Anastasi A., Urbina S. Psychological testing 1997, Prentice-Hall, Upper Saddle River, NJ. 7th ed.
2. Bartram D. Testing on the Internet: Issues, challenges, and opportunities in the field of occupational assessment. Computer-based testing and the Internet: Issues and advances 2006, 13-37. John Wiley & Sons, Chichester, UK. D. Bartram, R.K. Hambleton (Eds.).
3. Bauer T.N., Truxillo D.M., Paronto M.E., Weekley J.A., Campion M.A. Applicant reactions to different selection technology: Face-to-face, interactive voice response, and computer-assisted telephone screening interviews. International Journal of Selection and Assessment 2004, 12:135-148.
4. Bauer T.N., Truxillo D.M., Tucker J.S., Weathers V., Bertolino M., Erdogan B., et al. Selection in the Information Age: The impact of privacy concerns and computer experience on applicant reactions. Journal of Management 2006, 32(5):601-621.
5. Bennett-Alexander D., Hartman L. Employment law for business 2009, McGraw Hill, New York. 6th ed.
6. Bobko P., Kehoe J. On the fair use of bias: A comment of Drasgow. Psychological Bulletin 1983, 93:604-608.
7. Boudreau J.W. Utility analysis for decisions in human resource management. Handbook of industrial and organizational psychology 1991, 621-746. Consulting Psychologists Press, Palo Alto, CA. M.D. Dunnette, L. Hough (Eds.).
8. Buchanan T., Smith J.L. Using the Internet for psychological research: Personality testing on the world-wide web. British Journal of Psychology 1999, 90:125-144.
9. Buckley P., Minette K., Joy D., Michaels J. The use of an automated employment recruiting and screening system for temporary professional employees: A case study. Human Resource Management 2004, 43:233-241.
10. Cascio W.F., Aguinis H. Applied psychology in human resource management 2010, Pearson Prentice Hall, Upper Saddle River, NJ. 7th ed.
11. CedarCrestone CedarCrestone 2009-2010 HR Systems Survey White Paper HR Technologies. Service delivery approaches, and metrics 12th annual edition 2010, Retrieved May 5, 2011 from http:/www.cedarcrestone.com/research.php.
12. Chapman D., Rowe P. The influence of videoconference technology and interview structure on the recruiting function of the employment interview: A field experiment. International Journal of Selection and Assessment 2002, 10:185-197.
13. Chapman D.S., Uggerslev K.L., Webster J. Applicant reactions to face-to-face and technology-mediated interviews: A field of investigation. Journal of Applied Psychology 2003, 88:944-953.
14. Chapman D.S., Webster J. The use of technologies in the recruiting, screening, and selection processes for job candidates. International Journal of Selection and Assessment 2003, 11:113-120.
15. Chatman Improving interactional organizational research: A model of person-organization fit. Academy of Management Review 1989, 14:333-349.
16. Chuah S.C., Drasgow F., Roberts B.W. Personality assessment: Does the medium matter?. Journal of Research in Personality 2006, 40:359-376.
17. Church A.H. Is there a method to our madness? The impact of data collection methodology on organizational surveys results. Personnel Psychology 2001, 54:937-969.
18. Cober R.T., Brown D.J., Levy P.E., Keeping L.M., Cober A.L. Organizational web sites: Web site content and style as determinants of organizational attraction. International Journal of Selection and Assessment 2003, 11:158-169.
19. Corkrey R., Parkinson L. Interactive voice response: Review of studies 1989-2000. Behavior Research Methods, Instruments, & Computers 2002, 34:342-353.
20. Coyne I., Warszta T., Beadle S., Sheehan N. The impact of mode of administration on the equivalence of a test battery: A quasi-experimental design. International Journal of Selection and Assessment 2005, 13:220-223.
21. Cronk B.C., West J.L. Personality research on the Internet: A comparison of web-based and traditional instruments in take-home and in-class settings. Behavior Research Methods, Instruments, & Computers 2002, 34:177-180.
22. Daft R.L., Lengel R.H. Information richness: A new approach to managerial behavior and organization design. Research in Organizational Behavior 1984, 6:191-233.
23. Dillman D.A. Mail and Internet surveys: The total design method 2000, Wiley, New York. 2nd ed.
24. Dillman D.A., Sangster R.L., Tarnai J., Rockwood T.H. Understanding differences in people's answers to telephone and mail surveys. New Directions for Evaluation 1996, 70:45-61.
25. Dineen B.R., Ash S.R., Noe R.A. A web of applicant attraction: Person-organization fit in the context of web-based recruitment. Journal of Applied Psychology 2002, 87:723-734.
26. Dineen B.R., Noe R.A. Effects of customization on application decisions and applicant pool characteristics in a web-based recruitment context. Journal of Applied Psychology 2009, 94:224-234.
27. Drasgow F. Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are the central issues. Psychological Bulletin 1984, 95:134-135.
28. Drasgow F., Nye C.D., Guo J., Tay L. Cheating on proctored tests: The other side of the unproctored debate. Industrial and Organizational Psychology 2009, 2:46-48.
29. Dulebohn J.H., Johnson R. Human resource metrics and decision support: A classification framework. Human Resource Management Review 2012.
30. Ebrahim N.A., Ahmed S., Taha Z. Virtual teams: A literature review. Australian Journal of Basic and Applied Sciences 2009, 3:2653-2669.
31. Eddy E.R., Stone D.L., Stone-Romero E.F. The effects of information management policies on reactions to human resource information systems: An integration of privacy and procedural justice perspectives. Personnel Psychology 1999, 52:335-358.
32. Equal Employment Opportunity Commission (EEOC) Guidelines on employee selection procedures. Federal Register 1978, 35:12,333-12,336.
33. Galanaki E. The decision to recruit online: A descriptive study. Career Development International 2002, 7:243-251.
34. Gatewood R.D., Feild H.S., Barrick M. Human resource selection 2010, South-Western, Mason, OH. 7th ed.
35. Greenberg C.I. Technological innovations and advancements for psychologists working with organizations. The Psychologist-Manager Journal 1999, 3:181-190.
36. Guion R.M. Personnel testing 1965, McGraw Hill, New York.
37. Harris M. Internet testing: An examinee perspective. Computer-based testing and the internet: Issues and advances 2006, 115-133. John Wiley, Chichester, England. D. Bartram, R. Hambleton (Eds.).
38. Harris M.M., Van Hoye G., Lievens F. Privacy and attitudes toward Internet-based selection systems: A cross-cultural comparison. International Journal of Selection and Assessment 2003, 11:230-236.
39. Hattrup K., O'Connell M.S., Yager J.R. Pre-screening job applicants with Interactive Voice Response and Web-based technologies: Are the methods equivalent?. Applied H.R.M. Research 2006, 11:15-26.
40. Heneman H., Judge T., Kammeyer-Mueller J. Staffing organizations 2011, McGraw-Hill, Middleton, WI.
41. Jones J.W., Brasher E.E., Huff J.W. Innovations in integrity-based personnel selection: Building a technology-friendly assessment. International Journal of Selection and Assessment 2002, 10:87-97.
42. Kavanagh M.J., Gueutal H.G., Tannenbaum S.I. Human resource information systems: Development and application 1990, PWS-KENT Publishing, Boston, MA.
43. Kehoe J.F., Dickter D.N., Russell D.P., Sacco J.M. E-selection. The brave new world of eHR: Human resources management in the digital age 2005, 54-103. Jossey Bass, San Francisco. H.G. Gueutal, D.L. Stone (Eds.).
44. Kobak K.A., Greist J.H., Jefferson J.W., Mundt J.C., Katzelnick D.J. Computerized assessment of depression and anxiety over the telephone using interactive voice response. MD Computing 1999, 16:64-68.
45. Kobak K.A., Taylor L.H., Dottl S.L., Greist J.H., Jefferson J.W., Burroughs D., et al. A computer-administered telephone interview to identify mental disorders. Journal of the American Medical Association 1997, 278:905-910.
46. Krosnick J.A. Survey research. Annual Review of Psychology 1999, 50:537-567.
47. Krosnick J.A., Narayan S., Smith W.R. Satisficing in surveys: Initial evidence. New Direction Evaluations 1996, 70:29-44.
48. Linowes D.F. Privacy in America: Is your private life in the public eye? 1989, University of Illinois Press, Urbana, IL.
49. Linowes D.F. Many companies fail to protect confidential employee data 2000, Retrieved April 15, 2010 from http://epic.org/privacy/workplace/linowesPR.html.
50. Lukaszewski, K. & Stone, D.L. (2003, April) Privacy and human resources information systems. In M. Hakel (Chair), New directions in organizational privacy theory and research. Symposium conducted at the meeting of the Society for Industrial and Organizational Psychology, Orlando, FL.
51. Lukaszewski K.M., Stone D.L., Stone-Romero E.F. The effects of the ability to choose the type of human resources system on perceptions of invasion of privacy and system satisfaction. Journal of Business and Psychology 2008, 23:73-86.
52. Makransky G., Glas C.A.W. Unproctored Internet test verification: Using adaptive confirmation testing. Organizational Research Methods 2011, 1:608-630.
53. Marler J.H., Fisher S. An evidence-based review of eHRM and strategic human resource management 2012, Human Resource Management Review.
54. McDaniel M.A., Morgeson F.P., Finnegan E.B., Campion M.A., Braverman E.P. Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology 2001, 86:730-740.
55. McManus M.A., Ferguson M.W. Biodata, personality, and demographic differences of recruits from threes sources. International Journal of Selection and Assessment 2003, 11:175-183.
56. Mead A.D., Drasgow F. Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. Psychological Bulletin 1993, 114:449-458.
57. Meade A.W., Michels L.C., Lautenschlager G.J. Are internet and paper-and-pencil personality tests truly comparable?. Organizational Research Methods 2007, 10:322-345.
58. Mohamed A.A., Orife J.N., Wibowo K. The legality of key word search as a personnel selection tool. Employee Relations 2002, 24:516-522.
59. Nunnally J.C. Psychometric theory 1978, McGraw-Hill, New York. 2nd ed.
60. Nye C.D., Do B.R., Drasgow F., Fine S. Two-step testing in employee Selection: Is score inflation a problem?. International Journal of Selection and Assessment 2008, 16:112-120.
61. O'Net O'Net online Retrieved November 7, 2010 from. http://www.onetcenter.org/contact.html.
62. Occupational Personality Questionnaire (OPQ-32, SHL) Retrieved January 5, 2011 from. http://www.shl.com/WhatWeDo/PersonalityAssessment/Pages/OPQQuestionnaire.aspx.
63. Oostrom J.K., Born M.P., Serlie A.W., Van Der Molen H.T. Effects of individual differences on the perceived job relatedness of a cognitive ability test and a multimedia situational judgment test. International Journal of Selection and Assessment 2010, 18:394-406.
64. Oswald F.L., Carr J.Z., Schmidt A.M. The medium and the message: Dual effects of supervision and web-based testing on measurement equivalence for ability and personality measures. Presented at the meeting of the Society for Industrial and Organizational Psychology, San Diego, CA 2001.
65. Parshall, C. G., & Kromrey, J. D. (1993). Computer testing versus paper-and-pencil: An analysis of examinee characteristics associated with mode effect. A paper presented at the meeting of the American Educational Research Association, Atlanta, GA. (Educational Resources Document Reproduction Services (ERIC) #ED363272.).
66. Pearlman K., Barney M.F. Selection for a changing workplace. Managing selection in changing organizations: Human resource strategies 2000, 3-72. Jossey-Bass, San Francisco, CA. J.F. Kehoe (Ed.).
67. Peterson T.O., Taylor S.D. When technology comes knocking: Using information technology to automate job descriptions. Managing impressions with information technology 2004, 73-93. Praeger Publishing/Greenwood Publishing Group, Westport, CT. J.W. Beard (Ed.).
68. Pew Internet and American Life Project Usage over time Retrieved December 7, 2010 from. http://www.pewinternet.org.
69. Piller C. Bosses with X-rays eyes. Your employers may be using computers to keep tabs on you. Macworld 1993, 10:124-130.
70. Ployhart R.E., Weekley J.A., Holtz B.C., Kemp C. Web-based and paper-and-pencil testing of applicants in a proctored setting: Are personality, biodata, and situational judgment tests comparable?. Personnel Psychology 2003, 56:733-752.
71. Potosky D., Bobko P. Selection testing via the internet: Practical considerations and exploratory empirical findings. Personnel Psychology 2004, 57:1003-1034.
72. Privacy Rights Clearinghouse 500 million sensitive records breached since 2005 Retrieved March 15, 2011 from. http://www.privacyrights.org/500-million-records-breached.
73. Reiter-Palmon R., Brown M., Sandall D.L., Buboltz C., Nimps T. Development of an O*NET web-based job analysis and its implementation in the U.S. Navy: Lessons learned. Human Resource Management Review 2006, 16:294-309.
74. Reynolds D.H., Dickter D.N. Technology and employee selection. Handbook of employee selection 2010, 171-194. Taylor and Francis Group, New York. J.L. Farr, N.T. Tippins (Eds.).
75. Richman-Hirsch W.L., Olson-Buchanan J.B., Drasgow F. Examining the impact of administration medium on examinee perceptions and attitudes. Journal of Applied Psychology 2000, 85:880-887.
76. Salgado J.F., Moscoso S. Internet-based personality testing: Equivalence of measures and assesses' perceptions and reactions. International Journal of Selection and Assessment 2003, 11:194-205.
77. Schmidt F.L., Hunter J.E. Employment testing: Old theories and new research findings. American Psychologist 1981, 36:1128-1137.
78. Schwarz N., Strack F., Hippler H.J., Bishop G. The impact of administration mode on response effects in survey measurement. Applied Cognitive Psychology 1991, 5:193-212.
79. Shadish W.R., Cook T.D., Campbell D.T. Experimental and quasi-experimental designs for generalized causal inference 2002, Houghton Mifflin, Boston.
80. Silvester J., Anderson N., Haddleton E., Cunningham-Snell N., Gibb A. A cross-modal comparison of telephone and face-to-face selection interviews in graduate recruitment. International Journal of Selection and Assessment 2000, 8:16-21.
81. Sinar E.F., Paquet S.L., Reynolds D.H. Nothing but net? Corporate image and web-based testing. International Journal of Selection and Assessment 2003, 11:150-157.
82. Workplace Privacy Survey Society for Human Resources Management and West Group, Retrieved May 15, 2004 from. http://www.shrm.org/surveys.
83. Stone D.L., Lukaszewski K.M. An expanded model of the factors affecting the acceptance and effectiveness of electronic human resource management systems. Human Resource Management Review 2009, 19:134-143.
84. Stone D.L., Lukaszewski K., Isenhour L.C. E-Recruiting: Online strategies for attracting talent. The brave new world of eHR: Human resources management in the digital age 2005, 22-53. Jossey Bass, San Francisco. H.G. Gueutal, D.L. Stone (Eds.).
85. Stone, D. L., Lukaszewski, K., & Stone-Romero, E. F. (2001, August) Privacy and human resources information systems. Paper presented at the meeting of the Society for Industrial and Organizational Psychology, San Diego, CA.
86. Stone E.F., Stone D.L. Privacy in organizations: Theoretical issues, research findings, and protection strategies. Research in personnel and human resources management 1990, 349-411. JAI Press, Greenwich, CT. K.M. Rowland, G.R. Ferris (Eds.).
87. Stone D.L., Stone-Romero E.F., Lukaszewski K. The functional and dysfunctional consequences of human resource information technology for organizations and their employees. Advances in human performance and cognitive engineering research 2003, 37-68. Elsevier, New York. D. Stone (Ed.).
88. Stone D.L., Stone-Romero E.F., Lukaszewski K.M. Factors affecting the acceptance and effectiveness of electronic human resource systems. Human Resource Management Review 2006, 16:229-244.
89. Stone-Romero E.F. Strategies for improving the validity and utility of research in human resource management and allied disciplines. Human Resource Management Review 2008, 18:205-209.
90. Stone-Romero E.F. Implications of research design options for the validity of inferences derived from organizational research. Handbook of organizational research methods 2009, 302-327. Sage Publications, London, UK. D. Buchanan, A. Bryman (Eds.).
91. Stone-Romero E.F. Research strategies in industrial and organizational psychology: Nonexperimental, quasi-experimental, and randomized experimental research in special purpose and nonspecial purpose settings. Handbook of industrial and organizational psychology 2010, 35-70. American Psychological Association Press, Washington, DC. S. Zedeck (Ed.).
92. Stone-Romero E.F., Stone D.L., Hyatt D. Privacy and personnel selection techniques. Journal of Social Issues 2003, 59:343-368.
93. Straus S.G., Miles J.A., Levesque L.L. The effects of videoconference, telephone, and face-to-face media on interviewer and applicant judgments in employment interviews. Journal of Management 2001, 27:363-381.
94. Sylva H., Mol S.T. E-Recruitment: A study into applicant perceptions of an online application system. International Journal of Selection and Assessment 2009, 17:311-323.
95. Templer J.K., Lange R.S. Internet testing: Equivalence between proctored lab and unproctored field conditions. Computers in Human Behavior 2008, 24:1216-1228.
96. Thornburg L. Computer-assisted interview shortens hiring cycle. HR Magazine 1998, 43:73-79.
97. Tippins N.T. Internet alternatives to traditional proctored testing: Where are we now?. Industrial and Organization Psychology 2009, 2:2-10.
98. Tourangeau R., Steiger D.M., Wilson D. Self-administered questions by telephone: Evaluating interactive voice response. Public Opinion Quarterly 2002, 66:265-278.
99. Wallace P., Clariana R.B. Test mode familiarity and performance - Gender and race comparisons of test scores among computer literate students in advanced information systems. Journal of Information Systems Education 2005, 16:177-183.
100. Wallace J.C., Tye M.G., Vodanovich S.J. Applying for jobs online: Examining the legality of Internet-based application forms. Public Personnel Management 2000, 29:497-503.
101. Wiechmann D., Ryan A.M. Reactions to computerized testing in selection contexts. International Journal of Selection and Assessment 2003, 11:215-229.
102. Williamson I.O., Lepak D.P., King J. The effect of company recruitment web site orientation on individuals' perceptions of organizational attractiveness. Journal of Vocational Behavior 2003, 63:242-263.
103. Yang Y., Callegaro M., Bhola D., Dillman D. IVR and web administration in structured interviews utilizing rating scales: Exploring the role of motivation as moderator to mode effects. International Journal of Social Research Methodology 2011, 14:1-15.
104. Young D. IVR helps virtual shopping mall with seasonal hiring frenzy Retrieved January 12, 2012 from, frenzy/5055287. http://www.techrepublic.com/article/IVR-helps-virtual-shopping-mall-with-seasonal-hiring.