Internet Administration of Paper-and-Pencil Questionnaires Used in Couple Research: Assessing Psychometric Equivalence

Assessment

Volumn 19, Issue 2, 2012, Pages 226-242

  Brock, Rebecca L ^a   Barry, Robin A ^a   Lawrence, Erika ^a   Dey, Jodi ^a   Rolffs, Jaci ^a  

^a E11 SSH   (United States)

Author keywords

couples; Internet; online; psychometric equivalence; self report

Indexed keywords

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; ARTICLE; FAMILY SIZE; FEMALE; HUMAN; HUMAN RELATION; INSTRUMENTATION; INTERNET; MALE; MARRIAGE; METHODOLOGY; PAPER; PERSONALITY TEST; PREDICTIVE VALUE; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; QUESTIONNAIRE; REPRODUCIBILITY; SELF REPORT; STATISTICS; VALIDATION STUDY; WRITING;

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; FAMILY CHARACTERISTICS; FEMALE; HUMANS; INTERNET; INTERPERSONAL RELATIONS; MALE; MARRIAGE; PAPER; PERSONALITY TESTS; PREDICTIVE VALUE OF TESTS; PSYCHOMETRICS; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS; SELF REPORT; STATISTICS AS TOPIC; WRITING; YOUNG ADULT;

EID: 84855797492     PISSN: 10731911     EISSN: 15523489     Source Type: Journal    
DOI: 10.1177/1073191110382850     Document Type: Article

References (64)

1. Guidelines for computer-based tests and interpretations. Washington, DC: Author; 1986:.
2. Barnes M. L.,Sternberg R. J.Satisfaction in close relationships. Sternberg R. J.Hojjat M., ed. New York, NY: Guilford Press; 1997:79-101.
3. Barry R.,Bunde M.,Brock R. L.,Lawrence E.Validity and utility of a multidimensional model of received support in intimate relationships.Journal of Family Psychology. 2009;23:48-57.
4. Beck A. T.,Steer R. A.Manual for the Beck Anxiety Inventory. San Antonio, TX: Psychological Corporation; 1990:.
5. BowmanM. L. (1990). Coping efforts and marital satisfaction: Measuring marital coping and its correlates. Journal of Marriage and the Family, 52, 463-474. Retrieved from http://www.wiley.com/bw/journal.asp?ref=0022-2445.
6. Birnbaum M. H.Human research and data collection via the internet.Annual Review of Psychology. 2004;55:803-832.
7. Bradbury T. N.,Fincham F. D.,Beach S. R.Research on the nature and determinants of marital satisfaction: A decade in review.Journal of Marriage and Family. 2000;62:964-980.
8. Bradbury T. N.,Fincham F. D.,Frank D.,Beach S. R.Research on the nature and determinants of marital satisfaction: A decade in review.Journal of Marriage and the Family. 2000;62:964-980.
9. Buchanan T.The Oxford handbook of Internet psychology. Joinson A.McKenna K.Postmes T.Reips U., ed. Oxford, England: Oxford University Press; 2007:447-460.
10. BuchananT.AliT.HeffernanT. M.LingJ.ParrottA. C.RodgersJ.ScholeyA. B. (2005). Non-equivalence of online and paper-and-pencil psychological tests: The case of the Prospective Memory Questionnaire. Behavior Research Methods, 37, 148-154. Retrieved from http://brm.psychonomic-journals.org/.
11. BuchananT.SmithJ. L. (1999). Using the Internet for psychological research: Personality testing on the World Wide Web. British Journal of Psychology, 90, 125-144. Retrieved from http://www.bpsjournals.co.uk/journals/bjp/.
12. Buss A. H.,Perry M. P.The aggression questionnaire.Journal of Personality and Social Psychology. 1992;63:452-459.
13. Carlbring P.,Brunt S.,Bohman S.,Austin D.,Richards J.,Ost L. G.,Andersson G.Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobic research.Computers in Human Behavior. 2007;23:1421-1434.
14. Cicchetti D. V.Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.Psychological Assessment. 1994;6:284-290.
15. Coles M. E.,Cook L. M.,Blake T. R.Assessing obsessive compulsive symptoms and cognitions on the internet: Evidence for the comparability of paper and Internet administration.Behavior Research and Therapy. 2007;45:2232-2240.
16. Cordova J. V.,Gee C. B.,Warren L. Z.Emotional skillfulness in marriage: Intimacy as a mediator of the relationship between emotional skillfulness and marital satisfaction.Journal of Social and Clinical Psychology. 2005;24:218-235.
17. Cutrona C. E.,Russell D.Advances in personal relationships. Jones W. H.Perlman D., ed. Greenwich, CT: JAI Press; 1987:37-67.
18. Davis R. N.Web-based administration of a personality questionnaire: Comparison with traditional methods.Behavior Research Methods, Instruments, and Computers. 1999;31:572-577.
19. Dehle C.,Larsen D.,Landers J. E.Social support in marriage.American Journal of Family Therapy. 2001;29:307-324.
20. Dillman D. A.,Smyth J. D.,Christian L. M.Internet, mail, and mixed-mode surveys. Hoboken, NJ: Wiley; 2009:.
21. DunnO. J.ClarkV. A. (1969). Correlation coefficients measured on the same individuals. Journal of the American Statistical Association, 64, 366-377. Retrieved from http://www.amstat.org/publications/jasa.cfm.
22. DunnO. J.ClarkV. A. (1971). Comparison of tests of the equality of dependent correlation coefficients. Journal of the American Statistical Association, 66, 904-908. Retrieved from http://www.amstat.org/publications/jasa.cfm.
23. Fife-Schaw C.Research methods in psychology. 2006). Questionnaire design. In BreakwellG. M.HammondS.Fife-SchawC.SmithJ. A. (Eds.), Research methods in psychology (3rd ed., pp. 210-231). London, England: SAGE.Breakwell G. M.Hammond S.Fife-Schaw C.Smith J. A., ed. London, England: SAGE:210-231.
24. Fletcher G. J. O.,Simpson J. A.,Thomas G.The measurement of Perceived Relationship Quality Components: A confirmatory factor analytic approach.Personality and Social Psychology Bulletin. 2000;26:340-354.
25. Fraley R.,Waller N.,Brennan K.An item response theory analysis of self-report measures of adult attachment.Journal of Personality and Social Psychology. 2000;78:350-365.
26. Frye N. E.,Karney B. R.The context of aggressive behavior in marriage: A longitudinal study of newlyweds.Journal of Family Psychology. 2006;20:12-20.
27. Fuendeling J. M.Affect regulation as a stylistic process within attachment style.Journal Social and Personal Relationships. 1998;15:291-322.
28. Gable S. L.,Gonzaga G. C.,Strachman A.Will you be there for me when things go right? Supportive responses to positive event disclosures.Journal of Personality and Social Psychology. 2006;91:904-917.
29. Ghiselli E. E.Theory of psychological measurement. New York, NY: McGraw-Hill; 1964:.
30. Ghiselli E. E.,Campbell J. P.,Zedeck S.Measurement theory for the behavioral sciences. San Francisco, CA: W. H. Freeman; 1981:.
31. HambyS.SugarmanD. B.Boney-McCoyS. (2006). Does questionnaire format impact reported partner violence rates? An experimental study. Violence and Victims, 21, 507-518. Retrieved from http://www.springerpub.com/product/08866708.
32. HammenC.AdrianC.GordonD.BurgeD.JaenickeC.HirotoD. (1987). Children of depressed mothers: Maternal strain and symptom predictors of dysfunction. Journal of Abnormal Psychology, 96, 190-198. Retrieved from http://www.apa.org/pubs/journals/abn/index.aspx.
33. Hertel G.,Naumann S.,Konradt U.,Batinic B.Online social sciences. Batinic B.Reips U. D.Bosnijak M., ed. Seattle, WA: Hogrefe & Huber; 2002:115-133.
34. HewsonC.CharltonJ. P. (2005). Measuring health beliefs on the Internet: A comparison of paper and Internet administrations of the Multidimensional Health Locus of Control Scale. Behavior Research Methods, 37, 691-702. Retrieved from http://brm.psychonomic-journals.org/.
35. Heyman R.,Sayers S.,Bellack A.Global marital satisfaction versus marital adjustment: An empirical comparison of three measures.Journal of Family Psychology. 1994;8:432-446.
36. Karney B. R.,Bradbury T. N.The longitudinal course of marital quality and stability: A review of theory, method, and research.Psychological Bulletin. 1995;118:3-34.
37. Kenny D. A.,Kashy D. A.,Cook W. L.Dyadic data analysis. New York, NY: Guilford Press; 2006:.
38. Langer A.,Lawrence E.,Barry R. A.Using a vulnerability-stress adaptation framework to predict physical aggression trajectories in newlywed marriage.Journal of Consulting and Clinical Psychology. 2008;76:756-768.
39. Laurenceau J.,Barrett L. F.,Rovine M. J.The interpersonal process model of intimacy in marriage: A daily-diary and multilevel modeling approach.Journal of Family Psychology. 2005;19:314-323.
40. Lawrence E.,Barry R. A.,Langer A.,Brock R. L.Encyclopedia of human relationships. Reis H.Sprecher S., ed. Thousand Oaks, CA: SAGE; 2009:1028-1030.
41. Luce K. H.,Winzelberg A. J.,Das S.,Osborne M. I.,Bryson S. W.,Taylor C. B.Reliability of self-report: Paper versus online administration.Computers in Human Behavior. 2007;23:1384-1389.
42. Martin R.,Watson D.,Wan C. K.A three-factor model of trait anger: Dimensions of affect, behavior, and cognition.Journal of Personality. 2000;68:869-897.
43. Meade A. W.,Michels L. C.,Lautenschlager G. J.Are internet and paper-and-pencil personality tests truly comparable? An experimental design measurement invariance study.Organizational Research Methods. 2007;10:322-345.
44. Meyerson P.,Tryon W. W.Validating internet research: A test of psychometric equivalence of Internet and in-person samples.Behavior Research Methods, Instruments, and Computers. 2003;35:614-620.
45. Miller E. T.,Neal D. J.,Roberts L. J.,Baer J. S.,Cressler S. O.,Metrik J.,Marlatt G. A.Test-retest reliability of alcohol measures: Is there a difference between Internet-based assessment and traditional methods?.Psychology of Addictive Behaviors. 2002;16:56-63.
46. Naglieri J. A.,Drasgow F.,Schmit M.,Handler L.,Prifitera A.,Margolis A.,Velasquez R.Psychological testing on the internet: New problems, old issues.American Psychologist. 2004;59:150-162.
47. Neff L. A.,Karney B. R.Gender differences in social support: A question of skills or responsiveness?.Journal of Personality and Social Psychology. 2005;88:79-90.
48. NortonR. (1983). Measuring marital quality: A critical look at the dependent variable. Journal of Marriage and the Family, 45, 141-151. Retrieved from http://www.wiley.com/bw/journal.asp?ref=0022-2445.
49. Pasch L. A.,Bradbury T. N.Social support, conflict, and the development of marital dysfunction.Journal of Consulting and Clinical Psychology. 1998;66:219-230.
50. Pettit F. A.Exploring the use of the World Wide Web as a psychology data collection tool.Computers in Human Behavior. 1999;15:67-71.
51. PierceG.SarasonI.SarasonB. (1991). General and relationship-based perceptions of social support: Are two constructs better than one?Journal of Personality and Social Psychology, 61, 1028-1039. Retrieved from http://www.apa.org/pubs/journals/psp/.
52. Preckel F.,Thiemann H.Online versus paper-and-pencil-version of a high potential intelligence test.Swiss Journal of Psychology. 2003;62:131-138.
53. Robins R. W.,Hendin H. M.,Trzesniewski K. H.Measuring global self-esteem: Construct validation of a single-item measure and the Rosenberg Self-Esteem scale.Personality and Social Psychology Bulletin. 2001;27:151-161.
54. Radloff L. S.The CES-D scale: A self-report depression scale for research in the general population.Applied Psychological Measurement. 1977;1:385-401.
55. Riva G.,Teruzzi T.,Anolli L.The use of the internet in psychological research: Comparison of online and offline questionnaires.Cyberpsychology & Behavior. 2003;6:73-80.
56. Rosenberg M.Society and the adolescent self-image. Princeton, NJ: Princeton University Press; 1965:.
57. Schmidt W. C.World-Wide Web survey research: Benefits, potential problems, and solutions.Behavior Research Methods, Instruments, and Computers. 1997;29:274-279.
58. Snyder D. K.,Aikman G. G.The use of psychological testing for treatment planning and outcomes assessment. 1999). Marital Satisfaction Inventory-Revised. In MaruishM. E. (Ed.), The use of psychological testing for treatment planning and outcomes assessment (2nd ed., pp. 1173-1210). Mahwah, NJ: Lawrence Erlbaum.Maruish M. E., ed. Mahwah, NJ: Lawrence Erlbaum:1173-1210.
59. Sternberg R. J.Construct validation of a triangular love scale.European Journal of Social Psychology. 1997;27:313-335.
60. Tourangeau R.,Couper M. P.,Conrad F.Spacing, position, and order: Interpretive heuristics for visual features of survey questions.Public Opinion Quarterly. 2004;68:368-393.
61. van de Vijver F. J. R.,Harsveld M.The incomplete equivalence of the paper-and-pencil and computerized versions of the General Aptitude Test Battery.Journal of Applied Psychology. 1994;79:852-859.
62. WatsonD.ClarkL. A.TellegenA. (1988). Development and validation of brief measures of positive and negative affect: The PANAS Scales. Journal of Personality and Social Psychology, 54, 1063-1070. Retrieved from http://www.apa.org/pubs/journals/psp/.
63. WeissmanM. M.SholomskaD.PottengerM.PrusoffB. A.LockeB. Z. (1977). Assessing depressive symptoms in five psychiatric populations: a validation study. American Journal of Epidemiology, 106, 203-214. Retrieved from http://aje.oxfordjournals.org/.
64. Wilfong J. D.Computer anxiety and anger: The impact of computer use, computer experience, and self-efficacy beliefs.Computers in Human Behavior. 2006;22:1001-1011.