A Concurrent Mixed Methods Approach to Examining the Quantitative and Qualitative Meaningfulness of Absolute Magnitude Estimation Scales in Survey Research

Journal of Mixed Methods Research

Volumn 8, Issue 2, 2014, Pages 180-202

  Koskey, Kristin L K ^a   Stewart, Victoria C ^b  

^a UNIVERSITY OF AKRON   (United States)

^b UNIVERSITY OF TOLEDO   (United States)

Author keywords

concurrent mixed method; magnitude estimation scaling; rating scales; unlimited scaling methods

Indexed keywords

EID: 84898890376     PISSN: 15586898     EISSN: 15586901     Source Type: Journal    
DOI: 10.1177/1558689813496905     Document Type: Article

References (75)

1. Algom D.,Marks L. E.Individual differences in loudness processing and loudness scales.Journal of Experimental Psychology: General. 1984;113:571-593.
2. Alwin D. F.Research on survey quality.Sociological Methods and Research. 2001;20:1-39.
3. Bard E. G.,Robertson D.,Sorace A.Magnitude estimation of linguistic acceptability.Language. 1996;72:32-68.
4. Bass B. M.,Cascio W. F.,O'Connor E. J.Magnitude estimations of expressions of frequency and amount.Journal of Applied Psychology. 1974;59:313-320.
5. Beltyukova S. A.,Stone G. M.,Ellis L. W.Rasch analysis of word identification and magnitude estimation responses in measuring naïve listeners' judgments of speech intelligibility of children with severe-to-profound hearing impairments.Journal of Speech, Language, and Hearing Research. 2008;51:1124-1137.
6. Beltyukova S. A.,Stone G. E.,Fox C. M.Magnitude estimation and categorical rating scaling in social sciences: A theoretical and psychometric controversy.Journal of Applied Measurement. 2008;9:151-159.
7. Bond T. G.,Fox C. M.Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum; 2007:.
8. Borsboom D.Measuring the mind: Conceptual issues in contemporary psychometrics. Borsboom D., ed. New York, NY: Cambridge University Press; 2005:149-172.
9. Borsboom D.,Mellenbergh G. J.,Heerden J. V.The concept of validity.Psychological Review. 2004;111:1061-1071.
10. Boverie P. E.,Scheuffele D. J.,Raymond E. L.Multimethodological approach to examining risk-taking.Current Psychology: Developmental, Learning, Personality, & Social. 1995;13:289-302.
11. Chang L.Quantitative attitudes questionnaire: Instrument development and validation.Educational & Psychological Measurement. 1996;56:1037-1042.
12. Creswell J. W.Qualitative inquiry and research design: Choosing among five approaches. 2007). Qualitative inquiry and research design: Choosing among five approaches (2nd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2007:.
13. Eadie T. L.,Doyle P. C.Direct magnitude estimation and interval scaling of pleasantness and severity in dysphonic and normal speakers.Journal of Acoustical Society of America. 2002a;112:3014-3021.
14. Eadie T. L.,Doyle P. C.Direct magnitude estimation and interval scaling of naturalness and severity in tracheoesophageal (TE) speakers.Journal of Speech, Language, and Hearing Research. 2002b;45:1088-1096.
15. Eisenberg M.,Barry C.Order effects: A study of the possible influence of presentation order on user judgments of document relevance.Journal of the American Society for Information Science. 1988;39:293-300.
16. Ellis L.,Fucci D.Magnitude-estimation scaling of speech intelligibility: Effects of listeners' experience and semantic-syntactic context.Perceptual and Motor Skills. 1991;73:295-305.
17. Ericsson K. A.,Simon H. A.Verbal reports as data.Psychological Review. 1980;87:215-251.
18. Falmagne J. C.,Narens L.Scales and meaningfulness of quantitative laws.Synthese. 1983;55:287-325.
19. Fisher W. P.Meaning and method in the social sciences.Human Studies. 2004;27:429-454.
20. Fucci D.,Domyan S.,Ellis L.,Harris D.Magnitude-estimation scaling: An effective method for the measurement of the quality of filtered speech.Perceptual and Motor Skills. 1994;78:348-350.
21. Fucci D.,Petrosino L.,Banks M.,Zaums K.,Wilcox C.The effect of preference for three different types of music on magnitude estimation-scaling behavior in young adults.Perceptual and Motor Skills. 1996;83:339-347.
22. Hamblin R. L.Measurement in the social sciences. Blalock H. M., ed. Chicago, IL: Aldine Press; 1974:61-120.
23. Harris D.,Fucci D.,Petrosino L.,Wallace D.Instrumentation for magnitude estimation and cross-modality matching of auditory and lingual vibrotactile sensations.Review of Scientific Instruments. 1986;57:2343-2347.
24. Hellman R. P.,Zwislocki J.Monaural loudness function at 1000 cps and interaural summation.Journal of the Acoustical Society of America. 1963;35:856-865.
25. Hinshaw A. S.,Schepp K.Territorial intrusion and client outcomes: The use of magnitude estimation.Communicating Nursing Research. 1983;19:77.
26. Horowitz A. J.Subjective value of time in bus transit travel.Transportation. 1981;10:149-164.
27. Institute of Objective Measurement (2000, December). Definition of objective measurement. Retrieved from http://www.rasch.org/define.htm.
28. Kinney M.,Guzzetta C. E.Identifying critical defining characteristics of nursing diagnoses using magnitude estimation scaling.Research in Nursing & Health. 1989;12:373-380.
29. KlugeS. (2000). Empirically grounded construction of types and typologies in qualitative Social research. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, 1(1). Retrieved from http://www.qualitative-research.net/index.php/fqs/article/view/1124/2499.
30. Koskey K. L. K.A mixed-method approach to examining the use of absolute magnitude estimation scaling using the Many-Facet Rasch model and an instrumental case study. 2009;:.
31. Koskey K. L. K.,Sondergeld T. A.,Beltyukova S. A.,Fox C. M. Paper presented at the American Educational Research Association Annual Meeting; 2008New York, NY; 2008.
32. Lawless H. T.,Horne J.,Spiers W.Contrast and range effects for category, magnitude and labeled magnitude scales in judgements of sweetness intensity.Chemical Senses. 2000;25:85-92.
33. Linacre M. J.Many-facet Rasch measurement. Chicago, IL: MESA Press; 1994:.
34. Linacre M. J.Investigating rating scale category utility.Journal of Outcome Measurement. 1999;3:103-122.
35. Linacre M. J.Optimizing rating scale category effectiveness.Journal of Applied Measurement. 2002;3:85-106.
36. Linacre M. J.A user's guide to Winsteps/Ministeps Rasch-model program. Chicago, IL: MESA Press; 2005:.
37. Linacre M. J.FACETS: Rasch measurement computer program. Chicago, IL: MESA Press; 2006:.
38. Linacre M. J.A user's guide to FACETS: Rasch-model computer programs. Chicago, IL: MESA Press; 2008:.
39. Linacre M. J.,Wright B. D.Understanding Rasch measurement: Construction of measures from many-facet data.Journal of Applied Measurement. 2002;4:486-512.
40. Lodge M.Magnitude scaling: Quantitative measurement of opinions. Beverly Hills, CA: Sage; 1981:.
41. McColl D.,Fucci D.Comparison of magnitude estimation and interval scaling of loudness.Perceptual and Motor Skills. 1999;88:25-30.
42. McColl D.,Fucci D.Measurement of speech disfluency through magnitude estimation and interval scaling.Perceptual and Motor Skills. 2006;102:454-460.
43. Meek P. M.,Sennott-Miller L.,Ferdetich S. L.Focus on psychometrics: Scaling stimuli with magnitude estimation.Research in Nursing & Health. 1992;15:77-81.
44. Mundy B.On the general theory of meaningful representation.Synthese. 1986;67:391-437.
45. Onwuegbuzie A. J.,Collins K. M. T.The typology of mixed methods sampling designs in social science research.Qualitative Report. 2007;12:281-316.
46. Opfer J. E.,Devries J. M.Representational change and magnitude estimation: Why young children can make more accurate salary comparisons than adults.Cognition. 2008;108:843-849.
47. Orth B.,Wegener B.Scaling occupational prestige by magnitude estimation and category rating methods: A comparison with the sensory domain.European Journal of Social Psychology. 1983;13:417-431.
48. Petrosino L.,Fucci D.,Ellis L.,Harris D.Effects of auditory masking on lingual vibrotactile magnitude-estimation scaling responses of young children.Perceptual & Motor Skills. 1989;68:523-529.
49. Poulton E. C.The new psychophysics: Six models for magnitude estimation.Psychological Bulletin. 1968;69 (1): 1-19.
50. Rasch G.Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark, Netherlands: Danmarks Paedagogiske Institut; 1960:.
51. Rasch G.Probabilistic models for some intelligence and attainment tests. Chicago, IL: University of Chicago Press; 1980:.
52. Roberts F. S.Measurement theory. Reading, MA: Addison-Wesley; 1979:.
53. Schriesheim C. A.,Gardiner C. C.A comparative test of magnitude estimation and pair-comparison treatment of complete ranks for scaling a small number of equal interval frequency response anchors.Educational and Psychological Measurement. 1992;52:876-877.
54. Sennott-Miller L.,Murdaugh C.,Hinshaw A. S.Magnitude estimation: Issues and practical applications.Western Journal of Nursing Research. 1988;10:414-424.
55. Siegler R. S.,Opfer J. E.The development of numerical estimation: Evidence for multiple representation of numerical quantity.Psychological Science. 2003;14:237-243.
56. Southwood M. H.,Flege J. E.Scaling foreign accent: Direct magnitude estimation versus interval scaling.Clinical Linguistics & Phonetics. 1999;13:335-349.
57. Stake R. E.The art of case study research. Stake R. E., ed. Thousand Oaks, CA: Sage; 1995:1-13.
58. Stevens S. S.Handbook of experimental psychology. Stevens S. S., ed. New York, NY: Wiley; 1951:1-49.
59. Stevens S. S.Psychophysics and social scaling. Morristown, NJ: General Learning Press; 1972:.
60. Stevens S. S.Psychophysics: Introduction to its perceptual, neural, and social prospects. New York, NY: Wiley; 1975:.
61. Sudman S.,Bradburn N.,Schwarz N.Thinking about answers: The application of cognitive processes to survey methodology. San Francisco, CA: Jossey-Bass; 1996:.
62. Tashakkori A.,Teddlie C.Combining qualitative and quantitative approaches. Thousand Oaks, CA: Sage; 1998:.
63. Teddlie C.,Tashakkori A.Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences. Thousand Oaks, CA: Sage; 2009:.
64. Tesler M. D.,Savedra M. C.,Holzemer W. L.,Wilkie D. J.,Ward J. A.,Paul S. M.The word-graphic rating scale as a measure of children's and adolescents' pain intensity.Research in Nursing & Health. 1991;14:361-371.
65. Thurstone L. L.The measurement of values. Chicago, IL: Chicago Press; 1974:.
66. Torgerson W. S.Theory and methods of scaling. Torgerson W. S., ed. New York, NY: John Wiley; 1958:61-93.
67. Viswanathan M.,Sudman S.,Johnson M.Maximum versus meaningful discrimination in scale responses: Implications for validity of measurement of consumers' perceptions about products.Journal of Business Research. 2004;57:108-124.
68. Walker B.Magnitude estimation of conceptual data dimensions for use in sonification.Journal of Experimental Psychology. 2002;8:211-221.
69. Wegener B.Category-rating and magnitude estimation scaling techniques: An empirical comparison.Sociological methods & Research. 1983;12:31-75.
70. Willis G. B.Methods for testing and evaluating survey questionnaires. Presser S.Rothgeb J. M.Couper M. P.Lesser J. T.Martin E.Martin J.Singer E., ed. New York, NY: John Wiley; 2004:23-43.
71. Woolley M. E.,Bowen G. L.,Bowen N. K.The development and evaluations of procedures to assess child self-report validity.Educational and Psychological Measurement. 2006;66:687-700.
72. Wright B. D.,Masters G. N.Rating scale analysis. Chicago, IL: MESA Press; 1982:.
73. Wright B. D.,Stone M. H.Best test design: Rasch measurement. Chicago, IL: MESA Press; 1979:.
74. Zraick R. I.,Liss J. M.A comparison of equal-appearing interval scaling and direct magnitude estimation of nasal voice quality.Journal of Speech, Language, and Hearing Research. 2000;43:979-988.
75. Zwislocki J. J.,Goodman D. A.Absolute scaling of sensory magnitudes: A validation.Perceptions and Psychophysics. 1980;28 (1): 28-38.