Reliability in experimental sociology

Social Forces

Volumn 78, Issue 4, 2000, Pages 1277-1309

  Thye, Shane R ^a  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0034195508     PISSN: 00377732     EISSN: None     Source Type: Journal    
DOI: 10.1093/sf/78.4.1277     Document Type: Article

References (127)

1. Adams, J. Stacy. 1965. "Inequality in Social Exchange." Advances in Experimental Social Psychology 2:267-299.
2. Averill, James R. 1992. "The Structural Bases of Emotional Behavior." Pp. 1-24 in Emotion. Edited by Margaret S. Clark. Sage.
3. Babbie, Earl. 1989. The Practice of Social Research. Wadsworth.
4. Bacharach, Samuel B., and Edward J. Lawler. 1980. Power and Politics in Organizations. Jossey-Bass.
5. -. 1981. Bargaining: Power, Tactics, and Outcomes. San Francisco: Jossey-Bass.
6. Balkwell, James W., Joseph Berger, Murray Webster Jr., Max Nelson-Kilger and Jacqueline Cashen. 1992. "Processing Status Information: Some Tests of Competing Theoretical Arguments." Advances in Group Processes 9:1-20.
7. Bass, Alan R., and Ira J. Firestone. 1980. "Implications of Representativeness for Generalizability of Field and Laboratory Research Findings." American Psychologist 35:463-64.
8. Bentler, Peter M. EQS Structural Equations Program Manual. Encino, Calif.: Multivariate Software.
9. Berger, Joseph, Bernard P. Cohen, and Morris Zelditch Jr. 1972. "Status Characteristics and Social Interaction." American Sociological Review 37:241-55.
10. Berger, Joseph, Thomas L. Conner, and M. Hamit Fisek (eds.). 1974. Expectation States Theory: A Theoretical Research Program Cambridge, Mass.: Winthrop. Reprint. Lanham, Md.: University Press of America, 1982.
11. Berger, Joseph, M. Hamit Fisek, and Lee Freese. 1976. "Paths of Relevance and the Determination of Power and Prestige Orders." Pacific Sociological Review 19:45-62.
12. Berger, Joseph, M. Hamit Fisek, Robert Z. Norman, and Morris Zelditch Jr. 1977. Status Characteristics and Social Interaction. Elsevier.
13. Berger, Joseph, Morris Zelditch Jr., Bo Anderson and Bernard P. Cohen. 1972. "Structural Aspects of Distributive Justice: A Status Value Formulation." Pp. 119-146 in Sociological Theories in Progress, edited by Joseph Berger, Morris Zelditch Jr., and Bo Anderson. Houghton-Mifflin.
14. Berkowitz, Leonard, and Edward Donnerstein. 1982, "External Validity is More than Skin Deep." American Psychologist 37:245-257.
15. Blalock, Hubert M. 1979. "The Presidential Address: Measurement and Conceptualization Problems: The Major Obstacle to Integrating Theory and Research." American Sociological Review 44:881-94.
16. Bollen, Kenneth A., and Pamela Paxton. 1998. "Detection and Determinants of Bias in Subjective Measures." American Sociological Review 63:465-78.
17. Brogden, Hubert. 1972. "Some Observations on Two Methods in Psychology." Psychological Bulletin 77:431-37.
18. Brown, William. 1910. "Some Experimental Results in the Correlation of Mental Abilities." British Journal of Psychology 3:296-322.
19. Burke, Peter J. 1991. "Identity Processes and Social Stress." American Sociological Review 56:836-49.
20. Campbell, Donald and Julian Stanley. 1966. Experimental and Quasi-Experimental Designs for Research. Rand McNally.
21. Carmines, Edward G., and Richard A. Zeller. 1979. Reliability and Validity Assessment. Sage.
22. Christensen, Larry B. 1988. Experimental Methodology. Allyn & Bacon.
23. Cliff, Norman. 1992. "Abstract Measurement Theory and the Revolution that Never Happened." Psychological Science 3:186-90.
24. Cohen, Bernard P. 1989. Developing Sociological Knowledge. Nelson-Hall.
25. Cohen, Elizabeth G. 1993. "From Theory to Practice: The Development of an Applied Research Program." Pp. 385-415 in Theoretical Research Programs: Studies in the Growth of Theory, edited by Joseph Berger and Morris Zelditch Jr. Stanford University Press.
26. Cohen, Jacob. 1960. "A Coefficient of Agreement for Nominal Scales." Educational and Psychological Bulletin 76:378-82.
27. -. 1969. Statistical Power Analysis for the Behavioral Sciences. Academic Press.
28. Coleman, James. 1990. Foundations of Social Theory. Harvard.
29. Cook, Karen S., and Toshio Yamagishi. 1992. "Power in Exchange Networks: A Power-Dependence Formulation." Social Networks 14:245-65.
30. Crocker, Linda M., and James Algina. 1986. Introduction to Classical and Modern Test Theory. Holt, Rinehart & Winston.
31. Cronbach, Lee J. 1947. "Test Reliability: Its Meaning and Determination." Psychometrika 12:1-16.
32. -. 1951. "Coefficient Alpha and the Internal Structure of Tests." Psychometrika 16:297-334.
33. Cronbach, Lee J., Nageswari Rajaratnam, and Goldine C. Gleser. 1963. "Theory of Generalizability: A Liberalization of Reliability Theory." British Journal of Statistical Psychology 16:137-63.
34. Cronbach, Lee J., Goldine C. Gleser, Harinder Nanda, and Nageswari Rajaratnam. 1972. The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles Wiley.
35. Cureton, Edward E. 1958. "The Definition and Estimation of Test Reliability." Educational and Psychological Measurement 18:715-38.
36. Dipboye, Robert L., and Michael F. Flanagan. 1979. "Research Settings in Industrial and Organizational Psychology. Are Findings in the Field more Generalizable than in the Laboratory?" American Psychologist 34:141-50.
37. -. 1980a. "Reply to Willems and Howard" American Psychologist 35:388-90.
38. -. 1980b. "Representativeness Does Have Implications for the Generalizability of Laboratory and Field Research Findings." American Psychologist 35:464-67.
39. Dobbins, Gregory H., Irving M. Lane, and Dirk D. Steiner. 1988. "A Note on the Role of Laboratory Methodologies in Applied Behavioral Research: Don't Throw out the Baby with the Bath Water." Journal of Organizational Behavior 9:281-286.
40. Emerson, Richard M. 1972a. "Exchange Theory, Part I: A Psychological Basis for Social Exchange." Pp. 38-57 in Sociological Theories in Progress. Vol. 2, edited by Joseph Berger, Morris Zelditch Jr., and Bo Anderson. Boston: Houghton-Mifflin,
41. -. 1972b. "Exchange Theory, Part II: Exchange Relations and Networks." Pp. 58-87 in Sociological Theories in Progress. Vol. 2, edited by Joseph Berger, Morris Zelditch Jr., and Bo Anderson. Boston: Houghton-Mifflin.
42. Feldt, Leonard S., and Robert L. Brennan. 1983. "Reliability." Pp. 105-146 in Educational Measurement. 3d ed., edited by Robert L. Linn. Macmillan.
43. Fisher, Ronald A. 1935. The Design of Experiments. Hafner.
44. Fleiss, Joseph L. 1976. "Comment on Overall and Woodward's Asserted Paradox Concerning the Measurement of Change." Psychological Bulletin 83:774-75.
45. Foschi, Martha. 1996. "Double Standards in the Evaluation of Men and Women" Social Psychology Quarterly 59:237-54.
46. Geen, Russell G., John J. Rakosky and Roger Pigg. 1972. "Awareness and Arousal and its Relation to Aggression." British Journal of Social and Clinical Psychology 31:721-26.
47. Glass, Gene V. 1976. "Primary, Secondary, and Meta-analysis of Research." Educational Researcher 5:3-8.
48. Glass, Gene V., Barry McGaw, and Mary Lee Smith. 1981. Meta-analysis in Social Research. Sage.
49. Gordon, Michael, L. Allen Slade, and Neal Schmitt. 1986. "The 'Science of the Sophomore' Revisited: From Conjecture to Empiricism." Academy of Management Review 11:191-207.
50. Granovetter, Mark. 1985. "Economic Action and Social Structure: The Problem of Embeddedness." American Journal of Sociology 91:481-510.
51. Greenwood, John D. 1982. "The Relation Between Laboratory Experiments and Social Behaviour: Causal Explanation and Generalization." Journal for the Theory of Social Behaviour 12:225-50.
52. Gulliksen, Harold. 1950. Theory of Mental Tests. John Wiley.
53. Harré, Romano, and Paul F. Secord. 1973. The Explanation of Social Behaviour. Littlefield, Adams.
54. Heath, Anthony. 1975. Rational Choice and Social Exchange. Cambridge University Press.
55. Henshel, Richard L. 1980. "Seeking Inoperative Laws: Toward the Deliberate Use of Unnatural Experimentation." Pp. 175-99 in Theoretical Methods in Sociology, edited by Lee Freese. Pittsburgh: University of Pittsburgh Press.
56. Hoyt, Cyril. 1941."Test Reliability Estimated by Analysis of Variance." Psychometrica 6:153-60.
57. Hunter, John E., and Frank L. Schmidt. 1990. Methods of Meta-Analysis: Correcting Error and Bias in Research Findings. Sage.
58. Huynh, Huynh. 1976. "On the Reliability of Decisions in Domain-Referenced Testing. Journal of Educational Measurement 13:253-64.
59. Jasso, Guillermina. 1980. "A New Theory of Distributive Justice." American Sociological Review 45:3-32.
60. Jones, Lyle V. 1971. "The Nature of Measurement." Pp. 335-55 in Educational Measurement, edited by Robert L. Thorndike. Washington, D.C.: American Council on Education.
61. Kirk, Roger E. 1982. Experimental Design: Procedures for the Behavioral Sciences. Brooks/Cole.
62. Krippendorff, Klaus. 1978. "Reliability of Binary Attribute Data." Biometrica 34:142-44.
63. -. 1980. Content Analysis; An Introduction to its Methodology. Sage.
64. -. 1995. "On the Reliability of Unitizing Continuous Data." Pp. 47-76 in Sociological Methodology, edited by Peter V. Marsden. Jossey-Bass.
65. Kruglanski, Arie, and Moshe Kroy. 1976. "Outcome Validity in Experimental Research: A Reconceptualization." Representative Research in Social Psychology 7:166-78.
66. Kuder, George, and M. W. Richardson. 1937. "The Theory of the Estimation of Test Reliability." Psychometrika 2:151-60.
67. Kulik, James, and Roger Brown. 1979. "Frustration, Attribution of Blame, and Aggression. Journal of Experimental Social Psychology 15:183-94.
68. Lawler, Edward J. and Jeongkoo Yoon. 1993. "Power and the Emergence of Commitment Behavior in Negotiated Exchange." American Sociological Review 58:465-81.
69. -. 1996. "Commitment in Exchange Relations: Test of a Theory of Relational Cohesion" American Sociological Review 61:89-108.
70. Locke, Edwin A. 1986. "Generalizing from Laboratory to Field: Ecological Validity or Abstraction of Essential Elements." Pp. 3-9 in Generalizing from Laboratory to Field Settings, edited by Edwin A. Locke. D.C. Health & Company.
71. Lord, Frederic M., and Melvin R. Novick. 1968. Statistical Theories of Mental Test Scores. Addison-Wesley.
72. MacIntosh, Randall. 1998. "Global Attitude Measurement: An Assessment of the World Values Survey Postmaterialism Scale." American Sociological Review 63:452-64.
73. Markovsky, Barry. 1985. "Toward a Multilevel Distributive Justice Theory." American Sociological Review 50:822-39.
74. Markovsky, Barry, David Willer, and Travis Patton. 1988. "Power Relations in Exchange Networks," American Sociological Review 53:220-36.
75. Martin, Michael W., and Jane Sell. 1979. "The Role of the Experiment in the Social Sciences." Sociological Quarterly 20:581-90.
76. Meeker, Barbara F. 1990. "Expectation States and Interpersonal Behavior." Pp. 290-319 in Social Psychology: Sociological Perspectives, edited by Morris Rosenberg and Ralph H. Turner. Transaction Publishers.
77. Meeker, Barbara F., and Robert Leik. 1995. "Experimentation in Sociological Social Psychology." Pp. 630-49 in Sociological Perspectives on Social Psychology, edited by Karen S. Cook, Gary Alan Fine and James S. House. Allyn & Bacon.
78. Meehl, Paul E. 1967. "Theory Testing in Psychology and Physics: A Methodological Paradox." Philosophy of Science 34:103-15.
79. Mizruchi, Mark S. 1989. "Similarity of Political Behavior Among Large American Coorporations." American Journal of Sociology 95:401-24.
80. Molm, Linda. 1990. "Structure, Action, and Outcomes: The Dynamics of Power in Social Exchange." American Sociological Review 55:427-47.
81. Mook, Douglas. 1983. "In Defense of External Invalidity." American Psychologist 38:379-87.
82. Moore, James C., Jr. 1965, "Development of the Spatial Judgment Experimental Task." Technical Report no. 15. Laboratory for Social Research, Stanford University, Stanford, California.
83. -. 1968. "Status and Influence in Small Group Interactions." Sociometry 31:47-63.
84. Nicewander, Alan and James Price. 1978. "Dependent Variable Reliability and the Power of Statistical Tests." Psychological Bulletin 85:405-409.
85. -. 1983. "Reliability of Measurement and the Power of Statistical Tests: Some New Results." Psychological Bulletin 94:524-33.
86. Nunnally, Jum C. 1978. Psychometric Theory. McGraw Hill.
87. Nunnally, Jum C., and Ira Bernstein. 1994. Psychometric Theory. McGraw-Hill.
88. Overall, John E., and J. Arthur Woodward. 1975. "Unreliability of Difference Scores: A Paradox for the Measurement of Change." Psychological Bulletin 82:85-86.
89. -. 1976. "Reassertion of the Paradoxical Power of Tests of Significance Based on Unreliable Difference Scores." Psychological Bulletin 83:776-77.
90. Price, James L. and Charles W. Mueller. 1986. Handbook of Organizational Measurement. Ballinger.
91. Pruitt, Dean G. 1981. Negotiation Behavior. Academic.
92. Pugh, M. D., and Ralph Wahrman. 1983. "Neutralizing Sexism in Mixed-Sex Groups: Do Women Have to Be Better than Men?" American Journal of Sociology 88:746-62.
93. Ridgeway, Cecilia L., and Henry A. Walker. 1995. "Status Structures." Pp. 281-310 in Sociological Perspectives on Social Psychology, edited by in Karen S. Cook, Gary Alan Fine and James S. House. Allyn & Bacon.
94. Rosenthal, Robert. 1984. Meta-Analysis Procedures for Social Science Research. Sage.
95. Runkel, Philip J., and Joseph McGrath. 1972. Research on Human Behavior: A Systematic Guide to Method. Holt, Rinehart & Winston.
96. Schmidt, Frank L. 1992. "What do Data Really Mean? Research Findings, Meta-Analysis, and Cumulative Knowledge in Psychology." American Psychologist 47:1173-81.
97. Schmidt, Frank L., and John E. Hunter. 1989. "Interrater Reliability Coefficients Cannot be Computed When Only One Stimulus is Rated." Journal of Applied Psychology 74:368-70.
98. -. 1996. "Measurement Error in Psychological Research: Lessons from 26 Research Scenarios." Psychological Methods 1:199-233.
99. Schulman, Gary I. 1974. "Race, Sex, and Violence: A Laboratory Test of the Sexual Threat of the Black Male Hypothesis." American Journal of Sociology 79:1260-77.
100. Shavelson, Richard J., and Noreen M. Webb. 1991. Generalizability Theory: A Primer. Sage.
101. Spearman, Charles Edward. 1904. "The Proof and Measurement of Association Between Two Things." American Journal of Psychology 15:72-101.
102. -. 1910. "Correlation Calculated from Faulty Data." British Journal of Psychology 3:271-95.
103. Stanley, Julian C. 1971. "Reliability." Pp. 356-442 in Educational Measurement. Second Edition, edited by Robert L. Thorndike. Washington, DC.: American Council on Education.
104. Staw, Barry M., and Jerry Ross. 1985. "Stability in the Midst of Change: A Dispositional Approach to Job Attitudes." Journal of Applied Psychology 70:469-80.
105. Stevens, Stanley Smith. 1951. "Mathematics, Measurement and Psychophysics." Pp. 1-49 in Handbook of Experimental Psychology, edited by Stanley Smith Stevens. John Wiley.
106. Stolte, John F. 1983. "The Legitimation of Structural Inequality: Reformulation and Test of the Self-Evaluation Argument." American Sociological Review 48:331-42.
107. Sutcliffe, J.P. 1980. "On the Relationship of Reliability to Statistical Power." Psychological Bulletin 88:509-15.
108. Thomas, George M., Henry A. Walker, and Morris Zelditch Jr. 1986. "Legitimacy and Collective Action." Social Forces 65:378-404.
109. Thorndike, Edward L. 1904. An Introduction to the Theory of Mental and Social Measurements. Science Press.
110. -. 1951. "Reliability." Pp. 560-620 in Educational Measurement, edited by E.F. Lindquist. Washington: American Council on Education.
111. Traub, Ross E. 1994. Reliability for the Social Sciences. Sage.
112. Traub, Ross E., and Glenn L. Rowley. 1980. "Reliability of Test Scores and Decisions." Applied Psychological Measurement 4:517-45.
113. Troyer, Lisa, and C. Wesley Younts. 1997. "Whose Expectations Matter? The Relative Power of First-Order and Second-Order Expectations in Determining Social Influence." American Journal of Sociology 103:692-732.
114. Wagner, David G., and Joseph Berger. 1993. "Status Characteristics Theory: The Growth of a Program." Pp. 23-63 in Theoretical Research Programs: Studies in the Growth of Theory, edited by Joseph Berger and Morris Zelditch, Jr. Stanford University Press.
115. Walker, Henry A., and Morris Zelditch, Jr. 1993. "Power, Legitimacy and Stability of Authority: A Theoretical Research Program." Pp. 364-81 in Theoretical Research Programs: Studies in the Growth of Theory, edited by Joseph Berger and Morris Zelditch Jr. Stanford University Press.
116. Watson, James D. 1968. The Double Helix. Penguin.
117. Webb, Noreen M., and Richard J. Shavelson. 1981. "Multivariate Generalizability of Educational Development Ratings." Journal of Educational Measurement 18:13-22.
118. Webster, Murray, Jr. 1994. "Experimental Methods." Pp. 43-69 in Group Processes, edited by Martha Foschi and Edward J. Lawler. Nelson-Hall.
119. Webster, Murray, Jr., and John Kervin. 1971. "Artificiality in Experimental Sociology." Canadian Review of Sociology and Anthropology 8:263-72.
120. Webster, Murray, Jr., and Joseph M. Whitmeyer. 1999. "A Theory of Second-Order Expectations and Behavior." Social Psychology Quarterly 62:17-31.
121. Weiner, B.J. 1971. Statistical Principles in Experimental Design. McGraw Hill.
122. Willems, Edwin P., and George S. Howard. 1980. "The External Validity of Papers on External Validity" American Psychologist 35:387-88.
123. Willer, David. 1987. Theory and the Experimental Investigation of Social Structures. Gordon & Breach.
124. Willer, David. 1999. Network Exchange Theory. Praeger.
125. Willer, David, and Bo Anderson. 1981. Networks, Exchange, and Coercion. Elsevier/Greenwood.
126. Willer, David, and Murray Webster Jr. 1970. "Theoretical Constructs and Observables." American Sociological Review 35:748-57.
127. Zelditch, Morris, Jr. 1969. "Can you Really Study an Army in the Laboratory?" Pp. 531-39 in A Sociological Reader on Complex Organizations. 2d ed., edited by Amitai Etzioni. Holt, Rinehart & Winston.