The effectiveness of simple and stratified random sampling in broadcast news content analysis

Journalism and Mass Communication Quaterly

Volumn 73, Issue 1, 1996, Pages 159-168

  Riffe, Daniel ^a   Lacy, Stephen ^a   Nagovan, Jason ^a   Burkum, Larry ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0007274249     PISSN: 10776990     EISSN: None     Source Type: Journal    
DOI: 10.1177/107769909607300114     Document Type: Review

References (41)

1. THE EFFECTIVENESS OF SIMPLE AND STRATIFIED RANDOM SAMPLING IN BROADCAST NEWS CONTENT ANALYSIS By Daniel Riffe, Stephen Lacy, Jason Nagovan, and Larry Burkum A comparison of simple random, monthly stratified and quarterly/weekly stratified sampling in content analyses of television news used annual "populations" of network newscasts. Different samples were drawn and sample statistics compared with annual parameters. Based on percentages of samples that included population means within one or two standard errors, the most efficient technique was two random days per month. Daniel Riffe is a professor in the E.W. Scripps School of Journalism at Ohio University. Stephen Lacy is a professor of journalism and Larry Burkum is a doctoral candidate at Michigan State University. Jason Nagovan is a student at Northern Illinois University.
2. Guido H. Stempel, "Introduction," Journalism Quarterly Index to Volumes 51-60, 1974-1983 (Columbia, SC: Association for Education in Journalism and Mass Communication, 1984), iii.
3. We did not examine each study so catalogued in the index; our rough estimates of growth are thus only as good as the indexing process itself.
4. E.g., James B. Weaver, Christopher J. Porter, and Margaret E. Evans, "Patterns of Foreign News Coverage on U.S. Network TV: A 10-Year Analysis," Journalism Quarterly 61 (summer 1984): 356-63; Jyotika Ramaprasad, "Content, Geography, Concentration and Consonance in Foreign News Coverage of ABC, NBC and CBS," International Communication Bulletin 28 (spring 1993): 10-14; but see also, for domestic news coverage, Joseph R. Dominick, "Geographic Bias in National TV News," Journal of Communication 27 (autumn 1977): 94-99.
5. E.g., James B. Weaver, Christopher J. Porter, and Margaret E. Evans, "Patterns of Foreign News Coverage on U.S. Network TV: A 10-Year Analysis," Journalism Quarterly 61 (summer 1984): 356-63; Jyotika Ramaprasad, "Content, Geography, Concentration and Consonance in Foreign News Coverage of ABC, NBC and CBS," International Communication Bulletin 28 (spring 1993): 10-14; but see also, for domestic news coverage, Joseph R. Dominick, "Geographic Bias in National TV News," Journal of Communication 27 (autumn 1977): 94-99.
6. E.g., James B. Weaver, Christopher J. Porter, and Margaret E. Evans, "Patterns of Foreign News Coverage on U.S. Network TV: A 10-Year Analysis," Journalism Quarterly 61 (summer 1984): 356-63; Jyotika Ramaprasad, "Content, Geography, Concentration and Consonance in Foreign News Coverage of ABC, NBC and CBS," International Communication Bulletin 28 (spring 1993): 10-14; but see also, for domestic news coverage, Joseph R. Dominick, "Geographic Bias in National TV News," Journal of Communication 27 (autumn 1977): 94-99.
7. Churchhill Roberts, "The Presentation of Blacks in Television Network Newscasts," Journalism Quarterly 52 (spring 1975): 50-55; Joseph R. Dominick, "Business Coverage in Network Newscasts," Journalism Quarterly 58 (summer 1981): 179-85,191; Donna M. Randall, "The Portrayal of Corporate Crime in Network Television Newscasts," Journalism Quarterly 64 (spring 1987): 150-53.
8. Churchhill Roberts, "The Presentation of Blacks in Television Network Newscasts," Journalism Quarterly 52 (spring 1975): 50-55; Joseph R. Dominick, "Business Coverage in Network Newscasts," Journalism Quarterly 58 (summer 1981): 179-85,191; Donna M. Randall, "The Portrayal of Corporate Crime in Network Television Newscasts," Journalism Quarterly 64 (spring 1987): 150-53.
9. Churchhill Roberts, "The Presentation of Blacks in Television Network Newscasts," Journalism Quarterly 52 (spring 1975): 50-55; Joseph R. Dominick, "Business Coverage in Network Newscasts," Journalism Quarterly 58 (summer 1981): 179-85,191; Donna M. Randall, "The Portrayal of Corporate Crime in Network Television Newscasts," Journalism Quarterly 64 (spring 1987): 150-53.
10. Tony Atwater, "Network Evening News Coverage of the TWA Hostage Crisis," Journalism Quarterly 64 (summer-autumn 1987): 520-25; David F. Alteheide, "Three-in-One News: Network News Coverage of Iran," Journalism Quarterly 59 (autumn 1982): 482-86; or Milan D. Meeske and Mohamad H. Javaheri, "Network Television Coverage of the Iranian Hostage Crisis," Journalism Quarterly 59 (winter 1982): 641-45.
11. Tony Atwater, "Network Evening News Coverage of the TWA Hostage Crisis," Journalism Quarterly 64 (summer-autumn 1987): 520-25; David F. Alteheide, "Three-in-One News: Network News Coverage of Iran," Journalism Quarterly 59 (autumn 1982): 482-86; or Milan D. Meeske and Mohamad H. Javaheri, "Network Television Coverage of the Iranian Hostage Crisis," Journalism Quarterly 59 (winter 1982): 641-45.
12. Tony Atwater, "Network Evening News Coverage of the TWA Hostage Crisis," Journalism Quarterly 64 (summer-autumn 1987): 520-25; David F. Alteheide, "Three-in-One News: Network News Coverage of Iran," Journalism Quarterly 59 (autumn 1982): 482-86; or Milan D. Meeske and Mohamad H. Javaheri, "Network Television Coverage of the Iranian Hostage Crisis," Journalism Quarterly 59 (winter 1982): 641-45.
13. James B. Lemert, "Content Duplication by the Networks in Competing Evening Newscasts," Journalism Quarterly 51 (summer 1974): 238-44; Joe S. Foote and Michael E. Steele, "Degree of Conformity in Lead Stories in Early Evening Network TV Newscasts," Journalism Quarterly 63 (spring 1986): 19-23; Guido H. Stempel III, "Gatekeeping: The Mix of Topics and the Selection of Stories," Journalism Quarterly 62 (winter 1985): 791-96, 815; Guido H. Stempel III, "Topic and Story Choice of Five Network Newscasts," Journalism Quarterly 65 (autumn 1988): 750-52; Daniel Riffe, Brenda Ellis, Momo K. Rogers, Roger L. Van Ommeren, and Kieran A. Woodman, "Gatekeeping and the Network News Mix," Journalism Quarterly 63 (summer 1986): 315-21; and Ramaprasad, "Content, Geography, Concentration, and Consonance."
14. James B. Lemert, "Content Duplication by the Networks in Competing Evening Newscasts," Journalism Quarterly 51 (summer 1974): 238-44; Joe S. Foote and Michael E. Steele, "Degree of Conformity in Lead Stories in Early Evening Network TV Newscasts," Journalism Quarterly 63 (spring 1986): 19-23; Guido H. Stempel III, "Gatekeeping: The Mix of Topics and the Selection of Stories," Journalism Quarterly 62 (winter 1985): 791-96, 815; Guido H. Stempel III, "Topic and Story Choice of Five Network Newscasts," Journalism Quarterly 65 (autumn 1988): 750-52; Daniel Riffe, Brenda Ellis, Momo K. Rogers, Roger L. Van Ommeren, and Kieran A. Woodman, "Gatekeeping and the Network News Mix," Journalism Quarterly 63 (summer 1986): 315-21; and Ramaprasad, "Content, Geography, Concentration, and Consonance."
15. James B. Lemert, "Content Duplication by the Networks in Competing Evening Newscasts," Journalism Quarterly 51 (summer 1974): 238-44; Joe S. Foote and Michael E. Steele, "Degree of Conformity in Lead Stories in Early Evening Network TV Newscasts," Journalism Quarterly 63 (spring 1986): 19-23; Guido H. Stempel III, "Gatekeeping: The Mix of Topics and the Selection of Stories," Journalism Quarterly 62 (winter 1985): 791-96, 815; Guido H. Stempel III, "Topic and Story Choice of Five Network Newscasts," Journalism Quarterly 65 (autumn 1988): 750-52; Daniel Riffe, Brenda Ellis, Momo K. Rogers, Roger L. Van Ommeren, and Kieran A. Woodman, "Gatekeeping and the Network News Mix," Journalism Quarterly 63 (summer 1986): 315-21; and Ramaprasad, "Content, Geography, Concentration, and Consonance."
16. James B. Lemert, "Content Duplication by the Networks in Competing Evening Newscasts," Journalism Quarterly 51 (summer 1974): 238-44; Joe S. Foote and Michael E. Steele, "Degree of Conformity in Lead Stories in Early Evening Network TV Newscasts," Journalism Quarterly 63 (spring 1986): 19-23; Guido H. Stempel III, "Gatekeeping: The Mix of Topics and the Selection of Stories," Journalism Quarterly 62 (winter 1985): 791-96, 815; Guido H. Stempel III, "Topic and Story Choice of Five Network Newscasts," Journalism Quarterly 65 (autumn 1988): 750-52; Daniel Riffe, Brenda Ellis, Momo K. Rogers, Roger L. Van Ommeren, and Kieran A. Woodman, "Gatekeeping and the Network News Mix," Journalism Quarterly 63 (summer 1986): 315-21; and Ramaprasad, "Content, Geography, Concentration, and Consonance."
17. James B. Lemert, "Content Duplication by the Networks in Competing Evening Newscasts," Journalism Quarterly 51 (summer 1974): 238-44; Joe S. Foote and Michael E. Steele, "Degree of Conformity in Lead Stories in Early Evening Network TV Newscasts," Journalism Quarterly 63 (spring 1986): 19-23; Guido H. Stempel III, "Gatekeeping: The Mix of Topics and the Selection of Stories," Journalism Quarterly 62 (winter 1985): 791-96, 815; Guido H. Stempel III, "Topic and Story Choice of Five Network Newscasts," Journalism Quarterly 65 (autumn 1988): 750-52; Daniel Riffe, Brenda Ellis, Momo K. Rogers, Roger L. Van Ommeren, and Kieran A. Woodman, "Gatekeeping and the Network News Mix," Journalism Quarterly 63 (summer 1986): 315-21; and Ramaprasad, "Content, Geography, Concentration, and Consonance."
18. James B. Lemert, "Content Duplication by the Networks in Competing Evening Newscasts," Journalism Quarterly 51 (summer 1974): 238-44; Joe S. Foote and Michael E. Steele, "Degree of Conformity in Lead Stories in Early Evening Network TV Newscasts," Journalism Quarterly 63 (spring 1986): 19-23; Guido H. Stempel III, "Gatekeeping: The Mix of Topics and the Selection of Stories," Journalism Quarterly 62 (winter 1985): 791-96, 815; Guido H. Stempel III, "Topic and Story Choice of Five Network Newscasts," Journalism Quarterly 65 (autumn 1988): 750-52; Daniel Riffe, Brenda Ellis, Momo K. Rogers, Roger L. Van Ommeren, and Kieran A. Woodman, "Gatekeeping and the Network News Mix," Journalism Quarterly 63 (summer 1986): 315-21; and Ramaprasad, "Content, Geography, Concentration, and Consonance."
19. Lawrence W. Lichty and George A. Bailey, "Reading the Wind: Reflections on Content Analysis of Broadcast News," in Television Network News: Issues in Current Research, ed. William Adams and Fay Schreibman (Washington, DC: George Washington University, 1978), 111-37.
20. Presumably, the authors differentiate this technique from the frequently used convenience sample. Kolbe and Burnett found 81% of 103 ad content studies used convenience samples and 19% used probablity samples. However, Kolbe and Burnett's sample of 103 studies was itself a convenience sample. See Richard H. Kolbe and Melissa S. Burnett, "Content-Analysis Research: An Examination of Applications with Directives for Improving Research Reliability and Objectivity," Journal of Consumer Research 18 (September 1991): 243-50.
21. One Monday is selected randomly from all Mondays, one Tuesday from all Tuesdays, etc. Robert L. Jones and Roy E. Carter Jr., "Some Procedures for Estimating 'News Hole' in Content Analysis," Public Opinion Quarterly 23 (fall 1959): 399-403.
22. Roger D. Wimmer and Joseph R. Dominick, Mass Media Research: An Introduction, 3d ed. (Belmont, CA: Wadsworth, 1991), 163.
23. Daniel Riffe, Charles F. Aust, and Stephen Lacy, "The Effectiveness of Random, Consecutive Day and Constructed Week Sampling in Newspaper Content Analysis," Journalism Quarterly 70 (spring 1993): 133-39.
24. Alexander Mintz, "The Feasibility of the Use of Samples in Content Analysis," in Language of Politics, ed. Harold Lasswell, Nathan Leites, and associates (NY: George W. Stewart Publishers, Inc., 1949), 127-52.
25. Guido H. Stempel III, "Sample Size for Classifying Subject Matter in Dailies," Journalism Quarterly 29 (summer 1952): 333-34.
26. Stephen Lacy, Kay Robinson, and Daniel Riffe, "Sample Size in Content Analysis of Weekly Newspapers," Journalism Quarterly 75 (summer 1995): 336-45.
27. Lawrence W. Lichty and Douglas Gomery, "More is Less," in The Future of News, ed. Philip S. Cook, Douglas Gomery, and Lawrence W. Lichty (Baltimore: The Johns Hopkins University Press, 1992), 19.
28. Riffe et al., "Gatekeeping and the Network News Mix."
29. Ramaprasad, "Content, Geography, Concentration and Consonance."
30. Weaver, Porter, and Evans, "Patterns of Foreign News Coverage."
31. Gerald C. Stone and Elinor Grusin, "Network TV as the Bad News Bearer," Journalism Quarterly 61 (autumn 1984): 517-23, 592.
32. David K. Scott and Robert H. Gobetz, "Hard News/Soft News Content of the National Broadcast Networks, 1972-1987," Journalism Quarterly 69 (summer 1992): 406-12.
33. Both number of stories and seconds of time represent resources, but are in fact different ways of looking at resource allocation. And while they may be correlated, these two measures can provide different results when analyzed. See Abdulrahman H. Al-Enad, "Counting Items Versus Measuring Space in Content Analysis," Journalism Quarterly 68 (winter 1991): 657-62. Furthermore, this study's international stories and international seconds were correlated .65, and economic stories and economic seconds were correlated .70; both pairs of variables share less than 50% of variance.
34. Between spring 1990 and autumn 1994, 10 of 15 content analyses of network news in Journalism Quarterly used story count, 1 counted graphics used, and 6 counted seconds of airtime. Of 4 local content analyses, 3 used story count, and 3 counted seconds of airtime. Six of the 15 network analyses looked at international news and 5 at economic news; 2 of the local newscast studies looked at international and 1 at economic stories.
35. Lacy, Robinson, and Riffe in "Sample Size in Content Analysis of Weekly Newspapers" reported low coefficients of variability among weeklies.
36. The range of monthly means for total stories was 10.23-12 for ABC, and 7.95-11.05 for CBS. By contrast, the range of daily means for the same variable was 10.78-11.52 for ABC and 9.49-10.02 for CBS. Ranges for monthly total international stories were 3-5.05 for ABC and 2.48-4.35 for CBS, but daily total international stories were 3.72-4.65 on ABC and 3.13-3.45 for CBS. For total economic stories, monthly ranges were 1.24-3.86 on ABC and .67-1.83 for CBS; daily ranges were 1.5-1.92 for ABC and .86-1.27 for CBS. For total seconds of international news, monthly ranges were 248-668.64 for ABC and 172.38-627.83 for CBS; daily ranges were 377.36-461.15 for ABC and 314.72-352.16 for CBS. Finally, monthly ranges for total seconds of economic news were 70-371.36 for ABC and 79.09-203.91 for CBS, while daily ranges were 94.42-150.75 for ABC and 94.12-144.8 for CBS. The same pattern was found with the range of standard deviations.
37. Scott and Gobetz, "Hard News/Soft News."
38. Riffe, Aust, and Lacy, "The Effectiveness of Random, Consecutive Day and Constructed Week Sampling."
39. Lacy, Robinson, and Riffe, "Sample Size in Content Analysis of Weekly Newspapers."
40. In their studies, Riffe, Lacy, Aust, and Robinson used sets of only 20 samples per technique. The impact of a single sample failure would obviously be even greater. See Riffe, Aust, and Lacy, "The Effectiveness of Random, Consecutive Day and Constructed Week Sampling," and Lacy, Robinson, and Riffe, "Sample Size in Content Analysis of Weekly Newspapers."
41. In their studies, Riffe, Lacy, Aust, and Robinson used sets of only 20 samples per technique. The impact of a single sample failure would obviously be even greater. See Riffe, Aust, and Lacy, "The Effectiveness of Random, Consecutive Day and Constructed Week Sampling," and Lacy, Robinson, and Riffe, "Sample Size in Content Analysis of Weekly Newspapers."