Evaluating review content for book selection: An analysis of american history reviews in Choice, American Historical Review, and Journal of American History

College and Research Libraries

Volumn 58, Issue 4, 1997, Pages 323-336

  Natowitz, Allen ^a   Carlo, Paula Wheeler ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0031515484     PISSN: 00100870     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (54)

1. An overview of the literature prior to 1989 may be found in Virgil Blake, "The Role of Reviews and Reviewing Media in the Selection Process: An Examination of the Research Record," Collection Management 11, no. 1/2 (1989) 1-40. For more recent studies, see Dana Watson, "Reviewing: A Strategic Service," in A Service Profession, A Service Commitment: A Festschrift in Honor of Charles D. Patterson, eds. Connie Van Fleet and Danny P. Wallace (Metuchen, N.J.: Scarecrow Pr., 1992), 19-41; Judith Serebnick, "Selection and Holdings of Small Publishers' Books in OCLC Libraries: A Study of the Influence of Reviews, Publishers, and Vendors," Library Quarterly 62, no. 3 (July 1992): 259-94.
2. An overview of the literature prior to 1989 may be found in Virgil Blake, "The Role of Reviews and Reviewing Media in the Selection Process: An Examination of the Research Record," Collection Management 11, no. 1/2 (1989) 1-40. For more recent studies, see Dana Watson, "Reviewing: A Strategic Service," in A Service Profession, A Service Commitment: A Festschrift in Honor of Charles D. Patterson, eds. Connie Van Fleet and Danny P. Wallace (Metuchen, N.J.: Scarecrow Pr., 1992), 19-41; Judith Serebnick, "Selection and Holdings of Small Publishers' Books in OCLC Libraries: A Study of the Influence of Reviews, Publishers, and Vendors," Library Quarterly 62, no. 3 (July 1992): 259-94.
3. An overview of the literature prior to 1989 may be found in Virgil Blake, "The Role of Reviews and Reviewing Media in the Selection Process: An Examination of the Research Record," Collection Management 11, no. 1/2 (1989) 1-40. For more recent studies, see Dana Watson, "Reviewing: A Strategic Service," in A Service Profession, A Service Commitment: A Festschrift in Honor of Charles D. Patterson, eds. Connie Van Fleet and Danny P. Wallace (Metuchen, N.J.: Scarecrow Pr., 1992), 19-41; Judith Serebnick, "Selection and Holdings of Small Publishers' Books in OCLC Libraries: A Study of the Influence of Reviews, Publishers, and Vendors," Library Quarterly 62, no. 3 (July 1992): 259-94.
4. For example, Serebnick has maintained that research should examine how well reviews perform their role, in "Selection and Holdings," 291. Daniel Ream has argued that objective evaluation of book review journals has been relatively neglected in "An Evaluation of Four Book Review Journals," Research Quarterly 19 (winter 1979): 149.
5. For example, Serebnick has maintained that research should examine how well reviews perform their role, in "Selection and Holdings," 291. Daniel Ream has argued that objective evaluation of book review journals has been relatively neglected in "An Evaluation of Four Book Review Journals," Research Quarterly 19 (winter 1979): 149.
6. Terry Bilhartz, "In 500 Words or Less: Academic Book Reviewing in American History," History Teacher 17, no. 4 (Aug. 1984): 526-36.
7. James Benjamin Casey, "Assessment of Quality in Book Selection: An Evaluation of the Effectiveness of Opinions Rendered by Peer Reviews in American History Journals" (Ph.D. diss., Case Western Reserve University, May 22, 1985): 24.
8. Examples of such divergence may be found in William E. Snizek and E. R. Fuhrman, "Some Factors Affecting the Evaluative Content of Book Reviews in Sociology," American Sociologist 14 (May 1979): 108-14; Norval Glenn, "On the Misuse of Book Reviews," Contemporary Sociology 7, no. 3 (May 1978): 254; James H. Sweetland, "Reference Book Reviewing Tools: How Well Do They Do the Job?" Reference Librarian 15 (fall 1986): 65-74; James Rettig, "Reference Book Reviewing Media: A Critical Analysis," in Library Science Annual, vol. 2, ed. Bohdan S. Wynar (Littleton, Colo.: Libraries Unlimited, 1986); Duncan Lindsey, The Scientific Publication System in Social Science (San Francisco: Jossey-Bass, 1978); Joseph Palmer, "Agreement and Disagreement among Fiction Reviews in Library Journal, Booklist, and Publishers Weekly," Library Resources and Technical Services 39, no. 4 (Oct. 1995): 384-90.
9. Examples of such divergence may be found in William E. Snizek and E. R. Fuhrman, "Some Factors Affecting the Evaluative Content of Book Reviews in Sociology," American Sociologist 14 (May 1979): 108-14; Norval Glenn, "On the Misuse of Book Reviews," Contemporary Sociology 7, no. 3 (May 1978): 254; James H. Sweetland, "Reference Book Reviewing Tools: How Well Do They Do the Job?" Reference Librarian 15 (fall 1986): 65-74; James Rettig, "Reference Book Reviewing Media: A Critical Analysis," in Library Science Annual, vol. 2, ed. Bohdan S. Wynar (Littleton, Colo.: Libraries Unlimited, 1986); Duncan Lindsey, The Scientific Publication System in Social Science (San Francisco: Jossey-Bass, 1978); Joseph Palmer, "Agreement and Disagreement among Fiction Reviews in Library Journal, Booklist, and Publishers Weekly," Library Resources and Technical Services 39, no. 4 (Oct. 1995): 384-90.
10. Examples of such divergence may be found in William E. Snizek and E. R. Fuhrman, "Some Factors Affecting the Evaluative Content of Book Reviews in Sociology," American Sociologist 14 (May 1979): 108-14; Norval Glenn, "On the Misuse of Book Reviews," Contemporary Sociology 7, no. 3 (May 1978): 254; James H. Sweetland, "Reference Book Reviewing Tools: How Well Do They Do the Job?" Reference Librarian 15 (fall 1986): 65-74; James Rettig, "Reference Book Reviewing Media: A Critical Analysis," in Library Science Annual, vol. 2, ed. Bohdan S. Wynar (Littleton, Colo.: Libraries Unlimited, 1986); Duncan Lindsey, The Scientific Publication System in Social Science (San Francisco: Jossey-Bass, 1978); Joseph Palmer, "Agreement and Disagreement among Fiction Reviews in Library Journal, Booklist, and Publishers Weekly," Library Resources and Technical Services 39, no. 4 (Oct. 1995): 384-90.
11. Examples of such divergence may be found in William E. Snizek and E. R. Fuhrman, "Some Factors Affecting the Evaluative Content of Book Reviews in Sociology," American Sociologist 14 (May 1979): 108-14; Norval Glenn, "On the Misuse of Book Reviews," Contemporary Sociology 7, no. 3 (May 1978): 254; James H. Sweetland, "Reference Book Reviewing Tools: How Well Do They Do the Job?" Reference Librarian 15 (fall 1986): 65-74; James Rettig, "Reference Book Reviewing Media: A Critical Analysis," in Library Science Annual, vol. 2, ed. Bohdan S. Wynar (Littleton, Colo.: Libraries Unlimited, 1986); Duncan Lindsey, The Scientific Publication System in Social Science (San Francisco: Jossey-Bass, 1978); Joseph Palmer, "Agreement and Disagreement among Fiction Reviews in Library Journal, Booklist, and Publishers Weekly," Library Resources and Technical Services 39, no. 4 (Oct. 1995): 384-90.
12. Examples of such divergence may be found in William E. Snizek and E. R. Fuhrman, "Some Factors Affecting the Evaluative Content of Book Reviews in Sociology," American Sociologist 14 (May 1979): 108-14; Norval Glenn, "On the Misuse of Book Reviews," Contemporary Sociology 7, no. 3 (May 1978): 254; James H. Sweetland, "Reference Book Reviewing Tools: How Well Do They Do the Job?" Reference Librarian 15 (fall 1986): 65-74; James Rettig, "Reference Book Reviewing Media: A Critical Analysis," in Library Science Annual, vol. 2, ed. Bohdan S. Wynar (Littleton, Colo.: Libraries Unlimited, 1986); Duncan Lindsey, The Scientific Publication System in Social Science (San Francisco: Jossey-Bass, 1978); Joseph Palmer, "Agreement and Disagreement among Fiction Reviews in Library Journal, Booklist, and Publishers Weekly," Library Resources and Technical Services 39, no. 4 (Oct. 1995): 384-90.
13. Examples of such divergence may be found in William E. Snizek and E. R. Fuhrman, "Some Factors Affecting the Evaluative Content of Book Reviews in Sociology," American Sociologist 14 (May 1979): 108-14; Norval Glenn, "On the Misuse of Book Reviews," Contemporary Sociology 7, no. 3 (May 1978): 254; James H. Sweetland, "Reference Book Reviewing Tools: How Well Do They Do the Job?" Reference Librarian 15 (fall 1986): 65-74; James Rettig, "Reference Book Reviewing Media: A Critical Analysis," in Library Science Annual, vol. 2, ed. Bohdan S. Wynar (Littleton, Colo.: Libraries Unlimited, 1986); Duncan Lindsey, The Scientific Publication System in Social Science (San Francisco: Jossey-Bass, 1978); Joseph Palmer, "Agreement and Disagreement among Fiction Reviews in Library Journal, Booklist, and Publishers Weekly," Library Resources and Technical Services 39, no. 4 (Oct. 1995): 384-90.
14. Susan Fisher, "Book Reviews in Five Library Journals: A Comparative Analysis," Australian Library Journal 30, no. 1 (Aug. 1981): 96.
15. Bill Katz and Linda Sternberg Katz, Magazines for Libraries, 8th ed. (New Providence, N.J.: Bowker, 1995), 223.
16. Helen MacLam, "About Choice," Collection Management 16, no. 1 (1992): 73.
17. David Henige, "When Bad Is Good Enough: The Lowest Common Denominator in Reference Publishing and Reviewing," Reference Services Review 19, no. 1 (1991): 13; Katz and Katz, Magazines for Libraries, 223.
18. David Henige, "When Bad Is Good Enough: The Lowest Common Denominator in Reference Publishing and Reviewing," Reference Services Review 19, no. 1 (1991): 13; Katz and Katz, Magazines for Libraries, 223.
19. "About Choice" (internal document).
20. "Good Books and Gatekeepers," Choice 32, no. 7 (Mar. 1995): 1024.
21. Marvin D. Leavy, "An Exploration of the Validity of Choice's 'Outstanding Academic Books,'" Journal of Academic Librarianship 18, no. 2 (May 1992): 83. The estimate of 28 to 29 percent is as of June 1994. This information was provided by Helen MacLam, Social Sciences Editor at Choice.
22. Marvin D. Leavy, "An Exploration of the Validity of Choice's 'Outstanding Academic Books,'" Journal of Academic Librarianship 18, no. 2 (May 1992): 83. The estimate of 28 to 29 percent is as of June 1994. This information was provided by Helen MacLam, Social Sciences Editor at Choice.
23. Ulrich's International Periodical Directory 1996, 34th ed. (New Providence, R.I.: Bowker, 1996): 3151.
24. Katz and Katz, Magazines for Libraries, 657.
25. William Bishel, "Book Reviewing and Scholarly Communication: The View from the American Historical Review" (paper presented at the annual meeting of the American Historical Association, Jan. 1994).
26. Ibid.
27. Ibid.
28. "Guidelines for Reviewers," distributed to their reviewers by American Historical Review.
29. Katz and Katz, Magazines for Libraries, 664.
30. Ibid.
31. Steven Stowe, "Thinking about Reviews," Journal of American History 78, no. 2 (Sept. 1991): 593; Casey Blake, "Book Reviewing and Scholarly Communication" (paper presented at the annual meeting of the American Historical Association, Jan. 1994).
32. Steven Stowe, "Thinking about Reviews," Journal of American History 78, no. 2 (Sept. 1991): 593; Casey Blake, "Book Reviewing and Scholarly Communication" (paper presented at the annual meeting of the American Historical Association, Jan. 1994).
33. Klaus Krippendorff, "Content Analysis," in International Encyclopedia of Communications, vol. 1 (New York: Oxford Univ. Pr., 1989), 403.
34. Bryce Allen and David Reser, "Content Analysis in Library and Information Science Research," Library and Information Science Research 12, no. 3 (July-Sept. 1990): 260.
35. Examples of the use of content analysis may be found in Dean J. Champion and Michael F. Morris, "A Content Analysis of Book Reviews in the AJS, ASR, and Social Forces," American Journal of Sociology 78, no. 5 (Mar. 1993): 1256-65; Judith Fox, "Choice As a Book Selection Tool in Sociology: A Comparison with Contemporary Sociology," Collection Management 13, no. 1/2 (1990): 135-52; Beth Macleod, "Library Journal and Choice: A Review of Reviews," Journal of Academic Librarianship 7, no. 1 (Mar. 1981): 23-28; Alexandra Dimitroff, "Research for Special Libraries: A Quantitative Analysis of the Literature," Special Libraries 86, no. 4 (fall 1995): 256-64; Anne Bridges, "Scholarly Book Reviews and Collection Development: A Case Study in American History," Journal of Academic Librarianship 15, no. 5 (Nov. 1989): 290-93; Bilhartz, "In 500 Words or Less"; Paula Wheeler Carlo and Allen Natowitz, "The Appearance of Praise in Choice Reviews of Outstanding and Favorably Assessed Books in American History, Geography, and Area Studies," Collection Management 20, no. 3/4 (1996): 97-117.
36. Examples of the use of content analysis may be found in Dean J. Champion and Michael F. Morris, "A Content Analysis of Book Reviews in the AJS, ASR, and Social Forces," American Journal of Sociology 78, no. 5 (Mar. 1993): 1256-65; Judith Fox, "Choice As a Book Selection Tool in Sociology: A Comparison with Contemporary Sociology," Collection Management 13, no. 1/2 (1990): 135-52; Beth Macleod, "Library Journal and Choice: A Review of Reviews," Journal of Academic Librarianship 7, no. 1 (Mar. 1981): 23-28; Alexandra Dimitroff, "Research for Special Libraries: A Quantitative Analysis of the Literature," Special Libraries 86, no. 4 (fall 1995): 256-64; Anne Bridges, "Scholarly Book Reviews and Collection Development: A Case Study in American History," Journal of Academic Librarianship 15, no. 5 (Nov. 1989): 290-93; Bilhartz, "In 500 Words or Less"; Paula Wheeler Carlo and Allen Natowitz, "The Appearance of Praise in Choice Reviews of Outstanding and Favorably Assessed Books in American History, Geography, and Area Studies," Collection Management 20, no. 3/4 (1996): 97-117.
37. Examples of the use of content analysis may be found in Dean J. Champion and Michael F. Morris, "A Content Analysis of Book Reviews in the AJS, ASR, and Social Forces," American Journal of Sociology 78, no. 5 (Mar. 1993): 1256-65; Judith Fox, "Choice As a Book Selection Tool in Sociology: A Comparison with Contemporary Sociology," Collection Management 13, no. 1/2 (1990): 135-52; Beth Macleod, "Library Journal and Choice: A Review of Reviews," Journal of Academic Librarianship 7, no. 1 (Mar. 1981): 23-28; Alexandra Dimitroff, "Research for Special Libraries: A Quantitative Analysis of the Literature," Special Libraries 86, no. 4 (fall 1995): 256-64; Anne Bridges, "Scholarly Book Reviews and Collection Development: A Case Study in American History," Journal of Academic Librarianship 15, no. 5 (Nov. 1989): 290-93; Bilhartz, "In 500 Words or Less"; Paula Wheeler Carlo and Allen Natowitz, "The Appearance of Praise in Choice Reviews of Outstanding and Favorably Assessed Books in American History, Geography, and Area Studies," Collection Management 20, no. 3/4 (1996): 97-117.
38. Examples of the use of content analysis may be found in Dean J. Champion and Michael F. Morris, "A Content Analysis of Book Reviews in the AJS, ASR, and Social Forces," American Journal of Sociology 78, no. 5 (Mar. 1993): 1256-65; Judith Fox, "Choice As a Book Selection Tool in Sociology: A Comparison with Contemporary Sociology," Collection Management 13, no. 1/2 (1990): 135-52; Beth Macleod, "Library Journal and Choice: A Review of Reviews," Journal of Academic Librarianship 7, no. 1 (Mar. 1981): 23-28; Alexandra Dimitroff, "Research for Special Libraries: A Quantitative Analysis of the Literature," Special Libraries 86, no. 4 (fall 1995): 256-64; Anne Bridges, "Scholarly Book Reviews and Collection Development: A Case Study in American History," Journal of Academic Librarianship 15, no. 5 (Nov. 1989): 290-93; Bilhartz, "In 500 Words or Less"; Paula Wheeler Carlo and Allen Natowitz, "The Appearance of Praise in Choice Reviews of Outstanding and Favorably Assessed Books in American History, Geography, and Area Studies," Collection Management 20, no. 3/4 (1996): 97-117.
39. Examples of the use of content analysis may be found in Dean J. Champion and Michael F. Morris, "A Content Analysis of Book Reviews in the AJS, ASR, and Social Forces," American Journal of Sociology 78, no. 5 (Mar. 1993): 1256-65; Judith Fox, "Choice As a Book Selection Tool in Sociology: A Comparison with Contemporary Sociology," Collection Management 13, no. 1/2 (1990): 135-52; Beth Macleod, "Library Journal and Choice: A Review of Reviews," Journal of Academic Librarianship 7, no. 1 (Mar. 1981): 23-28; Alexandra Dimitroff, "Research for Special Libraries: A Quantitative Analysis of the Literature," Special Libraries 86, no. 4 (fall 1995): 256-64; Anne Bridges, "Scholarly Book Reviews and Collection Development: A Case Study in American History," Journal of Academic Librarianship 15, no. 5 (Nov. 1989): 290-93; Bilhartz, "In 500 Words or Less"; Paula Wheeler Carlo and Allen Natowitz, "The Appearance of Praise in Choice Reviews of Outstanding and Favorably Assessed Books in American History, Geography, and Area Studies," Collection Management 20, no. 3/4 (1996): 97-117.
40. Examples of the use of content analysis may be found in Dean J. Champion and Michael F. Morris, "A Content Analysis of Book Reviews in the AJS, ASR, and Social Forces," American Journal of Sociology 78, no. 5 (Mar. 1993): 1256-65; Judith Fox, "Choice As a Book Selection Tool in Sociology: A Comparison with Contemporary Sociology," Collection Management 13, no. 1/2 (1990): 135-52; Beth Macleod, "Library Journal and Choice: A Review of Reviews," Journal of Academic Librarianship 7, no. 1 (Mar. 1981): 23-28; Alexandra Dimitroff, "Research for Special Libraries: A Quantitative Analysis of the Literature," Special Libraries 86, no. 4 (fall 1995): 256-64; Anne Bridges, "Scholarly Book Reviews and Collection Development: A Case Study in American History," Journal of Academic Librarianship 15, no. 5 (Nov. 1989): 290-93; Bilhartz, "In 500 Words or Less"; Paula Wheeler Carlo and Allen Natowitz, "The Appearance of Praise in Choice Reviews of Outstanding and Favorably Assessed Books in American History, Geography, and Area Studies," Collection Management 20, no. 3/4 (1996): 97-117.
41. Examples of the use of content analysis may be found in Dean J. Champion and Michael F. Morris, "A Content Analysis of Book Reviews in the AJS, ASR, and Social Forces," American Journal of Sociology 78, no. 5 (Mar. 1993): 1256-65; Judith Fox, "Choice As a Book Selection Tool in Sociology: A Comparison with Contemporary Sociology," Collection Management 13, no. 1/2 (1990): 135-52; Beth Macleod, "Library Journal and Choice: A Review of Reviews," Journal of Academic Librarianship 7, no. 1 (Mar. 1981): 23-28; Alexandra Dimitroff, "Research for Special Libraries: A Quantitative Analysis of the Literature," Special Libraries 86, no. 4 (fall 1995): 256-64; Anne Bridges, "Scholarly Book Reviews and Collection Development: A Case Study in American History," Journal of Academic Librarianship 15, no. 5 (Nov. 1989): 290-93; Bilhartz, "In 500 Words or Less"; Paula Wheeler Carlo and Allen Natowitz, "The Appearance of Praise in Choice Reviews of Outstanding and Favorably Assessed Books in American History, Geography, and Area Studies," Collection Management 20, no. 3/4 (1996): 97-117.
42. Charles Busha and Stephen Harter, Research Methods in Librarianship Techniques and Interpretation (New York: Academic Pr., 1980), 174.
43. Classic studies include Richard Budd, Robert Thorp, and Lewis Donohew, Content Analysis of Communications (New York: Macmillan, 1967); Ole R. Holsti, Content Analysis for the Social Sciences and Humanities (Reading, Mass.: Addison-Wesley, 1969); Klaus Krippendorff, Content Analysis: An Introduction to Its Methodology (Beverly Hills, Calif.: Sage, 1980).
44. Classic studies include Richard Budd, Robert Thorp, and Lewis Donohew, Content Analysis of Communications (New York: Macmillan, 1967); Ole R. Holsti, Content Analysis for the Social Sciences and Humanities (Reading, Mass.: Addison-Wesley, 1969); Klaus Krippendorff, Content Analysis: An Introduction to Its Methodology (Beverly Hills, Calif.: Sage, 1980).
45. Classic studies include Richard Budd, Robert Thorp, and Lewis Donohew, Content Analysis of Communications (New York: Macmillan, 1967); Ole R. Holsti, Content Analysis for the Social Sciences and Humanities (Reading, Mass.: Addison-Wesley, 1969); Klaus Krippendorff, Content Analysis: An Introduction to Its Methodology (Beverly Hills, Calif.: Sage, 1980).
46. Budd, Thorp, and Donohew, Content Analysis of Communications, 6.
47. Bilhartz, "In 500 Words or Less"; Macleod, "Library Journal and Choice."
48. Bilhartz, "In 500 Words or Less"; Macleod, "Library Journal and Choice."
49. A similar system of rating was used by Bilhartz, "In 500 Words or Less." As a basis for their study, Greene and Spornick used the rating system that appears in Periodical Abstracts on Disc, Research II Edition [computer database] (Ann Arbor, Mich.: UMI, 1994). Robert J. Greene and Charles D. Spornick, "Favorable and Unfavorable Book Reviews: A Quantitative Study," Journal of Academic Librarianship 21, no. 6 (Nov. 1995): 449-53.
50. A similar system of rating was used by Bilhartz, "In 500 Words or Less." As a basis for their study, Greene and Spornick used the rating system that appears in Periodical Abstracts on Disc, Research II Edition [computer database] (Ann Arbor, Mich.: UMI, 1994). Robert J. Greene and Charles D. Spornick, "Favorable and Unfavorable Book Reviews: A Quantitative Study," Journal of Academic Librarianship 21, no. 6 (Nov. 1995): 449-53.
51. A similar system of rating was used by Bilhartz, "In 500 Words or Less." As a basis for their study, Greene and Spornick used the rating system that appears in Periodical Abstracts on Disc, Research II Edition [computer database] (Ann Arbor, Mich.: UMI, 1994). Robert J. Greene and Charles D. Spornick, "Favorable and Unfavorable Book Reviews: A Quantitative Study," Journal of Academic Librarianship 21, no. 6 (Nov. 1995): 449-53.
52. The average number of evaluative elements for each of the journals is the quotient of the total number of evaluative elements and the number of reviews. Choice 381/153 = 2.49 JAH 467/153 = 3.05 AHR 509/153 = 3.33
53. Ream calculated the mean time lag of Choice reviews to be about four months (127.7 days) after a book was published. Based on Ream's calculation, JAH reviews appear, on average, 12.5 months after a book is published, whereas AHR reviews appear approximately 14.6 months after a book is published.
54. Data are on file. Inquiries may be addressed to either of the authors.