Peer review of datasets: When, why, and how

Bulletin of the American Meteorological Society

Volumn 96, Issue 2, 2015, Pages 191-201

  Mayernik, Matthew S ^a   Callaghan, Sarah ^b   Leigh, Roland ^c   Tedds, Jonathan ^c   Worley, Steven ^a  

^a NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^b RUTHERFORD APPLETON LABORATORY   (United Kingdom)

^c UNIVERSITY OF LEICESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EARTH ATMOSPHERE; METEOROLOGY;

ACADEMIC COMMUNITY; DATA REPOSITORIES; PEER-REVIEW PROCESS; PUBLISHING SYSTEMS; RESEARCH QUALITY; SCIENTIFIC ARTICLES; SCIENTIFIC COMMUNICATION; SCIENTIFIC JOURNALS;

REVIEWS;

EID: 84929464944     PISSN: 00030007     EISSN: 15200477     Source Type: Journal    
DOI: 10.1175/BAMS-D-13-00083.1     Document Type: Article

References (49)

1. AMS, cited 2013: Full and open access to data: A policy statement of the American Meteorological Society. American Meteorological Society. [Available online at www.ametsoc.org/policy/2013fullopenaccessdata-amsstatement.html.]
2. -, cited 2014a: Reviewer guidelines for AMS journals. American Meteorological Society. [Available online at http://www2.ametsoc.org/ams/index.cfm/publications/editors-and-reviewers/reviewer-guidelines-for-ams-journals/.]
3. -, cited 2014b: Reviewer guidelines for the Bulletin of the American Meteorological Society (BAMS). American Meteorological Society. [Available online at http://www2.ametsoc.org/ams/index.cfm/publications/editors-and-reviewers/reviewer-guidelines-bulletin-for-bams/.]
4. Baldocchi, D., and Coauthors, 2001: FLUXNET: A new tool to study the temporal and spatial variability of ecosystem-scale carbon dioxide, water vapor, and energy f lux densities. Bull. Amer. Meteor. Soc., 82, 2415-2434, doi:10.1175/1520-0477(2001)082〈2415:FANTTS〉2.3.CO;2.
5. Borgman, C. L., 2007: Scholarship in the Digital Age: Information, Infrastructure, and the Internet. MIT Press, 336 pp.
6. Callaghan, S., 2015: Data without peer: Examples of data peer review in the Earth sciences. D-Lib Mag., 21, doi:10.1045/january2015-callaghan.
7. -, R. Lowry, and D. Walton, 2012: Data citation and publication by NERC's Environmental Data Centres. Ariadne, 68. [Available online at www.ariadne.ac.uk/issue68/callaghan-et-al.]
8. -, F. Murphy, J. Tedds, R. Allan, J. Kunze, R. Lawrence, M. S. Mayernik, and A. Whyte, 2013: Processes and procedures for data publication: A case study in the geosciences. Int. J. Digital Curation, 8, 193-203, doi:10.2218/ijdc.v8i1.253.
9. Costello, M. J., W. K. Michener, M. Gahegan, Z.-Q. Zhang, and P. E. Bourne, 2013: Biodiversity data should be published, cited, and peer reviewed. Trends Ecol. Evol., 28, 454-461, doi:10.1016/j.tree.2013.05.002.
10. FORCE11 Data Citation Synthesis Group, cited 2013: Joint declaration of data citation principles - Final. [Available online at www.force11.org/datacitation.]
11. Gates, W. L., 1992: AMIP: The Atmospheric Model Intercomparison Project. Bull. Amer. Meteor. Soc., 73, 1962-1970, doi:10.1175/1520-0477(1992)073〈1962:ATAMIP〉2.0.CO;2.
12. Golden, M., and D. M. Schultz, 2012: Quantifying the volunteer effort of scientific peer reviewing. Bull. Amer. Meteor. Soc., 93, 337-345, doi:10.1175/BAMS-D-11-00129.1.
13. Hess, M., P. Koepke, and I. Schult, 1998: Optical properties of aerosols and clouds: The software package OPAC. Bull. Amer. Meteor. Soc., 79, 831-844, doi:10.1175/1520-0477(1998)079〈0831:OPOAAC〉2.0.CO;2.
14. Huffman, G. J., and Coauthors, 1997: The Global Precipitation Climatology Project (GPCP) Combined Precipitation Dataset. Bull. Amer. Meteor. Soc., 78, 5-20, doi:10.1175/1520-0477(1997)078〈0005:TGPCPG〉2.0.CO;2.
15. Hunter, J., 2012: Post-publication peer review: Opening up scientific conversation. Front. Comput. Neurosci., 6, 63, doi:10.3389/fncom.2012.00063.
16. Kalnay, E., and Coauthors, 1996: The NCEP/NCAR 40-Year Reanalysis Project. Bull. Amer. Meteor. Soc., 77, 437-471, doi:10.1175/1520-0477(1996)077〈0437:TNYRP〉2.0.CO;2.
17. Kanamitsu, M., W. Ebisuzaki, J. Woollen, S.-K. Yang, J. J. Hnilo, M. Fiorino, and G. L. Potter, 2002: NCEP-DOE AMIP-II Reanalysis (R-2). Bull. Amer. Meteor. Soc., 83, 1631-1643, doi:10.1175/BAMS-83-11-1631.
18. Kistler, R., and Coauthors, 2001: The NCEP-NCAR 50-Year Reanalysis: Monthly means CD-ROM and documentation. Bull. Amer. Meteor. Soc., 82, 247-267, doi:10.1175/1520-0477(2001)082〈0247:TNNYRM〉2.3.CO;2.
19. Kriegeskorte, N., A. Walther, and D. Deca, 2012: An emerging consensus for open evaluation: 18 visions for the future of scientific publishing. Front. Comput. Neurosci., 6, 94, doi:10.3389/fncom.2012.00094.
20. Large, W. G., and S. G. Yeager, 2009: The global climatology of an interannually varying air-sea flux data set. Climate Dyn., 33, 341-364, doi:10.1007/s00382-008-0441-3.
21. Lawrence, B., C. Jones, B. Matthews, S. Pepler, and S. Callaghan, 2011: Citation and peer review of data: Moving towards formal data publication. Int. J. Digital Curation, 6, 4-37, doi:10.2218/ijdc.v6i2.205.
22. Lee, C. J., C. R. Sugimoto, G. Zhang, and B. Cronin, 2013: Bias in peer review. J. Amer. Soc. Inf. Sci. Technol., 64, 2-17, doi:10.1002/asi.22784.
23. th Conf. on Broadcast Meteorology, Miami, FL, Amer. Meteor. Soc., 4.4. [Available online at http://ams.confex.com/ams/pdfpapers/171923.pdf.]
24. Liebmann, B., and C. A. Smith, 1996: Description of a complete (interpolated) outgoing longwave radiation dataset. Bull. Amer. Meteor. Soc., 77, 1275-1277.
25. Mantua, N. J., S. R. Hare, Y. Zhang, J. M. Wallace, and R. C. Francis, 1997: A Pacific interdecadal climate oscillation with impacts on salmon production. Bull. Amer. Meteor. Soc., 78, 1069-1079, doi:10.1175/1520-0477(1997)078〈1069:APICOW〉2.0.CO;2.
26. Mayernik, M. S., 2013: Bridging data lifecycles: Tracking data use via data citations workshop report. NCAR Tech. Note NCAR/TN-494+PROC, 32 pp., doi:10.5065/D6PZ56TX.
27. Meehl, G. A., C. Covey, K. E. Taylor, T. Delworth, R. J. Stouffer, M. Latif, B. McAvaney, and J. F. B. Mitchell, 2007: THE WCRP CMIP3 multimodel dataset: A new era in climate change research. Bull. Amer. Meteor. Soc., 88, 1383-1394, doi:10.1175/BAMS-88-9-1383.
28. Mesinger, F., and Coauthors, 2006: North American Regional Reanalysis. Bull. Amer. Meteor. Soc., 87, 343-360, doi:10.1175/BAMS-87-3-343.
29. Miller, G., and J. Couzin, 2007: Peer review under stress. Science, 316, 358-359, doi:10.1126/science.316.5823.358.
30. Nicholas, K. A., and W. Gordon, 2011: A quick guide to writing a solid peer review. Eos, Trans. Amer. Geophys. Union, 92, 233-240, doi:10.1029/2011EO280001.
31. Overpeck, J. T., G. A. Meehl, S. Bony, and D. R. Easterling, 2011: Climate data challenges in the 21st century. Science, 331, 700-702, doi:10.1126/science.1197869.
32. Pampel, H., H. Pfeiffenberger, A. Schäfer, E. Smit, S. Pröll, and C. Bruch, 2012: Report on peer review of research data in scholarly communication. Alliance for Permanent Access to the Records of Science in Europe Network, 41 pp. [Available online at http://epic.awi.de/30353/1/APARSEN-DEL-D33-1A-01-1-0.pdf.]
33. Parsons, M. A., and P. Fox, 2013: Is data publication the right metaphor? Data Sci. J., 12, WDS32-WDS46, doi:10.2481/dsj.WDS-042.
34. -, R. Duerr, and J.-B. Minster, 2010: Data citation and peer review. Eos, Trans. Amer. Geophys. Union, 91, 297-298, doi:10.1029/2010EO340001.
35. Rossow, W. B., and R. A. Schiffer, 1991: ISCCP cloud data products. Bull. Amer. Meteor. Soc., 72, 2-20, doi:10.1175/1520-0477(1991)072〈0002:ICDP〉2.0.CO;2.
36. -, and -, 1999: Advances in understanding clouds from ISCCP. Bull. Amer. Meteor. Soc., 80, 2261-2287, doi:10.1175/1520-0477(1999)080〈2261:AIUCFI〉2.0.CO;2.
37. Schneider, D. P., C. Deser, J. Fasullo, and K. Trenberth, 2013: Climate data guide spurs discovery and understanding. Eos, Trans. Amer. Geophys. Union, 94, 121-122, doi:10.1002/2013EO130001.
38. Socha, Y. M., and Coauthors, 2013: Out of cite, out of mind: The current state of practice, policy, and technology for the citation of data. Data Sci. J., 12, CIDCR1-CIDCR75, doi:10.2481/dsj.OSOM13-043.
39. Stephens, G. L., and Coauthors, 2002: The CloudSat mission and the A-Train. Bull. Amer. Meteor. Soc., 83, 1771-1790, doi:10.1175/BAMS-83-12-1771.
40. Torrence, C., and G. P. Compo, 1998: A practical guide to wavelet analysis. Bull. Amer. Meteor. Soc., 79, 61-78, doi:10.1175/1520-0477(1998)079〈0061:APGTWA〉2.0.CO;2.
41. Trenberth, K. E., 1990: Recent observed interdecadal climate changes in the Northern Hemisphere. Bull. Amer. Meteor. Soc., 71, 988-993, doi:10.1175/1520-0477(1990)071〈0988:ROICCI〉2.0.CO;2.
42. -, 1997: The definition of El Niño. Bull. Amer. Meteor. Soc., 78, 2771-2777, doi:10.1175/1520-0477(1997)078〈2771:TDOENO〉2.0.CO;2.
43. Wang, A., and X. Zeng, 2013: Development of global hourly 0.5-degree land surface air temperature datasets. J. Climate, 26, 7676-7691, doi:10.1175/JCLI-D-12-00682.1.
44. -, and -, cited 2014: Global hourly 0.5-degree land surface air temperature datasets. Research Data Archive at the National Center for Atmospheric Research, Computational and Information Systems Laboratory, doi:10.5065/D6PR7SZF.
45. Weller, A. C., 2001: Editorial Peer Review: Its Strengths and Weaknesses. ASIS&T Monograph Series, Information Today, 342 pp.
46. Willmott, C. J., 1982: Some comments on the evaluation of model performance. Bull. Amer. Meteor. Soc., 63, 1309-1313, doi:10.1175/1520-0477(1982)063〈1309:SCOTEO〉2.0.CO;2.
47. Woodruff, S. D., R. L. Slutz, R. L. Jenne, and P. M. Steurer, 1987: A Comprehensive Ocean-Atmosphere Data Set. Bull. Amer. Meteor. Soc., 68, 1239-1250, doi:10.1175/1520-0477(1987)068〈1239:ACOADS〉2.0.CO;2.
48. Xie, P., and P. A. Arkin, 1997: Global precipitation: A 17-year monthly analysis based on gauge observations, satellite estimates, and numerical model outputs. Bull. Amer. Meteor. Soc., 78, 2539-2558, doi:10.1175/1520-0477(1997)078〈2539:GPAYMA〉2.0.CO;2.
49. Yeager, S. G., and W. G. Large, cited 2008: CORE.2 global air-sea flux dataset. Research Data Archive at the National Center for Atmospheric Research, Computational and Information Systems Laboratory, doi:10.5065/D6WH2N0S.