Principles and approaches for reproducible scoring of tissue stains in research

Laboratory Investigation

Volumn 98, Issue 7, 2018, Pages 844-855

  Meyerholz, David K ^a   Beck, Amanda P ^b  

^a UNIVERSITY OF IOWA   (United States)

^b ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

THROMBOPLASTIN; COLORING AGENT;

CLINICAL RESEARCH; IMMUNOHISTOCHEMISTRY; INCIDENCE; PRIORITY JOURNAL; QUALITATIVE RESEARCH; QUANTITATIVE STUDY; REVIEW; STAINING; HUMAN; PROCEDURES; REPRODUCIBILITY; SPECIMEN HANDLING; STANDARDS;

COLORING AGENTS; HUMANS; IMMUNOHISTOCHEMISTRY; REPRODUCIBILITY OF RESULTS; SPECIMEN HANDLING; STAINING AND LABELING;

EID: 85047822606     PISSN: 00236837     EISSN: 15300307     Source Type: Journal    
DOI: 10.1038/s41374-018-0057-0     Document Type: Review

References (97)

1. Adissu HA, Estabel J, Sunter D, et al. Histopathology reveals correlative and unique phenotypes in a high-throughput mouse phenotyping screen. Dis Model Mech. 2014;7:515–24
2. Choudhury KR, Yagle KJ, Swanson PE, et al. A robust automated measure of average antibody staining in immunohistochemistry images. J Histochem Cytochem. 2010;58:95–107
3. Cregger M, Berger AJ, Rimm DL. Immunohistochemistry and quantitative analysis of protein expression. Arch Pathol Lab Med. 2006;130:1026–30
4. Ladiges W, Ikeno Y, Liggitt D, et al. Pathology is a critical aspect of preclinical aging studies. Pathobiol Aging Age Relat Dis. 2013;3. 10.3402/pba.v3i0.22451
5. Nielsen S. External quality assessment for immunohistochemistry: experiences from NordiQC. Biotech Histochem. 2015;90:331–40
6. Liu WL, Wang LW, Chen JM, et al. Application of multispectral imaging in quantitative immunohistochemistry study of breast cancer: a comparative study. Tumour Biol. 2016;37:5013–24
7. Okoye JO, Nnatuanya IN. Immunohistochemistry: a revolutionary technique in laboratory medicine. Clin Med Diagn. 2015;5:60–9
8. Prasad K, Prabhu GK. Image analysis tools for evaluation of microscopic views of immunohistochemically stained specimen in medical research-a review. J Med Syst. 2012;36:2621–31
9. Rojo MG, Bueno G, Slodkowska J. Review of imaging solutions for integrated quantitative immunohistochemistry in the pathology daily practice. Folia Histochem Cytobiol. 2009;47:349–54
10. Rudbeck L. Adding quality to your qualitative IHC. MLO Med Lab Obs. 2015;47:21
11. Varghese F, Bukhari AB, Malhotra R, et al. IHC Profiler: an open source plugin for the quantitative evaluation and automated scoring of immunohistochemistry images of human tissue samples. PLoS ONE. 2014;9:e96801
12. Lin F, Chen Z. Standardization of diagnostic immunohistochemistry: literature review and geisinger experience. Arch Pathol Lab Med. 2014;138:1564–77
13. Scudamore CL. Practical approaches to reviewing and recording pathology data. A practical guide to the histology of the mouse. John Wiley & Sons, Ltd; Chennai, India, 2014. p. 25–41
14. Taylor CR, Levenson RM. Quantification of immunohistochemistry—issues concerning methods, utility and semiquantitative assessment II. Histopathology. 2006;49:411–24
15. Axelrod DE, Miller N, Chapman JA. Avoiding pitfalls in the statistical analysis of heterogeneous tumors. Biomed Inform Insights. 2009;2:11–8
16. Dunstan RW, Wharton KA Jr, Quigley C, et al. The use of immunohistochemistry for biomarker assessment--can it compete with other technologies? Toxicol Pathol. 2011;39:988–1002
17. Eaton KA, Danon SJ, Krakowka S, et al. A reproducible scoring system for quantification of histologic lesions of inflammatory disease in mouse gastric epithelium. Comp Med. 2007;57:57–65
18. Engel KB, Moore HM. Effects of preanalytical variables on the detection of proteins by immunohistochemistry in formalin-fixed, paraffin-embedded tissue. Arch Pathol Lab Med. 2011;135:537–43
19. Gibson-Corley KN, Olivier AK, Meyerholz DK. Principles for valid histopathologic scoring in research. Vet Pathol. 2013;50:1007–15
20. Kraus JA, Dabbs DJ, Beriwal S, et al. Semi-quantitative immunohistochemical assay versus oncotype DX((R)) qRT-PCR assay for estrogen and progesterone receptors: an independent quality assurance study. Mod Pathol. 2012;25:869–76
21. Olivier AK, Naumann P, Goeken A, et al. Genetically modified species in research: opportunities and challenges for the histology core laboratory. J Histotechnol. 2012;35:63–7
22. Rizzardi AE, Johnson AT, Vogel RI, et al. Quantitative comparison of immunohistochemical staining measured by digital image analysis versus pathologist visual scoring. Diagn Pathol. 2012;7:42
23. Shackelford C, Long G, Wolf J, et al. Qualitative and quantitative analysis of nonneoplastic lesions in toxicology studies. Toxicol Pathol. 2002;30:93–6
24. van Diest PJ, van Dam P, Henzen-Logmans SC, et al. A scoring system for immunohistochemical staining: consensus report of the task force for basic research of the EORTC-GCCG. European Organization for Research and Treatment of Cancer-Gynaecological Cancer Cooperative Group. J Clin Pathol. 1997;50:801–4
25. Walker RA. Quantification of immunohistochemistry—issues concerning methods, utility and semiquantitative assessment I. Histopathology. 2006;49:406–10
26. Scudamore CL, Soilleux EJ, Karp NA, et al. Recommendations for minimum information for publication of experimental pathology data: MINPEPA guidelines. J Pathol. 2016;238:359–67
27. Lin PL, Rodgers M, Smith L, et al. Quantitative comparison of active and latent tuberculosis in the Cynomolgus Macaque model. Infect Immun. 2009;77:4631–42
28. Scudamore CL. Integrating pathology into human disease modelling—how to eat the elephant. Dis Model Mech. 2014;7:495–7
29. Dettmeyer RB. Forensic histopathology: fundementals and perspectives. New York: Springer; 2011
30. Williams JM, Duckworth CA, Burkitt MD, et al. Epithelial cell shedding and barrier function: a matter of life and death at the small intestinal villus tip. Vet Pathol. 2015;52:445–55
31. Ramos-Vara JA, Webster JD, DuSold D, et al. Immunohistochemical evaluation of the effects of paraffin section storage on biomarker stability. Vet Pathol. 2014;51:102–9
32. Grillo F, Pigozzi S, Ceriolo P, et al. Factors affecting immunoreactivity in long-term storage of formalin-fixed paraffin-embedded tissue sections. Histochem Cell Biol. 2015;144:93–9
33. Economou M, Schoni L, Hammer C, et al. Proper paraffin slide storage is crucial for translational research projects involving immunohistochemistry stains. Clin Transl Med. 2014;3:4
34. Cheung CC, Banerjee D, Barnes PJ, et al. Canadian Association of Pathologists-Association canadienne des pathologistes National Standards Committee for High Complexity Testing/Immunohistochemistry: guidelines for the preparation, release, and storage of unstained archived diagnostic tissue sections for immunohistochemistry. Am J Clin Pathol. 2014;142:629–33
35. Xie R, Chung JY, Ylaya K, et al. Factors influencing the degradation of archival formalin-fixed paraffin-embedded tissue sections. J Histochem Cytochem. 2011;59:356–65
36. Torlakovic EE, Nielsen S, Vyberg M, et al. Getting controls under control: the time is now for immunohistochemistry. J Clin Pathol. 2015;68:879–82
37. Leach MW, Halpern WG, Johnson CW, et al. Use of tissue cross-reactivity studies in the development of antibody-based biopharmaceuticals: history, experience, methodology, and future directions. Toxicol Pathol. 2010;38:1138–66
38. Schonbrunn A. Editorial: antibody can get it right: confronting problems of antibody specificity and irreproducibility. Mol Endocrinol. 2014;28:1403–7
39. Bordeaux J, Welsh A, Agarwal S, et al. Antibody validation. Biotechniques. 2010;48:197–209
40. Hewitt SM, Baskin DG, Frevert CW, et al. Controls for immunohistochemistry: the Histochemical Society’s standards of practice for validation of immunohistochemical assays. J Histochem Cytochem. 2014;62:693–7
41. Crissman JW, Goodman DG, Hildebrandt PK, et al. Best practices guideline: toxicologic histopathology. Toxicol Pathol. 2004;32:126–31
42. Cohen DA, Dabbs DJ, Cooper KL, et al. Interobserver agreement among pathologists for semiquantitative hormone receptor scoring in breast carcinoma. Am J Clin Pathol. 2012;138:796–802
43. Meyerholz DK, Sieren JC, Beck AP, et al. Approaches to evaluate lung inflammation in translational research. Vet Pathol. 2018;55:42–52
44. Holland T, Holland C. Analysis of unbiased histopathology data from rodent toxicity studies (or, are these groups different enough to ascribe it to treatment?). Toxicol Pathol. 2011;39:569–75
45. Cross SS. Grading and scoring in histopathology. Histopathology. 1998;33:99–106
46. Holland T. The comparative power of the discriminant methods used in toxicological pathology. Toxicol Pathol. 2005;33:490–4
47. Shalin SC, Sakharpe A, Lyle S, et al. p53 staining correlates with tumor type and location in sebaceous neoplasms. Am J Dermatopathol. 2012;34:129–35 (quiz 136–8)
48. Klopfleisch R. Multiparametric and semiquantitative scoring systems for the evaluation of mouse model histopathology—a systematic review. BMC Vet Res. 2013;9:123
49. Fedchenko N, Reifenrath J. Different approaches for interpretation and reporting of immunohistochemistry analysis results in the bone tissue—a review. Diagn Pathol. 2014;9:221
50. Schafer KA, Eighmy J, Fikes JD, et al. Use of severity grades to characterize histopathologic changes. Toxicol Pathol. 2018;46:256–65
51. Knudson CJ, Hartwig SM, Meyerholz DK, et al. RSV vaccine-enhanced disease is orchestrated by the combined actions of distinct CD4 T cell subsets. PLoS Pathog. 2015;11:e1004757
52. Snyder JM, Ward JM, Treuting PM. Cause-of-death analysis in rodent aging studies. Vet Pathol. 2016;53:233–43
53. Remmele W, Stegner HE. [Recommendation for uniform definition of an immunoreactive score (IRS) for immunohistochemical estrogen receptor detection (ER-ICA) in breast cancer tissue]. Pathologe. 1987;8:138–40
54. Budwit-Novotny DA, McCarty KS, Cox EB, et al. Immunohistochemical analyses of estrogen receptor in endometrial adenocarcinoma using a monoclonal antibody. Cancer Res. 1986;46:5419–25
55. Ellis MJ, Coop A, Singh B, et al. Letrozole is more effective neoadjuvant endocrine therapy than tamoxifen for ErbB-1- and/or ErbB-2-positive, estrogen receptor-positive primary breast cancer: evidence from a phase III randomized trial. J Clin Oncol. 2001;19:3808–16
56. Engelberg JA, Giberson RT, Young LJ, et al. The use of mouse models of breast cancer and quantitative image analysis to evaluate hormone receptor antigenicity after microwave-assisted formalin fixation. J Histochem Cytochem. 2014;62:319–34
57. Allred DC, Harvey JM, Berardo M, et al. Prognostic and predictive factors in breast cancer by immunohistochemical analysis. Mod Pathol. 1998;11:155–68
58. Levenson RM, Hoyt CC. Spectral imaging and microscopy. Am Lab. 2000;32:26
59. True LD. Quantitative immunohistochemistry: a new tool for surgical pathology? Am J Clin Pathol. 1988;90:324–5
60. Cross SS. Kappa statistics as indicators of quality assurance in histopathology and cytopathology. J Clin Pathol. 1996;49:597–9
61. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74
62. Bleich A, Mahler M, Most C, et al. Refined histopathologic scoring system improves power to detect colitis QTL in mice. Mamm Genome. 2004;15:865–71
63. Scheinin T, Butler DM, Salway F, et al. Validation of the interleukin-10 knockout mouse model of colitis: antitumour necrosis factor-antibodies suppress the progression of colitis. Clin Exp Immunol. 2003;133:38–43
64. Festing MF. The design and statistical analysis of animal experiments. ILAR J. 2002;43:191–3
65. Zeiss CJ, Ward JM, Allore HG. Designing phenotyping studies for genetically engineered mice. Vet Pathol. 2012;49:24–31
66. Rimm DL. What brown cannot do for you. Nat Biotechnol. 2006;24:914–6
67. Zehntner SP, Chakravarty MM, Bolovan RJ, et al. Synergistic tissue counterstaining and image segmentation techniques for accurate, quantitative immunohistochemistry. J Histochem Cytochem. 2008;56:873–80
68. Bankhead P, Fernandez JA, McArt DG, et al. Integrated tumor identification and automated scoring minimizes pathologist involvement and provides new insights to key biomarkers in breast cancer. Lab Invest. 2018;98:15–26
69. Hamilton PW, Bankhead P, Wang Y, et al. Digital pathology and image analysis in tissue biomarker research. Methods. 2014;70:59–73
70. Aeffner F, Wilson K, Martin NT, et al. The gold standard paradox in digital image analysis: manual versus automated scoring as ground truth. Arch Pathol Lab Med. 2017;141:1267–75
71. Blyth DI, Pedrick MS, Savage TJ, et al. Lung inflammation and epithelial changes in a murine model of atopic asthma. Am J Respir Cell Mol Biol. 1996;14:425–38
72. Elwood CM, Hamblin AS, Batt RM. Quantitative and qualitative immunohistochemistry of T cell subsets and MHC class II expression in the canine small intestine. Vet Immunol Immunopathol. 1997;58:195–207
73. Kumagai K, Ohno I, Imai K, et al. The involvement of matrix metalloproteinases in basement membrane injury in a murine model of acute allergic airway inflammation. Clin Exp Allergy. 2002;32:1527–34
74. Reid MD, Bagci P, Ohike N, et al. Calculation of the Ki67 index in pancreatic neuroendocrine tumors: a comparative analysis of four counting methodologies. Mod Pathol. 2015;28:686–94
75. Meyerholz DK, Stoltz DA, Namati E, et al. Loss of cystic fibrosis transmembrane conductance regulator function produces abnormalities in tracheal development in neonatal pigs and young children. Am J Respir Crit Care Med. 2010;182:1251–61
76. Barr JY, Wang X, Meyerholz DK, et al. CD8 T cells contribute to lacrimal gland pathology in the nonobese diabetic mouse model of Sjogren syndrome. Immunol Cell Biol. 2017;95:684–94
77. Dee FR, Meyerholz DK. Teaching medical pathology in the twenty-first century: virtual microscopy applications. J Vet Med Educ. 2007;34:431–6
78. Carvajal-Hausdorf DE, Schalper KA, Neumeister VM, et al. Quantitative measurement of cancer tissue biomarkers in the lab and in the clinic. Lab Invest. 2015;95:385–96
79. Gu J, Hacker GW. Modern methods in analytical morphology. USA: Springer; 2012
80. Uc A, Olivier AK, Griffin MA, et al. Glycaemic regulation and insulin secretion are abnormal in cystic fibrosis pigs despite sparing of islet cell mass. Clin Sci (Lond). 2015;128:131–42
81. Johnson SJ, Walker FR. Strategies to improve quantitative assessment of immunohistochemical and immunofluorescent labelling. Sci Rep. 2015;5:10607
82. Jensen EC. Quantitative analysis of histological staining and fluorescence using ImageJ. Anat Rec (Hoboken). 2013;296:378–81
83. Brown DL. Practical stereology applications for the pathologist. Vet Pathol. 2017;54:358–68
84. Wanke R. Stereology—benefits and pitfalls. Exp Toxicol Pathol. 2002;54:163–4
85. Rizzardi AE, Zhang X, Vogel RI, et al. Quantitative comparison and reproducibility of pathologist scoring and digital image analysis of estrogen receptor beta2 immunohistochemistry in prostate cancer. Diagn Pathol. 2016;11:63
86. Cardiff RD, Hubbard NE, Engelberg JA, et al. Quantitation of fixative-induced morphologic and antigenic variation in mouse and human breast cancers. Lab Invest. 2013;93:480–97
87. Rimm DL, Giltnane JM, Moeder C, et al. Bimodal population or pathologist artifact? J Clin Oncol. 2007;25:2487–8
88. Hou J, Riise J, Pakkenberg B. Application of immunohistochemistry in stereology for quantitative assessment of neural cell populations illustrated in the Gottingen minipig. PLoS ONE. 2012;7:e43556
89. Fiore C, Bailey D, Conlon N, et al. Utility of multispectral imaging in automated quantitative scoring of immunohistochemistry. J Clin Pathol. 2012;65:496–502
90. Elias S, McGuire JR, Yu H, et al. Huntingtin is required for epithelial polarity through RAB11A-mediated apical trafficking of PAR3-aPKC. PLoS Biol. 2015;13:e1002142
91. Borthwick LA, Botha P, Verdon B, et al. Is CFTR-delF508 really absent from the apical membrane of the airway epithelium? PLoS One. 2011;6:e23226
92. Meyerholz DK, Stoltz DA, Gansemer ND, et al. Lack of cystic fibrosis transmembrane conductance regulator disrupts fetal airway development in pigs. Lab Investig. 2018. 10.1038/s41374-018-0026-7
93. Yuri P, Hendri AZ, Danarto R. Association between tumor-associated macrophages and microvessel density on prostate cancer progression. Pros Int. 2015;3:93–98
94. Schochlin M, Weissinger SE, Brandes AR, et al. A nuclear circularity-based classifier for diagnostic distinction of desmoplastic from spindle cell melanoma in digitized histological images. J Pathol Inform. 2014;5(1):40
95. Agley CC, Velloso CP, Lazarus NR, et al. An image analysis method for the precise selection and quantitation of fluorescently labeled cellular constituents: application to the measurement of human muscle cells in culture. J Histochem Cytochem. 2012;60:428–438
96. Zhu C, Wang J, Cheng T, et al. The potential role of increasing the release of mouse beta- defensin-14 in the treatment of osteomyelitis in mice: a primary study. PLoS One. 2014;9:e86874
97. Adam RJ, Michalski AS, Bauer C, et al. Air trapping and airflow obstruction in newborn cystic fibrosis piglets. Am J Resp Crit Care Med. 2013;188(12):1434-1441