Digital image analysis: A review of reproducibility, stability and basic requirements for optimal results

APMIS

Volumn 120, Issue 4, 2012, Pages 276-289

  Riber Hansen, Rikke ^a   Vainer, Ben ^b   Steiniche, Torben ^a  

^a AARHUS UNIVERSITY HOSPITAL   (Denmark)

^b Mental Health Services CPH   (Denmark)

Author keywords

Computer assisted; Image processing; Immunohistochemistry; Pathology; Reproducibility of results

Indexed keywords

EPIDERMAL GROWTH FACTOR RECEPTOR 2; ESTROGEN RECEPTOR; HISTONE H3; KI 67 ANTIGEN; PHOSPHOHISTONE H3; PROGESTERONE RECEPTOR; SURVIVIN; TRASTUZUMAB; UNCLASSIFIED DRUG;

ALGORITHM; BREAST CANCER; CANCER CELL; CANCER PROGNOSIS; CELL COUNT; CELL PROLIFERATION; DIAGNOSTIC TEST; DIGITAL IMAGE ANALYSIS; DIGITAL IMAGING; DISEASE MARKER; FLUORESCENCE IN SITU HYBRIDIZATION; HISTOLOGY; HISTOPATHOLOGY; HUMAN; IMAGE ANALYSIS; IMMUNOHISTOCHEMISTRY; INTERMETHOD COMPARISON; MICROSCOPY; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; REPRODUCIBILITY; REVIEW; SAMPLING; SENTINEL LYMPH NODE; STAINING; TIME; VALIDATION PROCESS; WORKLOAD;

BIOMEDICAL TECHNOLOGY; DIAGNOSTIC IMAGING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MICROSCOPY; REPRODUCIBILITY OF RESULTS; SIGNAL PROCESSING, COMPUTER-ASSISTED; STAINING AND LABELING;

EID: 84858700235     PISSN: 09034641     EISSN: 16000463     Source Type: Journal    
DOI: 10.1111/j.1600-0463.2011.02854.x     Document Type: Review

References (71)

1. Tadrous PJ. On the concept of objectivity in digital image analysis in pathology. Pathology 2010;42:207-11.
2. Jagoe R, Steel JH, Vucicevic V, Alexander N, van NS, Wootton R, et al. Observer variation in quantification of immunocytochemistry by image analysis. Histochem J 1991;23:541-7.
3. Haringman JJ, Vinkenoog M, Gerlag DM, Smeets TJ, Zwinderman AH, Tak PP. Reliability of computerized image analysis for the evaluation of serial synovial biopsies in randomized controlled trials in rheumatoid arthritis. Arthritis Res Ther 2005;7:R862-7.
4. Lazzarini AL, Levine RA, Ploutz-Snyder RJ, Sanderson SO. Advances in digital quantification technique enhance discrimination between mild and advanced liver fibrosis in chronic hepatitis C. Liver Int 2005;25:1142-9.
5. Gokhale S, Rosen D, Sneige N, Diaz LK, Resetkova E, Sahin A, et al. Assessment of two automated imaging systems in evaluating estrogen receptor status in breast carcinoma. Appl Immunohistochem Mol Morphol 2007;15:451-5.
6. Layfield LJ, Saria EA, Conlon DH, Kerns BJ. Estrogen and progesterone receptor status determined by the Ventana ES 320 automated immunohistochemical stainer and the CAS 200 image analyzer in 236 early-stage breast carcinomas: prognostic significance. J Surg Oncol 1996;61:177-84.
7. Rooney T, Bresnihan B, Andersson U, Gogarty M, Kraan M, Schumacher HR, et al. Microscopic measurement of inflammation in synovial tissue: inter-observer agreement for manual quantitative, semiquantitative and computerised digital image analysis. Ann Rheum Dis 2007;66:1656-60.
8. Gavrielides MA, Gallas BD, Lenz P, Badano A, Hewitt SM. Observer variability in the interpretation of HER2/neu immunohistochemical expression with unaided and computer-aided digital microscopy. Arch Pathol Lab Med 2011;135:233-42.
9. Bonnelykke-Behrndtz ML, Sorensen FB, Damsgaard TE. Stereological quantification of tumor volume, mean nuclear volume and total number of melanoma cells correlated with morbidity and mortality. APMIS 2008;116:903-11.
10. van der Ploeg AP, van Akkooi AC, Schmitz PI, Koljenovic S, Verhoef C, Eggermont AM. EORTC Melanoma Group sentinel node protocol identifies high rate of submicrometastases according to Rotterdam Criteria. Eur J Cancer 2010;46:2414-21.
11. Riber-Hansen R, Nyengaard JR, Hamilton-Dutoit SJ, Sjoegren P, Steiniche T. Metastatic melanoma volume in sentinel nodes: objective stereology-based measurement predicts disease recurrence and survival. Histopathology 2009;54:796-803.
12. Carter CL, Allen C, Henson DE. Relation of tumor size, lymph node status, and survival in 24, 740 breast cancer cases. Cancer 1989;63:181-7.
13. Balch CM, Gershenwald JE, Soong SJ, Thompson JF, Atkins MB, Byrd DR, et al. Final version of 2009 AJCC Melanoma Staging and Classification. J Clin Oncol 2009;27:6199-206.
14. Riber-Hansen R, Nyengaard JR, Hamilton-Dutoit SJ, Steiniche T. Stage migration after minor changes in histologic estimation of tumor burden in sentinel lymph nodes: the protocol trap. Cancer 2009;115:2177-87.
15. Riber-Hansen R, Nyengaard JR, Hamilton-Dutoit SJ, Steiniche T. The nodal location of metastases in melanoma sentinel lymph nodes. Am J Surg Pathol 2009;33:1522-8.
16. Riber-Hansen R, Nyengaard JR, Hamilton-Dutoit S, Sjoegren P, Steiniche T. Automated digital volume measurement of melanoma metastases in sentinel nodes predicts disease recurrence and survival. Histopathology 2011;59:433-40.
17. Goedkoop AY, de Rie MA, Teunissen MB, Picavet DI, van der Hall PO, Bos JD, et al. Digital image analysis for the evaluation of the inflammatory infiltrate in psoriasis. Arch Dermatol Res 2005;297:51-9.
18. Kraan MC, Haringman JJ, Ahern MJ, Breedveld FC, Smith MD, Tak PP. Quantification of the cell infiltrate in synovial tissue by digital image analysis. Rheumatology (Oxford) 2000;39:43-9.
19. Donnelly DJ, Gensel JC, Ankeny DP, van RN, Popovich PG. An efficient and reproducible method for quantifying macrophages in different experimental models of central nervous system pathology. J Neurosci Methods 2009;181:36-44.
20. Wang Y, McCleary D, Wang CW, Kelly P, James J, Fennell DA, et al. Ultra-fast processing of gigapixel tissue MicroArray images using high performance computing. Anal Cell Pathol (Amst) 2010;33:271-85.
21. Bedossa P, Dargere D, Paradis V. Sampling variability of liver fibrosis in chronic hepatitis C. Hepatology 2003;38:1449-57.
22. Oger M, Belhomme P, Klossa J, Michels JJ, Elmoataz A. Automated region of interest retrieval and classification using spectral analysis. Diagn Pathol 2008;3(Suppl 1):S17;4.
23. Brugmann A, Eld M, Lelkaitis G, Nielsen S, Grunkin M, Hansen JD, et al. Digital image analysis of membrane connectivity is a robust measure of HER2 immunostains. Breast Cancer Res Treat 2011 [Epub ahead of print].
24. Rexhepaj E, Brennan DJ, Holloway P, Kay EW, McCann AH, Landberg G, et al. Novel image analysis approach for quantifying expression of nuclear proteins assessed by immunohistochemistry: application to measurement of oestrogen and progesterone receptor levels in breast cancer. Breast Cancer Res 2008;10:R89;10.
25. Walker RA. Quantification of immunohistochemistry - issues concerning methods, utility and semiquantitative assessment I. Histopathology 2006;49:406-10.
26. NORDIQC Website. (accessed 9 July 2011).
27. UK-NEQAS Website. (accessed 9 July 2011).
28. Tuominen VJ, Ruotoistenmaki S, Viitanen A, Jumppanen M, Isola J. ImmunoRatio: a publicly available web application for quantitative image analysis of estrogen receptor (ER), progesterone receptor (PR), and Ki-67. Breast Cancer Res 2010;12:R56;12.
29. Rojo MG, Garcia GB, Mateos CP, Garcia JG, Vicente MC. Critical comparison of 31 commercially available digital slide systems in pathology. Int J Surg Pathol 2006;14:285-305.
30. Johansson AC, Visse E, Widegren B, Sjogren HO, Siesjo P. Computerized image analysis as a tool to quantify infiltrating leukocytes: a comparison between high- and low-magnification images. J Histochem Cytochem 2001;49:1073-9.
31. Lopez C, Jaen MJ, Lejeune M, Escriva P, Salvado MT, Pons LE, et al. Roundness variation in JPEG images affects the automated process of nuclear immunohistochemical quantification: correction with a linear regression model. Histochem Cell Biol 2009;132:469-77.
32. Lopez C, Lejeune M, Escriva P, Bosch R, Salvado MT, Pons LE, et al. Effects of image compression on automatic count of immunohistochemically stained nuclei in digital images. J Am Med Inform Assoc 2008;15:794-8.
33. Grunkin M, Raundahl J, Foged NT. Practical considerations of image analysis and quantification of signal transduction IHC staining. Methods Mol Biol 2011;717:143-54.
34. Rojkind M, Ponce-Noyola P. The extracellular matrix of the liver. Coll Relat Res 1982;2:151-75.
35. Goodman ZD, Becker RL Jr, Pockros PJ, Afdhal NH. Progression of fibrosis in advanced chronic hepatitis C: evaluation by morphometric image analysis. Hepatology 2007;45:886-94.
36. Calvaruso V, Burroughs AK, Standish R, Manousou P, Grillo F, Leandro G, et al. Computer-assisted image analysis of liver collagen: relationship to Ishak scoring and hepatic venous pressure gradient. Hepatology 2009;49:1236-44.
37. Manousou P, Dhillon AP, Isgro G, Calvaruso V, Luong TV, Tsochatzis E, et al. Digital image analysis of liver collagen predicts clinical outcome of recurrent hepatitis C virus 1year after liver transplantation. Liver Transpl 2011;17:178-88.
38. Germani G, Burroughs AK, Dhillon AP. The relationship between liver disease stage and liver fibrosis: a tangled web. Histopathology 2010;57:773-84.
39. Hanahan D, Weinberg RA. Hallmarks of cancer: the next generation. Cell 2011;144:646-74.
40. Noutsias M, Pauschinger M, Ostermann K, Escher F, Blohm JH, Schultheiss H, et al. Digital image analysis system for the quantification of infiltrates and cell adhesion molecules in inflammatory cardiomyopathy. Med Sci Monit 2002;8:MT59-71.
41. Sont JK, De Boer WI, van Schadewijk WA, Grunberg K, van Krieken JH, Hiemstra PS, et al. Fully automated assessment of inflammatory cell counts and cytokine expression in bronchial tissue. Am J Respir Crit Care Med 2003;167:1496-503.
42. Klapper W, Hoster E, Determann O, Oschlies I, van der Laak J, Berger F, et al. Ki-67 as a prognostic marker in mantle cell lymphoma - consensus guidelines of the pathology panel of the European MCL Network. J Hematol 2009;2:103-11.
43. Nielsen PS, Riber-Hansen R, Raundahl J, Steiniche T. Automated quantification of MART1-verified Ki67 indices by digital image analysis in melanocytic lesions. Arch Pathol Lab Med (in press).
44. Coleman KE, Brat DJ, Cotsonis GA, Lawson D, Cohen C. Proliferation (MIB-1 expression) in oligodendrogliomas: assessment of quantitative methods and prognostic significance. Appl Immunohistochem Mol Morphol 2006;14:109-14.
45. Grala B, Markiewicz T, Kozlowski W, Osowski S, Slodkowska J, Papierz W. New automated image analysis method for the assessment of Ki-67 labeling index in meningiomas. Folia Histochem Cytobiol 2009;47:587-92.
46. Lejeune M, Jaen J, Pons L, Lopez C, Salvado MT, Bosch R, et al. Quantification of diverse subcellular immunohistochemical markers with clinicobiological relevancies: validation of a new computer-assisted image analysis procedure. J Anat 2008;212:868-78.
47. Skaland I, Ovestad I, Janssen EA, Klos J, Kjellevold KH, Helliesen T, et al. Digital image analysis improves the quality of subjective HER-2 expression scoring in breast cancer. Appl Immunohistochem Mol Morphol 2008;16:185-90.
48. Turashvili G, Leung S, Turbin D, Montgomery K, Gilks B, West R, et al. Inter-observer reproducibility of HER2 immunohistochemical assessment and concordance with fluorescent in situ hybridization (FISH): pathologist assessment compared to quantitative image analysis. BMC Cancer 2009;9:165;13.
49. Ellis CM, Dyson MJ, Stephenson TJ, Maltby EL. HER2 amplification status in breast cancer: a comparison between immunohistochemical staining and fluorescence in situ hybridisation using manual and automated quantitative image analysis scoring techniques. J Clin Pathol 2005;58:710-14.
50. Cheng L, Pisansky TM, Sebo TJ, Leibovich BC, Ramnani DM, Weaver AL, et al. Cell proliferation in prostate cancer patients with lymph node metastasis: a marker for progression. Clin Cancer Res 1999;5:2820-3.
51. Stanton KJ, Sidner RA, Miller GA, Cummings OW, Schmidt CM, Howard TJ, et al. Analysis of Ki-67 antigen expression, DNA proliferative fraction, and survival in resected cancer of the pancreas. Am J Surg 2003;186:486-92.
52. Levy MJ, Clain JE, Clayton A, Halling KC, Kipp BR, Rajan E, et al. Preliminary experience comparing routine cytology results with the composite results of digital image analysis and fluorescence in situ hybridization in patients undergoing EUS-guided FNA. Gastrointest Endosc 2007;66:483-90.
53. Rexhepaj E, Jirstrom K, O'connor DP, O'Brien SL, Landberg G, Duffy MJ, et al. Validation of cytoplasmic-to-nuclear ratio of survivin as an indicator of improved prognosis in breast cancer. BMC Cancer 2010;10:639; 13.
54. Skaland I, Janssen EA, Gudlaugsson E, Klos J, Kjellevold KH, Soiland H, et al. Validating the prognostic value of proliferation measured by phosphohistone H3 (PPH3) in invasive lymph node-negative breast cancer patients less than 71years of age. Breast Cancer Res Treat 2009;114:39-45.
55. Alexander BM, Sprott K, Farrow DA, Wang X, D'Andrea AD, Schnitt SJ, et al. DNA repair protein biomarkers associated with time to recurrence in triple-negative breast cancer. Clin Cancer Res 2010;16:5796-804.
56. Skaland I, Janssen EA, Gudlaugsson E, Klos J, Kjellevold KH, Soiland H, et al. Phosphohistone H3 expression has much stronger prognostic value than classical prognosticators in invasive lymph node-negative breast cancer patients less than 55years of age. Mod Pathol 2007;20:1307-15.
57. Brennan DJ, Rexhepaj E, O'Brien SL, McSherry E, O'connor DP, Fagan A, et al. Altered cytoplasmic-to-nuclear ratio of survivin is a prognostic indicator in breast cancer. Clin Cancer Res 2008;14:2681-9.
58. De Boer WI, Hiemstra PS, Sont JK, De HE, Rabe KF, van Krieken JH, et al. Image analysis and quantification in lung tissue. Clin Exp Allergy 2001;31:504-8.
59. Nielsen PS, Riber-Hansen R, Steiniche TD. Immunohistochemical double stains against Ki67/MART1 and HMB45/MITF: promising diagnostic tools in melanocytic lesions. Am J Dermatopathol 2011;33:361-70.
60. Schubert W, Bonnekoh B, Pommer AJ, Philipsen L, Bockelmann R, Malykh Y, et al. Analyzing proteome topology and function by automated multidimensional fluorescence microscopy. Nat Biotechnol 2006;24:1270-8.
61. Tholouli E, Sweeney E, Barrow E, Clay V, Hoyland JA, Byers RJ. Quantum dots light up pathology. J Pathol 2008;216:275-85.
62. Liu J, Lau SK, Varma VA, Moffitt RA, Caldwell M, Liu T, et al. Molecular mapping of tumor heterogeneity on clinical tissue specimens with multiplexed quantum dots. ACS Nano 2010;4:2755-65.
63. Li R, Dai H, Wheeler TM, Sayeeduddin M, Scardino PT, Frolov A, et al. Prognostic value of Akt-1 in human prostate cancer: a computerized quantitative assessment with quantum dot technology. Clin Cancer Res 2009;15:3568-73.
64. Chen C, Xia HS, Gong YP, Peng J, Peng CW, Hu MB, et al. The quantitative detection of total HER2 load by quantum dots and the identification of a new subtype of breast cancer with different 5-year prognosis. Biomaterials 2010;31:8818-25.
65. Hikage M, Gonda K, Takeda M, Kamei T, Kobayashi M, Kumasaka M, et al. Nano-imaging of the lymph network structure with quantum dots. Nanotechnology 2010;21:185103;8.
66. Macville MV, Van der Laak JA, Speel EJ, Katzir N, Garini Y, Soenksen D, et al. Spectral imaging of multi-color chromogenic dyes in pathological specimens. Anal Cell Pathol 2001;22:133-42.
67. Levenson R. Putting the "more" back in morphology: spectral imaging and image analysis in the service of pathology. Arch Pathol Lab Med 2008;132:748-57.
68. Jaganath R, Angeletti C, Levenson R, Rimm DL. Diagnostic classification of urothelial cells in urine cytology specimens using exclusively spectral information. Cancer 2004;102:186-91.
69. Gabriel E, Venkatesan V, Shah S. Towards high performance cell segmentation in multispectral fine needle aspiration cytology of thyroid lesions. Comput Methods Programs Biomed 2010;98:231-40.
70. Bird B, Romeo M, Laver N, Diem M. Spectral detection of micro-metastases in lymph node histo-pathology. J Biophotonics 2009;2:37-46.
71. Ornberg RL. Proliferation and apoptosis measurements by color image analysis based on differential absorption. J Histochem Cytochem 2001;49:1059-60.