Polyp-Alert: Near real-time feedback during colonoscopy

Computer Methods and Programs in Biomedicine

Volumn 120, Issue 3, 2015, Pages 164-179

  Wang, Yi ^a   Tavanapong, Wallapak ^a   Wong, Johnny ^a   Oh, Jung Hwan ^b   de Groen, Piet C ^c  

^a Iowa State University   (United States)

^b UNIVERSITY OF NORTH TEXAS   (United States)

^c MAYO CLINIC ROCHESTER   (United States)

Author keywords

Colonoscopy; Medical imaging video; Near Real time; Polyp detection

Indexed keywords

MEDICAL IMAGING; STATISTICAL TESTS; VISUAL COMMUNICATION;

CLINICAL PRACTICES; COLONOSCOPY; NEAR-REAL TIME; POLYP DETECTION; RULE-BASED CLASSIFIER; SEQUENCE OF IMAGES; SOFTWARE SYSTEMS; VISUAL FEEDBACK;

ENDOSCOPY;

ARTICLE; CLASSIFIER; CLINICAL PRACTICE; COLON POLYP; COLONOSCOPY; DECISION TREE; DIAGNOSTIC IMAGING; ENDOSCOPIST; HUMAN; IMAGING SOFTWARE; LEARNING ALGORITHM; POLYPECTOMY; TASK PERFORMANCE; VIDEORECORDING; VISUAL FEEDBACK; COLONIC POLYPS;

COLONIC POLYPS; COLONOSCOPY; HUMANS;

EID: 84929963303     PISSN: 01692607     EISSN: 18727565     Source Type: Journal    
DOI: 10.1016/j.cmpb.2015.04.002     Document Type: Article

References (60)

1. American Cancer Society Colorectal Cancer Facts & Figures 2014-2015, American Cancer Society.
2. Lieberman D. Quality and colonoscopy: a new imperative. Gastrointest. Endosc. 2005, 61(2):392-394.
3. Pabby A., Schoen R.E., Weissfeld J.L., Burt R., Kikendall J.W., Lance P., Lanza E., Schatzkin A. Analysis of colorectal cancer occurrence during surveillance colonoscopy in the dietary prevention trial. Gastrointest. Endosc. 2005, 61(3):385-391.
4. Rex K., Bond J.H., Winawer S., Levin T.R., Burt R.W., et al. Quality in the technical performance of colonoscopy and the continuous quality improvement process for colonoscopy: recommendations of the U.S. multi-society task force on colorectal cancer. Am. J. Gastroenterol. 2002, 97(6):1296-1308.
5. S. Hwang, J. Oh, W. Tavanapong, J.Wong, P.C. de Groen, Polyp detection in colonoscopy video using elliptical shape feature, in: Proc. IEEE Int. Conf. Image Processing, San Antonio, TX, 2007, pp. 465-468.
6. Iakovidis D.K., Maroulis D.E., Karkanis S.A. An intelligent system for automatic detection of gastrointestinal adenomas in video endoscopy. Comput. Biol. Med. 2006, 30(October (10)):1084-1103.
7. Krishnan S.M., Yang X., Chan K.L., Kumar S., Goh P.M.Y. Intestinal abnormality detection from endoscopic images. Proc. IEEE Eng. Med. Biol. Soc. 1998, 2:896-898.
8. Dhandra B.V., Hegadi Ravindra, Hangarge Mallikarjun, Malemath V.S. Analysis of abnormality in endoscopic images using combined HSI color space and watershed segmentation. Proc. Int'l Conf. Pattern Recognit. 2006, 4:695-698.
9. Kang J., Doraiswami R. Real-time image processing system for endoscopic applications. Proc. IEEE Can. Conf. Electr. Comput. Eng. 2003, 3:1469-1472.
10. Wang P., Krishnan S.M., Kugean C., Tjoa M.P. Classification of endoscopic images based on texture and neural network. Proc. Int'l Conf. IEEE Eng. Med. Biol. Soc. 2001, 4:3691-3695.
11. Karkanis S.A., Dimitrios K., Iakovidis Dimitrios E., Maroulis Dimitris A., Tzivras Karras M. Computer-aided tumor detection in endoscopic video using color wavelet features. IEEE Trans. Inf. Technol. Biomed. 2003, 7(3):141-152.
12. L. Alexandre, J. Casteleiro, N. Nobre, Polyp detection in endoscopic video using SVMs, in: Proc. of the 11th European Conference on Principles and Practice of Knowledge Discovery in Databases, vol. 4702, 2007, pp. 358-365.
13. Li P., Chan K.L., Krishnan S.M. Learning a multi-size patch-based hybrid kernel machine ensemble for abnormal region detection in colonoscopic images,. Proc. IEEE Int'l Conf. Comput. Vision Pattern Recognit. 2005, 2:670-675.
14. Tjoa M., Krishnan S. Feature extraction for the analysis of colon status from the endoscopic images. BioMed. Eng. Online 2003, 2(1):9.
15. Karkanis S.A., Iakovidis D.K., Karras D.A., Maroulis D.E. Detection of lesions in endoscopic video using textural descriptors on wavelet domain supported by artificial neural network architectures. Proc. IEEE Int'l Conf. Image Process. 2001, 833-836.
16. Magoulas G.D., Plagianakos V.P., Tasoulis D.K., Vrahatis M.N. Tumor detection in colonoscopy using the unsupervised k-windows clustering algorithm and neural networks. Proc. Eur. Symp. Biomed. Eng. 2004.
17. Magoulas G.D., Plagianakos V.P., Vrahatis M.N. Improved neural networkbased interpretation of colonoscopy images through on-line learning and evolution. Eur. Network Excell. Intell. Technol. Smart Adapt. Syst. 2001, 38-43.
18. Magoulas G.D., Plagianakos V.P., Vrahatis M.N. Neural network-based colonoscopic diagnosis using on-line learning and differential evolution. Appl. Soft Comput. 2004, 4(4):369-379.
19. Cheng D.C., Ting W.C., Chen Y.F., Pu Q., Jiang X.Y. Colorectal polyps detection using texture features and support vector machine. Proc. Int'l Conf. Adv. Mass Data Anal. Images Signals Med. Biotechnol. Chem. Food Ind. 2008, 5108:62-72.
20. Ameling S., Wirth S., Paulus D., Lacey G., Vilariño F. Texture-based polyp detection in colonoscopy. Bildverarbeitung fürdie Medizin 2009, 346-350.
21. Ameling S., Wirth S., Paulus D. Methods for Polyp Detection in Colonoscopy Video: A Review, 14/2008 2008.
22. S. Gross, M. Kennel, T. Stehle, J. Wulff, J. Tischendorf, et al., Polyp segmentation in NBI colonoscopy, in: Algorithmen - Systeme - Anwendungen Proceedings des Workshops, Bildverarbeitung für die Medizin, Springer, Berlin, Heidelberg. vol. 22, 2009, pp. 252-256, 25.
23. Tanaka S., Oka S., Hirata M., et al. Pit pattern diagnosis for colorectal neoplasia using narrow band imaging magnification. Dig. Endosc. 2006, 18(S1):S52-S56.
24. Z. Qian, Q.-H. Max, Meng, Polyp detection in wireless capsule endoscopy images using novel color texture features, in: Proc. of World Congress on Intelligent Control and Automation, June 21-25, Taipei, Taiwan, 2011, pp. 948-952.
25. Li B., Fan Y., Meng M.Q.-H., Qi L. Intestinal polyp recognition in capsule endoscopy images using color and shape features. Proc. of IEEE Int'l Conf. on Robotics and Biomimetic 2009, 1490-1494.
26. B. Li, M.Q.-H. Meng, L. Xu, A comparative study of shape features for polyp detection in Wireless Capsule Endoscopy images, in: Proc. of Int'l Conf. of IEEE Engineering in Medicine and Biology Society, 2009 September, Minneapolis, MN, USA, 2009, pp. 3733-3734.
27. Li B., Meng M.Q.-H. Small bowel tumor detection for Wireless Capsule Endoscopy images using textural features and support vector machine. Proc. of IEEE/RSJ International Conference in Intelligent Robots and Systems 2009, 498-503.
28. A. Karargyris, N. Bourbakis, Identification of polyps in Wireless Capsule Endoscopy videos using Log Gabor Filters, in: Proc. of IEEE/NIH Life Science Systems and Applications Workshop, Bethesda, MD, USA, 2009, pp.143-147.
29. D.J.C. Barbosa, J. Ramos, J.H. Correia, C.S. Lima, Automatic detection of small bowel tumors in Capsule Endoscopy based on color curvelet covariance statistical texture descriptors, in: Proc. of IEEE Int'l Conf. of Engineering in Medicine and Biology Society, September 2009, Minneapolis, MN, USA, 2009, pp. 6683-6686.
30. Hwang S. Bag-of-visual-words approach to abnormal image detection in wireless capsule endoscopy videos. Adv. Visual Comput. Lect. Notes Comput. Sci. 2011, 6939:320-327.
31. L. Alexandre, N.N. Nobre, J.C. Casteleiro, Color and position versus texture features for endoscopic polyp detection, in: Proc. Int'l Conf. Biomedical Engineering and Informatics, Sanya, China, 2008, 38-42.
32. Park S., Sargent D., et al. A colon video analysis framework for polyp detection. IEEE T. Bio-Med. Eng. 2012, 59(5):1408-1418.
33. Bernal J., Sánchez J., Vilarino F. Towards automatic polyp detection with a polyp appearance model. Pattern Recognit. 2012, 45(9):3166-3182.
34. Wang Y., Tavanapong W., Wong J., Oh J., de Groen P.C. Part-based multi-derivative edge cross-section profiles for polyp detection in colonoscopy. IEEE J. Biomed. Health Inf. 2013, PP(99):1-11.
35. Tajbakhsh N., Chi C., Gurudu R., Suryakanth J., Liang Automatic polyp detection from learned boundaries,. Proc. IEEE Int'l Symp. Biomed. Imaging 2014, 97-100. (April 29 2014-May 2 2014).
36. Lienhart R. Reliable transition detection in videos: a survey and practitioner's guide. Int. J. Image Graph. 2001, 1(3):469-486.
37. Hanjalic A. Shot boundary detection: unraveled and resolved. IEEE Trans. Circuits Syst. Video Technol. 2002, 12(February (2)):90-105.
38. J.S. Boreczky, L.D. Wilcox, A Hidden Markov model frame work for video segmentation using audio and image features, in: Proc. of IEEE ICASSP, vol. 2, 1998, pp. 3741-3744.
39. Koprinska I., Carrato S. Temporal video segmentation: a survey. Signal Process. Image Commun. 2001, 16(5):477-500.
40. Kikukawa T., Kawafuchi S. Development of an automatic summary editing system for the audio-visual resources. Trans. Electron. Inform. 1992, J75-A:204-212.
41. Shahraray B. Scene change detection and content-based sampling of video sequences. Proc. IS&T/SPIE 1995, 2419.
42. W. Xiong, J.C.-M. Lee, M.C. Ip, Net comparison: a fast and elective method for classifying image sequences, in: Proc. of SPIE Conference on IS&T/SPIE Symp. on Electronic Imaging: Science & Technology. International Society for Optics and Photonics, San Jose, CA, 1995.
43. Pappas T.N. An adaptive clustering algorithm for image segmentation. IEEE Trans. Signal Process 1992, 40:901-914.
44. Aigrain P., Joly P. The automatic real-time analysis of film editing and transition elects and its applications. Comput. Graph. 1994, 18(1):93-103.
45. J.S. Boreczky, L.D. Wilcox, A hidden Markov model framework for video segmentation using audio and image features, in: Proc. of In'l Conf. on Acoustics Speech, and Signal Processing, Seattle, 1998, 3741-3744.
46. J. Oh, S. Hwang, W. Tavanapong, P.C. de Groen, J. Wong, Blurry frame detection and shot segmentation in colonoscopy videos, in: Proc. of IS&T/SPIE Symp. on Storage and Retrieval Methods and Applications for Multimedia, San Jose, CA, 2004, 531-542.
47. Cao Y., Liu D., Tavanapong W., Wong J., Oh J., de Groen P.C. Computer-aided detection of diagnostic and therapeutic operations in colonoscopy videos. IEEE Trans. Biomed. Eng. 2007, 54(July (7)):1268-1279.
48. Wang Y., Tavanapong W., Wong J., Oh J., de Groen P.C. Near real-time retroflexion detection in colonoscopy. IEEE J. Biomed.d Health Inf. 2012, 17(1):143-152.
49. Wang Y., Tavanapong W., Wong J., Oh J., de Groen P.C. Computer-aided detection of retroflexion in colonoscopy. Proc. of IEEE Int'l Symp. on Computer-Based Medical Systems 2011, 1-6.
50. Wang Y., Tavanapong W., Wong J., Oh J., de Groen P.C. Detection of quality visualization of appendiceal orifices using local edge cross-section profile features and near pause detection. IEEE Trans. Biomed. Eng. 2010, 57(3):689-695.
51. Wang Y., Tavanapong W., Wong J., Oh J., de Groen P.C. Edge cross-section features for detection of appendiceal orifice appearance in colonoscopy videos. Proc. of IEEE Engineering in Medicine and Biology Society 2008, 3000-3003.
52. Trevor H., Robert T., Jerome F. The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2009, Springer-Verlag, New York. second ed.
53. Polynomial Curve Fitting, MathWorks, [Online]. Available: 〈http://www.mathworks.com/help/techdoc/ref/polyfit.html〉.
54. Zelinsky A., Bradski G.R. Learning OpenCV-Computer Vision with the OpenCV Library 2008.
55. Shi J., Tomasi C. Good features to track. Proc. IEEE Conf. Comput. Vision Pattern Recognit. 1994, 593-600.
56. Harris C., Stephens M. A combined corner and edge detector. Proc. of the Fourth Alvey Vision Conference 1988.
57. Stanek S., Tavanapong W., Wong J., Oh J., Nawarathna R., Muthukudage J., de P.C., Groen SAPPHIRE middleware and software development kit for medical video analysis. Proc. of Int'l Symp. on Computer-Based Medical Systems 2011, 1-6.
58. Witten I.H., Frank E. Data Mining Practical Machine Learning Tools and Techniques 2005, Morgan Kaufmann, San Francisco, CA. second ed.
59. Participants in the Paris, workshop., the Paris endoscopic classification of superficial neoplastic lesions: esophagus, stomach, and, colon. Gastrointest. Endosc. 2003, 58(6 Suppl.):S3-S43.
60. Mahmoudi S.A., Kierzynka M., Manneback P., Kurowski K. Real-time motion tracking using optical flow on multiple GPUs. Bull. Polish Acad. Sci. Tech. Sci. 2014, 62(1):139-150.