Smartphone and mobile image processing for assisted living: Health-monitoring apps powered by advanced mobile imaging algorithms

IEEE Signal Processing Magazine

Volumn 33, Issue 4, 2016, Pages 30-48

  Nejati, Hossein ^a   Pomponiu, Victor ^a   Do, Thanh Toan ^a   Zhou, Yiren ^a   Iravani, Sahar ^a   Cheung, Ngai Man ^a  

^a SINGAPORE UNIVERSITY OF TECHNOLOGY AND DESIGN   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; HEALTH; HUMAN COMPUTER INTERACTION; IMAGE PROCESSING; PATIENT MONITORING; SIGNAL ENCODING; SIGNAL PROCESSING;

ADVANCED SIGNAL PROCESSING; HEALTH MONITORING; HUMAN COMPUTER INTERFACES; PHYSIOLOGICAL MONITORING; SOFTWARE AND HARDWARES; STATE OF THE ART; TRACKING DEVICES; WEARABLE DEVICES;

SMARTPHONES;

EID: 85032751351     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2016.2549996     Document Type: Article

References (33)

1. M. N. K. Boulos, S. Wheeler, C. Tavares, and R. Jones, "How smartphones are changing the face of mobile and participatory healthcare: An overview, with example from ecaalyx, " Biomed. Eng. Online, vol. 10, no. 24, 2011. DOI: 10. 1186/1475-925X-10-24
2. N.-M. Cheung and D. Koh. (2014, Jan. ). Mobile imaging system for early diagnosis of skin cancer. IEEE Life Sci. Newsl. [Online]. Available: http://lifesciences. ieee. org/publications/newsletter/january-2014/482-mobile-imaging-system-for-early-diagnosis-of-skin-cancer
3. M.-Z. Poh, D. J. McDuff, and R. W. Picard, "Non-contact, automated cardiac pulse measurements using video imaging and blind source separation, " Opt. Express, vol. 18, no. 10, pp. 10762-10774, May 2010.
4. S. Kwon, H. Kim, and K. S. Park, "Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone, " in Proc. 2012 Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society, San Diego, CA, pp. 2174-2177.
5. F.-C. Huang, G. Wetzstein, B. A. Barsky, and R. Raskar, "Eyeglasses-free display: Towards correcting visual aberrations with computational light field displays, " ACM Trans. Graph., vol. 33, no. 4, July 2014.
6. A. Borve, K. Terstappen, C. Sandberg, and J. Paoli, "Mobile teledermoscopy-theres an app for that!, " Dermatol. Pract. Concept., vol. 3, no. 2, pp. 41-48, Apr. 2013.
7. T.-T. Do, Y. Zhou, H. Zheng, N.-M. Cheung, and D. Koh, "Early melanoma diagnosis with mobile imaging, " in Proc. 2014 36th Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society, Chicago, IL, pp. 6752-6757.
8. J. Shi and J. Malik, "Normalized cuts and image segmentation, " IEEE Trans. Pattern Anal. Machine Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
9. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph-based image segmentation, " Int. J. Computer Vis., vol. 59, no. 2, pp. 167-181, Sept. 2004.
10. P. A. Estevez, M. Tesmer, C. A. Perez, and J. M. Zurada, "Normalized mutual information feature selection, " IEEE Trans. Neural Networks, vol. 20, no. 2, pp. 189-201, Feb. 2009.
11. Q. Wang, Z. Yu, C. Rasmussen, and J. Yu, "Stereo vision-based depth of field rendering on a mobile device, " J. Electron. Imag., vol. 23, no. 2, p. 023009, 2014.
12. H. Chikatsu and Y. Takahashi, "Comparative evaluation of consumer grade cameras and mobile phone cameras for close range photogrammetry, " Proc. SPIE, vol. 7447, Sept. 2009.
13. IEEE Standard for Camera Phone Image Quality, IEEE Standard P1858-2012.
14. S. Mayu, M. Teruhiro, and Keiichi, Y. "Estimating heart rate variation during walking with smartphone, " in Proc. 2013 ACM Int. Joint Conf. Pervasive and Ubiquitous Computing, New York, pp. 245-254.
15. G. Gaoan and Z. Zhenmin, "Heart rate measurement via smart phone acceleration sensor, " in Proc. 2014 Int. Conf. Smart Computing (SMARTCOMP), Hong Kong, pp. 295-300.
16. A. Pal, A. Sinha, A. D. Choudhury, T. Chattopadyay, and A. Visvanathan, "A robust heart rate detection using smart-phone video, " in Proc. Third ACM MobiHoc Workshop on Pervasive Wireless Healthcare, New York, 2013, pp. 43-48.
17. S. Xu, L. Sun, and G. K. Rohde, "Robust efficient estimation of heart rate pulse from video, " Biomed. Opt. Express, vol. 5, no. 4, pp. 1124-1135, Apr. 2014.
18. Y. Sun, S. Hu, V. Azorin-Peris, S. Greenwald, J. Chambers, and Y. Zhu, "Motioncompensated noncontact imaging photoplethysmography to monitor cardiorespiratory status during exercise, " J. Biomed. Opt., vol. 16, no. 7, p. 077010, 2011.
19. B. M. Bates-Jensen, "Chronic wound assessment, " Nurs. Clin. North Am., vol. 34, no. 4, pp. 799-845, 1999.
20. N. D. J. Hettiarachchi, R. B. H. Mahindaratne, G. D. C. Mendis, H. T. Nanayakkara, and N. D. Nanayakkara, "Mobile based wound measurement, " in Proc. 2013 IEEE Point-of-Care Healthcare Technologies (PHT), Bangalore, India, 2013, pp. 298-301.
21. M. A. L. Wang, P. C. Pedersen, D. M. Strong, B. Tulu, E. Agu, and R. Ignotz, "Smartphone-based wound assessment system for patients with diabetes, " IEEE Trans. Biomed. Eng., vol. 62, no. 2, pp. 477-488, Feb. 2015.
22. H. Wannous, Y. Lucas, and S. Treuillet, "Enhanced assessment of the wound-healing process by accurate multiview tissue classification, " IEEE Trans. Med. Imag., vol. 30, no. 2, pp. 315-326, Feb. 2011.
23. C. Doukas, P. Stagkopoulos, C. T. Kiranoudis, and I. Maglogiannis, "Automated skin lesion assessment using mobile technologies and cloud platforms, " in Proc. 2012 Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society, San Diego, CA, pp. 2444-2447.
24. M. Sadeghi, T. K. Lee, D. McLean, H. Lui, and M. S. Atkins, "Detection and analysis of irregular streaks in dermoscopic images of skin lesions, " IEEE Trans. Med. Imag., vol. 32, no. 5, pp. 849-861, May 2013.
25. N. Otsu, "A threshold selection method from gray-level histograms, " Automatica, vol. 11, no. 285-296, pp. 23-27, 1975.
26. O. Abuzaghleh, B. D. Barkana, and M. Faezipour, "Noninvasive real-time automated skin lesion analysis system for melanoma early detection and prevention, " IEEE J. Trans. Eng. Health Med., vol. 3, pp. 1-12, Apr. 2015.
27. T. Wadhawan, N. Situ, H. Rui, K. Lancaster, X. Yuan, and G. Zouridakis, "Implementation of the 7-point checklist for melanoma detection on smart handheld devices, " in Proc. 2011 Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society, Boston, pp. 3180-3183.
28. K. Ramlakhan and Y. Shang, "A mobile automated skin lesion classification system, " in Proc. 2011 IEEE 23rd Int. Conf. Tools with Artificial Intelligence, Boca Raton, FL, pp. 138-141.
29. E. D. Boudreaux, M. E. Waring, R. B. Hayes, R. S. Sadasivam, S. Mullen, and S. Pagoto, "Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations, " Transl. Behav. Med., vol. 4, no. 4, pp. 363-371, Dec. 2014.
30. Food and Drug Administration. (2013, Sept. 25). Mobile medical applications: Guidance for industry and food and drug administration staff. [Online]. Available: http:// www.fda. gov/downloads/MedicalDevices/.../UCM263366. pdf
31. P. Moulon. (2016). OpenMVG: Open multiple view geometry. [Online]. Available: imagine. enpc. fr/~moulonp/openMVG
32. Movidius. (2016, Jan. 27). Google and Movidius to enhance deep learning capabilities in next-gen devices. [Online]. Available: http://www. movidius. com/news/googleand-movidius-to-enhance-deep-learning-capabilities-in-next-gen-devices
33. Federal Trade Commission. (2015, Feb. 23). FTC cracks down on marketers of "melanoma detection" apps. [Online]. Available: www. ftc. gov/news-events/pressreleases/ 2015/02/ftc-cracks-down-marketers-melanoma-detection-apps