A Machine Learning Based Framework for Verification and Validation of Massive Scale Image Data

IEEE Transactions on Big Data

Volumn 7, Issue 2, 2021, Pages 451-467

  Ding, Junhua ^a   Hu, Xin Hua ^a   Gudivada, Venkat ^a  

^a EAST CAROLINA UNIVERSITY   (United States)

Author keywords

Big data; deep learning; diffraction image; machine learning; metamorphic testing

Indexed keywords

ITERATIVE METHODS; LARGE DATASET; MACHINE LEARNING; SOFTWARE TESTING; TURING MACHINES; VERIFICATION;

BIG DATA APPLICATIONS; EXPERIMENTAL APPROACHES; FEATURE SELECTION ALGORITHM; MACHINE LEARNING APPROACHES; SCIENTIFIC SOFTWARES; TEST COVERAGE CRITERIA; VERIFICATION OF SOFTWARES; VERIFICATION-AND-VALIDATION;

LEARNING ALGORITHMS;

EID: 85107351059     PISSN: None     EISSN: 23327790     Source Type: Journal    
DOI: 10.1109/TBDATA.2017.2680460     Document Type: Article

References (55)

1. V. Gudivada, R. Raeza-Yates, and V. Raghavan, "Big data: Promises and problems, " IEEE Comput., vol. 48, no. 3, pp. 20-23, Mar. 2015.
2. Y. Bengio, "Learning deep architectures for AI, " Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
3. Apache, "Hadoop, " 2016. [Online]. Available: http://hadoop. apache.org/
4. V. Gudivada, D. Rao, and V. Raghavan, "Renaissance in database management: Navigating the landscape of candidate systems, " IEEE Comput., vol. 49, no. 4, pp. 31-42, Apr. 2016.
5. D. Rao, V. N. Gudivada, and V. V. Raghavan, "Data quality issues in big data, " in Proc. IEEE Int. Conf. Big Data Workshop Data Qual, Oct. 2015, pp. 2654-2660.
6. J. Zhang, et al., "Analysis of cellular objects through diffraction images acquired by flow cytometry, " Opt. Express, vol. 21, no. 21, pp. 24 819-24 828, 2013.
7. T. Y. Chen, S. C. Cheung, and S. Yiu, "Metamorphic testing: A new approach for generating next test cases, " Dept. Comput. Sci., Hong Kong Univ. Sci. Technol., Tech. Rep. HKUST-CS98-01, 1998.
8. J. Ding, D. Zhang, and X. Hu, "An application of metamorphic testing for testing scientific software, " presented at the 1st Int. Workshop Metamorphic Testing ICSE, Austin, TX, USA, May 2016.
9. U. Kanewala and J. M. Bieman, "Testing scientific software: A systematic literature review, " Inf. Softw. Technol., vol. 56, no. 10, pp. 1219-1232, 2014.
10. S. Segura, G. Fraser, A. Sanchez, and A. Ruiz-Cortes, "A survey on metamorphic testing, " IEEE Trans. Softw. Eng., vol. 42, no. 9, pp. 805-824, Sep. 2016.
11. R. Maximilian and T. Poggio, "Models of object recognition, " Nature Neuroscience, vol. 3, pp. 1199-1204, 2000.
12. K. Jacobs, J. Lu, and X. Hu, "Development of a diffraction imaging flow cytometer, " Opt. Lett., vol. 34, no. 19, pp. 2985-2987, 2009.
13. Mongodb, 2016. [Online]. Available: https://www.mongodb.com/
14. Mongochef, 2016. [Online]. Available: http://3t.io/mongochef/
15. M. Yurkin and A. Hoekstra, "User manual for the discrete dipole approximation code ADDA 1.3b4, " 2014. [Online]. Available: https://github.com/adda-Team/adda/tree/master/doc
16. ADDA project, 2016. [Online]. Available: https://github.com/adda-Team/adda
17. C. Hsu, C.-C. Chang, and C.-J. Lin, "A practical guide to support vector classification, " Nat. Taiwan Univ., Taipei, Taiwan, 2003, [Online]. Available: http://www.csie.ntu.edu.tw/cjlin/papers/guide/guide.pdf
18. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning, " Nature, vol. 521, pp. 436-444, May 2015.
19. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks, " in Proc. Advances Neural Inf. Process. Syst., 2012, pp. 1097-1105.
20. R. Haralick, "On a texture-context feature extraction algorithm for remotely sensed imagery, " in Proc. IEEE Comput. Soc. Conf. Decision Control, 1971, pp. 650-657.
21. K. Dong, et al., "Label-free classification of cultured cells through diffraction imaging, " Biomed. Opt. Express, vol. 2, no. 6, pp. 1717-1726, 2011.
22. R. M. Haralick, K. Shanmugan, and I. H. Dinstein, "Textural features for image classification, " IEEE Trans. Syst. Man Cybern., vol. SMC-3, no. 6, pp. 610-621, Nov. 1973.
23. S. K. Thati, J. Ding, D. Zhang, and X. Hu, "Feature selection and analysis of diffraction images, " presented at the 4th IEEE Int. Workshop Inf. Assurance, Vancouver, Canada, 2015.
24. J. Dixon and J. Ding, "An empirical study of parallel solution for GLCM calculation of diffraction images, " 38th Annu. Intl. Conf. IEEE Eng. Med. Biol. Soc., Orlando, FL, Aug. 2016.
25. T. Kanungo, D. Mount, N. Netanyahu, C. Piatko, R. Silverman, and A. Wu, "An efficient k-means clustering algorithm: Analysis and implementation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 881-892, Jul. 2012.
26. M. A. Hall, "Correlation-based feature selection for machine learning, " PhD dissertation, Dept. Comput. Sci., Univ. Waikato, Hamilton, New Zealand, 1999.
27. E. Gibney, "Google AI algorithm masters ancient game of go, " Nature, vol. 529, pp. 445-446, Jan. 2016.
28. M. Moran, "Correlating the morphological and light scattering properties of biological cells, " PhD dissertation, Dept. Dept. Phys., East Carolina Univ., Greenville, NC, USA, 2013.
29. R. Pan, Y. Feng, Y. Sa, J. Lu, K. Jacobs, and X. Hu, "Analysis of diffraction imaging in non-conjugate configurations, " Opt. Express, vol. 22, no. 25, pp. 31568-31574, 2014.
30. X. Yang, et al., "A quantitative method for measurement of HL-60 cell apoptosis based on diffraction imaging flow cytometry technique, " Biomed. Opt. Express, vol. 5, no. 7, pp. 2172-2183, 2014.
31. M. Zhang, "A deep learning based classification of large scale biomedical images, " ProjectReport-MS-CS-17-0011, East Carolina University, Greenville, NC, Nov. 2016.
32. Y. Feng, et al., "Polarization imaging and classification of Jurkat T and Ramos B cells using a flow cytometer, " Cytometry A, vol. 85, no. 11, pp. 817-826, 2014.
33. C.-C. Chang and C.-J. Lin, "LIBSVM, " 2016. [Online]. Available: https://www.csie.ntu.edu.tw/cjlin/libsvm/
34. Caffe project, 2016. [Online]. Available: http://caffe. berkeleyvision.org/
35. J. Mayer and R. Guderlei, "An empirical study on the selection of good metamorphic relations, " in Proc. 30th Annu. Int. Comput. Softw. Appl. Conf., 2006, pp. 475-484.
36. U. Kanewala, J. M. Bieman, and A. Ben-Hur, "Predicting metamorphic relations for testing scientific software: A machine learning approach using graph kernels, " J. Softw. Testing Verification Rel., vol. 26, no. 3, pp. 245-269, 2015.
37. J. Ding, T. Wu, J. Q. Lu, and X. Hu, "Self-checked metamorphic testing of an image processing program, " presented at the 4th IEEE Int. Conf. Secur. Softw. Integr. Rel. Improvement, Singapore, 2010.
38. J. Ding, D. Zhang, and X. Hu, "A framework for ensuring the quality of a big data service, " presented at the 13th IEEE Int. Conf. Services Comput., San Francisco, CA, 2016.
39. W. E. Wong and A. Mathur, "Reducing the cost of mutation testing: An experimental study, " J. Syst. Softw., vol. 31, no. 3, pp. 185-196, 1995.
40. Y. Jia and M. Harman, "An analysis and survey of the development of mutation testing, " IEEE Trans. Softw. Eng., vol. 37, no. 5, pp. 649-678, Sep./Oct. 2011.
41. L. Cai and Y. Zhu, "The challenges of data quality and data quality assessment in the big data era, " Data Sci. J., vol. 14, no. 2, pp. 1-10, 2015.
42. J. Gao, C. Xie, and C. Tao, "Big data validation and quality assurance-issuses, challenges, and needs, " in Proc. IEEE Symp. Service-Oriented Syst. Eng., Mar. 2016, pp. 433-441.
43. X. Dong et al., "Knowledge-based trust: Estimating the trustworthiness of web sources, " Proc. VLDB Endowment, vol. 8, no. 9, pp. 938-949, May 2015.
44. X. Yin, J. Han, and P. S. Yu, "Truth discovery with multiple conflicting information providers on the web, " IEEE Trans. Knowl. Data Eng., vol. 20, no. 6, pp. 796-808, Jun. 2008.
45. C. H. Wu and Y. Song, "Robust and distributed web-scale neardup document conflation in Microsoft academic service, " in Proc. IEEE Int. Conf. Big Data, Oct. 2015, pp. 2606-2611.
46. Apache samza, 2016. [Online]. Available: http://samza.apache. org/
47. J. A. Saez, B. Krawczyk, and M. Wozniak, "On the influence of class noise in medical data classification: Treatment using noise filtering methods, " Appl. Artif. Intell., vol. 30, no. 6, pp. 590-609, Jul. 2016.
48. M. Yousef, D. S. D. Müserref, W. Khalifa, and J. Allmer, "Feature selection has a large impact on one-class classification accuracy for microRNAs in plants, " Advances Bioinf., vol. 2016, 2016, Art. no. 5670851.
49. F. Min, Q. Hu, and W. Zhu, "Feature selection with test cost constraint, " Int. J. Approximate Reasoning, vol. 55, no. 1, pp. 167-179, 2014.
50. H. A. L. Thi, H. M. Le, and T. P. Dinh, "Feature selection in machine learning: An exact penalty approach using a difference of convex function algorithm, " Mach. Learn., vol. 101, no. 1-3, pp. 163-186, 2015.
51. H. Liu, F.-C. Kuo, D. Towey, and T. Chen, "How effectively does metamorphic testing alleviate the oracle problem?" IEEE Trans. Softw. Eng., vol. 40, no. 1, pp. 4-22, Jan. 2014.
52. V. Le, M. Afshari, and Z. Su, "Compiler validation via equivalence modulo inputs, " in Proc. 35th ACM SIGPLAN Conf. Program. Language Des. Implementation, 2014, pp. 216-226.
53. M. Lindvall, D. Ganesan, R. Ardal, and R. E. Wiegand, "Metamorphic model-based testing applied on NASA DAT: An experience report, " in Proc. 37th Int. Conf. Softw. Eng., May 2015, vol. 2, pp. 129-138.
54. Z. Zhou, S. Xiang, and T. Chen, "Metamorphic testing for software quality assessment: A study of search engines, " IEEE Trans. Softw. Eng., vol. 42, no. 3, pp. 264-284, Mar. 2016.
55. C. Nie and H. Leung, "A survey of combinatorial testing, " ACM Comput. Survey, vol. 43, no. 2, pp. 1-29, Feb. 2011.