An Analysis of Machine- and Human-Analytics in Classification

IEEE Transactions on Visualization and Computer Graphics

Volumn 23, Issue 1, 2017, Pages 71-80

  Tam, Gary K L ^a   Kothari, Vivek ^b   Chen, Min ^b  

^a SWANSEA UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

classification; decision tree; facial expression; information theory; model; Visual analytics; visualization image

Indexed keywords

ARTIFICIAL INTELLIGENCE; DECISION THEORY; DECISION TREES; INFORMATION THEORY; LEARNING SYSTEMS; MODELS; VISUALIZATION;

CLASSIFICATION MODELS; COGNITIVE PROCESS; DECISION TREE MODELING; FACIAL EXPRESSIONS; MACHINE LEARNING APPROACHES; PARALLEL COORDINATES; VISUAL ANALYTICS; VISUALIZATION IMAGES;

CLASSIFICATION (OF INFORMATION);

ARTICLE; COGNITION; DECISION TREE; HUMAN; HUMAN EXPERIMENT; INFORMATION SCIENCE; MACHINE LEARNING; REASONING; THEORETICAL STUDY;

EID: 84999287019     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2016.2598829     Document Type: Article

References (51)

1. B. Alsallakh, A. Hanbury, H. Hauser, S. Miksch, and A. Rauber. Visual methods for analyzing probabilistic classification data. IEEE Transac-tions on Visualization and Computer Graphics, 20(12):1703-1712, 2014.
2. M. F. Amasyali and O. K. Ersoy. Comparison of single and ensemble classifiers in terms of accuracy and execution time. In Proc. Innovation Intelligent System Applications, 2011.
3. R. K. Anderson. Visual Data Mining: The VisMiner Approach. Wiley-Blackwell, 2012.
4. M. Ankerst, C. Elsen, M. Ester, and H.-P. Kriegel. Visual classification: An interactive approach to decision tree construction. In Proc. 5th ACM SIGKDD, pages 392-396, 1999.
5. M. Babaee, S. Tsoukalas, G. Rigoll, and M. Datcu. Visualization-based active learning for the annotation of SAR images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(10):4687-4698, 2015.
6. H. Bay, T. Tuytelaars, and L. Van Gool. Speeded up robust features (SURF). Computer Vision and Image Understanding, 110(3):346-359, 2008.
7. C. M. Bishop. Pattern Recognition and Machine Learning. Springer, New York, 2006.
8. L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone. Classification and Regression Trees. Chapman & Hall, New York, 1984.
9. R. Caruana, Y. Lou, J. Gehrke, P. Koch, M. Sturm, and N. Elhadad. In-telligible models for health care: Predicting pneumonia risk and hospital 30-day readmission. In Proc. 21th ACM SIGKDD, pages 1721-1730, 2015.
10. R. Caruana and A. Niculescu-Mizil. An empirical comparison of super-vised learning algorithms. In Proc. 23rd International Conference on Machine Learning, pages 161-168, 2006.
11. M. Chen and A. Golan. What may visualization processes optimize? IEEE Transactions on Visualization and Computer Graphics, online preprint, 2015.
12. M. Chen and H. Jänicke. An information-theoretic framework for visu-alization. IEEE Transactions on Visualization and Computer Graphics, 16(6):1206-1215, 2010.
13. S. Cheng and K. Mueller. The data context map: Fusing data and at-tributes into a unified display. IEEE Transactions on Visualization and Computer Graphics, 22(1):121-130, 2016.
14. T. M. Cover and J. A. Thomas. Elements of Information Theory. John Wiley & Sons, 2nd edition, 2006.
15. R. J. Crouser, B. Hescott, and R. Chang. Toward complexity measures for systems involving human computation. Human Computation, 1(1):4565, 2014.
16. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray. Visual categorization with bags of keypoints. In Proc. Workshop on Statistical Learning in Computer Vision, pages 1-22, 2004.
17. P. Domingos. A few useful things to know about machine learning. Com-munications of the ACM, 55(10):78-87, Oct. 2012.
18. H. L. Dreyfus and S. E. Dreyfus. What artificial experts can and cannot do. AI & Society, 6(1):18-26, 1992.
19. M. Fahle and T. Poggio. Visual hyperacuity: Spatiotemporal interpola-tion in human vision. Proceedings of the Royal Society of London B: Biological Sciences, 213(1193):451-477, 1981.
20. H. Fang, N. M. Parthaláin, A. J. Aubrey, G. K. L. Tam, R. Borgo, P. L. Rosin, P.W. Grant, D. Marshall, and M. Chen. Facial expression recogni-tion in dynamic sequences: An integrated approach. Pattern Recognition, 47(3):1271-1281, 2014.
21. H. Fang, G. K. L. Tam, R. Borgo, A. J. Aubrey, P. W. Grant, P. L. Rosin, C. Wallraven, D. W. Cunningham, D. Marshall, and M. Chen. Visual-izing natural image statistics. IEEE Transactions on Visualization and Computer Graphics, 19(7):1228-1241, 2013.
22. S. García and F. Herrera. An extension on "statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons. Journal of Machine Learning Research, 9:2677-2694, 2008.
23. T. Hancock, T. Jiang, M. Li, and J. Tromp. Lower bounds on learning decision lists and trees. Information and Computation, 126(2):114-122, 1996.
24. Z. S. Harris. Distributional structure. Word, 10(23):146162, 1954.
25. B. Höferlin, R. Netzel, M. Höferlin, D. Weiskopf, and G. Heidemann. Inter-active learning of ad-hoc classifiers for video visual analytics. In Proc. IEEE Conference on Visual Analytics Science and Technology, pages 23-32, 2012.
26. L. Hyafil and R. L. Rivest. Constructing optimal binary decision trees is np-complete. Information Processing Letters, 5(1):15-17, 1976.
27. L. Itti and P. F. Baldi. Bayesian surprise attracts human attention. In Ad-vances in Neural Information Processing Systems, Vol. 19 (NIPS∗2005), pages 547-554, 2006.
28. A. Kapoor, B. Lee, D. Tan, and E. Horvitz. Interactive optimization for steering machine classification. In Proc. SIGCHI Conference on Human Factors in Computing Systems, pages 1343-1352, 2010.
29. A. Kapoor, B. Lee, D. Tan, and E. Horvitz. Performance and preferences: Interactive refinement of machine learning procedures. In Proc. AAAI Conference on Artificial Intelligence, 2012.
30. H. Kim, J. Choo, H. Park, and A. Endert. Interaxis: Steering scatterplot axes via observation-level interaction. IEEE Transactions on Visualization and Computer Graphics, 22(1):131-140, Jan 2016.
31. S. B. Kotsiantis. Supervised machine learning: a review of classification techniques. Informatica, 31(3):249-268, 2007.
32. A. Krizhevsky. Learning multiple layers of features from tiny images. Master's thesis, Dept. Computer Science, University of Toronto, 2009.
33. P. A. Legg, D. H. S. Chung, M. L. Parry, R. Bown, M. W. Jones, I. W. Griffiths, and M. Chen. Transformation of an uncertain video search pipeline to a sketch-based visual analytics loop. IEEE Transactions on Visualization and Computer Graphics, 19(12):2109-2118, 2013.
34. Z. Liao, Y. Yu, and B. Chen. Anomaly detection in gps data based on visual analytics. In Proc. IEEE Symposium on Visual Analytics Science and Technology, pages 51-58, 2010.
35. T. Löwe, E. C. Förster, G. Albuquerque, J. P. Kreiss, and M. Magnor. Visual analytics for development and evaluation of order selection criteria for autoregressive processes. IEEE Transactions on Visualization and Computer Graphics, 22(1):151-159, 2016.
36. T. May, A. Bannach, J. Davey, T. Ruppert, and J. Kohlhammer. Guiding feature subset selection with an interactive visualization. In Proc. IEEE Conference on Visual Analytics Science and Technology, pages 111-120, 2011.
37. M. Migut and M.Worring. Visual exploration of classification models for risk assessment. In Proc. IEEE Symposium on Visual Analytics Science and Technology, pages 11-18, 2010.
38. T. M. Mitchell. Machine Learning. McGraw-Hill, 1997.
39. S. A. Nene, S. K. Nayar, and H. Murase. Columbia object image library (coil-100), cucs-006-96. Technical report, Columbia University, 1996.
40. S. J. D. Prince. Computer Vision: Models, Learning, and Inference. Cam-bridge University Press, 2012.
41. J. R. Quinlan. Induction of decision trees. Machine Learning, 1(1):81-106, 1986.
42. J. R. Quinlan. C4.5: Programs for Machine Learning. Morgan Kauf-mann, San Francisco, 1993.
43. M. Röhlig, M. Luboschik, F. Krüger, T. Kirste, H. Schumann, M. Bögl, B. Alsallakh, and S. Miksch. Supporting activity recognition by visual analytics. In Proc. IEEE Conference on Visual Analytics Science and Technology, pages 41-48, 2015.
44. D. Sacha, M. Sedlmair, L. Zhang, J. A. Lee, D. Weiskopf, S. C. North, and D. A. Keim. Human-centered machine learning through interactive visualization: Review and open challenges. In Proc. 24th European Sym-posium on Artificial Neural Networks, 2016.
45. C. E. Shannon. A mathematical theory of communication. Bell System Technical Journal, 27:379-423, 1948.
46. M. Sokolova and G. Lapalme. A systematic analysis of performance mea-sures for classification tasks. Information Processing and Management, 45(4):427-437, 2009.
47. G. K. L. Tam, H. Fang, A. J. Aubrey, P. W. Grant, P. L. Rosin, D. Mar-shall, and M. Chen. Visualization of time-series data in parameter space for understanding facial dynamics. Computer Graphics Forum, 30(3):901-910, 2011.
48. C.-H. Teh and R. Chin. On image analysis by the methods of mo-ments. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(4):496-513, 1988.
49. S. van den Elzen and J. van Wijk. Baobabview: Interactive construc-tion and analysis of decision trees. In Proc. IEEE Conference on Visual Analytics Science and Technology, pages 151-160, 2011.
50. K. Xu, J. L. Ba, R. Kiros, K. Cho, A. Courville, R. Salakhudinov, R. S. Zemel, and Y. Bengio. Show, attend and tell: Neural image caption gen-eration with visual attention. In Proc. 32nd International Conference on Machine Learning, pages 2048-2057, 2015.
51. J. Yosinski, J. Clune, A. Nguyen, T. Fuchs, and H. Lipson. Understand-ing neural networks through deep visualization. In Proc. Deep Learning Workshop, 32nd International Conference on Machine Learning, 2015.