Eliciting good teaching from humans for machine learners

Artificial Intelligence

Volumn 217, Issue , 2014, Pages 198-215

  Cakmak, Maya ^a   Thomaz, Andrea L ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b Georgia Institute of Technology   (United States)

Author keywords

Algorithmic teaching; Interactive machine learning

Indexed keywords

INTERACTIVE MACHINE LEARNING; MACHINE LEARNERS;

EID: 84908399351     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2014.08.005     Document Type: Article

References (45)

1. S. Amershi, J. Fogarty, A. Kapoor, D. Tan, Effective end-user interaction with machine learning, in: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2012, pp.1529-1532.
2. D. Angluin, Queries and concept learning, Mach. Learn. 2 (1988) 319-342.
3. F. Balbach, T. Zeugmann, Recent developments in algorithmic teaching, in: Proceedings of the 3rd International Conference on Language and Automata Theory and Applications, 2009, pp.1-18.
4. Y. Bengio, J. Louradour, R. Collobert, J. Weston, Curriculum learning, in: L. Bottou, M. Littman (Eds.), Proceedings of the 26th International Conference on Machine Learning, Montreal, June 2009, pp.41-48.
5. M. Cakmak, M. Lopes, Algorithmic and human teaching of sequential decision tasks, in: Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2012, pp.1536-1542.
6. M. Cakmak, A. Thomaz, Mixed-initiative active learning, in: ICML 2011 Workshop on Combining Learning Strategies to Reduce Label Cost, 2011.
7. H. Chernoff, The use of faces to represent points in k -dimensional space graphically, J. Am. Stat. Assoc. 68(342) (1973) 361-368.
8. A. Culotta, T. Kristjansson, A. McCallum, P. Viola, Corrective feedback and persistent learning for information extraction, Artif. Intell. 170(14-15) (2006)
9. S. Dasgupta, Coarse sample complexity bounds for active learning, in: Advances in Neural Information Processing Systems (NIPS), 2006, pp.235-242.
10. F. Denis, R. Gilleron, PAClearning under helpful distributions, in: 8th International Workshop on Algorithmic Learning Theory, in: Lect. Notes Artif. Intell., vol.1316, Springer-Verlag, 1997, pp.132-145.
11. O. Deniz, J. Lorenzo, M. Castrillon, J. Mendez, A. Falcon, Learning to recognize faces incrementally, in: Proceedings of the 29th DAGM Conference on Pattern Recognition, Springer-Verlag, Berlin, Heidelberg, 2007, pp.365-374.
12. J. Elman, Learning and development in neural networks: the importance of starting small, Cognition 48 (1993) 71-99.
13. J. Fails, D. Olsen, A design tool for camera-based interaction, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2003, pp.449-456.
14. J. Fogarty, D. Tan, A. Kapoor, S. Winder, Cueflik: interactive concept learning in image search, in: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, 2008, pp.29-38.
15. S. Goldman, M. Kearns, On the complexity of teaching, J. Comput. Syst. Sci. 50(1) (February 1995) 20-31.
16. Y. Huang, T.M. Mitchell, Text clustering with extended user feedback, in: Proceedings of the 29th ACM SIGIR Conference on Research and Development in Information Retrieval, 2006, pp.413-420.
17. C. Isbell, C. Shelton, M. Kearns, S. Singh, P. Stone, Cobot: a social reinforcement learning agent, in: Proceedings of the 5th International Conference on Autonomous Agents, 2001, pp.377-384.
18. A. Kapoor, B. Lee, D. Tan, E. Horvitz, Interactive optimization for steering machine classification, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2010, pp.1343-1352.
19. F. Khan, X. Zhu, B. Mutlu, How do humans teach: on curriculum learning and teaching dimension, in: Advances in Neural Information Processing Systems (NIPS), 2011.
20. A. Kittur, E.H. Chi, B. Suh, Crowdsourcing user studies with mechanical turk, in: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, 2008, pp.453-456.
21. W. Knox, P. Stone, Training a tetris agent via interactive shaping: a demonstration of the tamer framework, in: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2010, pp.1767-1768.
22. T. Kristjansson, A. Culotta, P. Viola, A. McCallum, Interactive information extraction with constrained conditional random fields, in: Proceedings of the National Conference on Artificial Intelligence (AAAI), 2004, pp.412-418.
23. T. Kulesza, S. Stumpf, M. Burnett, I. Kwan, Tell me more? The effects of mental model soundness on personalizing an intelligent agent, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2012, pp.1-10.
24. C.H. Lampert, H. Nickisch, S. Harmeling, Learning to detect unseen object classes by between-class attribute transfer, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, pp.951-958.
25. Y. Lee, K. Grauman, Learning the easy things first: Self-paced visual category discovery, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp.1721-1728.
26. N. Littlestone, Learning quickly when irrelevant attributes abound: a new linear-threshold algorithm, Mach. Learn. 2 (1988) 285-318.
27. J. MacGregor, The effects of order on learning classifications by example: heuristics for finding the optimal order, Artif. Intell. 34(3) (1988) 361-370.
28. M. Mascolo, Change processes in development: the concept of coactive scaffolding, New Ideas Psychol. 23 (2005) 185-196.
29. H.D. Mathias, A model of interactive teaching, J. Comput. Syst. Sci. 54(3) (1997) 487-501.
30. B. McCandliss, J. Fiez, A. Protopapas, M. Conway, J. McClelland, Success and failure in teaching the [r]-[l] contrast to Japaneseadults: tests of a Hebbianmodel of plasticity and stabilization in spoken language perception, Cogn. Affect. Behav. Neurosci. 2(2) (2002) 89-108.
31. S. Rosenthal, A. Dey, Towards maximizing the accuracy of human-labeled sensor data, in: International Conference on Intelligent User Interfaces (IUI), 2010, pp.259-268.
32. J. Ross, L. Irani, M.S. Silberman, A. Zaldivar, B. Tomlinson, Who are the crowdworkers?: Shifting demographics in mechanical turk, in: Proceedings of the 28th of the International Conference Extended Abstracts on Human Factors in Computing Systems, 2010, pp.2863-2872.
33. P. Shafto, N. Goodman, Teaching games: statistical sampling assumptions for learning in pedagogical situations, in: Proceedings of the 30th Annual Conference of the Cognitive Science Society, 2008, pp.1-6.
34. M. Shilman, D. Tan, P. Simard, Cuetip: a mixed-initiative interface for correcting handwriting errors, in: Proceedings of the 19th Annual ACM Sympo-sium on User Interface Software and Technology, 2006, pp.323-332.
35. A. Singla, I. Bogunovic, G. Bartok, A. Karbasi, A. Krause, Near-optimally teaching the crowd to classify, arXiv preprint, arXiv:1402.2092, 2014.
36. P. Stone, M. Veloso, Layered learning, in: R.L. de Mantaras, E. Plaza (Eds.), Proceedings of the Eleventh European Conference on Machine Learning, May/June 2000, Barcelona, Catalonia, Spain, Springer Verlag, 2000, pp.369-381.
37. S. Stumpf, V. Rajaram, L. Li, W. Wong, M. Burnett, T. Dietterich, E. Sullivan, J. Herlocker, Interacting meaningfully with machine learning systems: three experiments, Int. J. Hum.-Comput. Stud. 67(8) (2009) 639-662.
38. S. Stumpf, E. Sullivan, E. Fitzhenry, I. Oberst, W. Wong, M. Burnett, Integrating rich user feedback into intelligent user interfaces, in: Proceedings of the 13th International Conference on Intelligent User Interfaces (IUI), 2008, pp.50-59.
39. M. Taylor, Assisting transfer-enabled machine learning algorithms: Leveraging human knowledge for curriculum design, in: Proc. AAAI Spring Sympo-sium on Agents that Learn from Human Teachers, 2009.
40. J. Tenenbaum, V. Silva, J. Langford, A global geometric framework for nonlinear dimensionality reduction, Science 290 (2000) 2319-2323.
41. A.L. Thomaz, Socially guided machine learning, Ph.D. thesis, Massachusetts Institute of Technology, 2006.
42. A.L. Thomaz, C. Breazeal, Reinforcement learning with human teachers: evidence of feedback and guidance with implications for learning performance, in: Proceedings of the 21st National Conference on Artificial Intelligence (AAAI), 2006, pp.1000-1005.
43. L. VonAhn, L. Dabbish, Labeling images with a computer game, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2004, pp.319-326.
44. R. Warner, T. Stoess, P. Shafto, Reasoning in teaching and misleading situations, in: Proceedings of the 33rd Annual Conference of the Cognitive Science Society, 2011, pp.1430-1435.
45. J. Whitehill, A stochastic optimal control perspective on affect-sensitive teaching, Ph.D. thesis, University of California, San Diego, 2012.