Crowdsourcing step-by-step information extraction to enhance existing how-to videos

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2014, Pages 4017-4026

  Kim, Juho ^a   Nguyen, Phu ^a   Weir, Sarah ^a   Guo, Philip J ^b   Miller, Robert C ^a   Gajos, Krzysztof Z ^c  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF ROCHESTER   (United States)

^c HARVARD UNIVERSITY   (United States)

Author keywords

Crowdsourcing; How to videos; Video annotation

Indexed keywords

TEXT PROCESSING;

CROWDSOURCING; HOW-TO VIDEOS; INTERACTIVE VIDEO; INTERMEDIATE RESULTS; LEARNING EXPERIENCES; MECHANICAL TURKS; VIDEO ANNOTATIONS; VISUAL ANNOTATIONS;

HUMAN ENGINEERING;

EID: 84900391682     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2556288.2556986     Document Type: Conference Paper

References (33)

1. Altman, D. G. Practical statistics for medical research, vol. 12. CRC Press, 1991
2. Bandura, A. Self-efficacy: Toward a unifying theory of behavioral change. Psychological review 84, 2 (1977), 191
3. Banovic, N., Grossman, T., Matejka, J., and Fitzmaurice, G. Waken: Reverse engineering usage information and interface structure from software videos. In VIST '12 (2012)
4. Bernstein, M. S., Brandt, J., Miller, R. C., and Karger, D. R. Crowds in two seconds: Enabling realtime crowd-powered interfaces. In VIST '11, ACM (2011)
5. Bernstein, M. S., Little, G., Miller, R. C., Hartmann, B., Ackerman, M. S., Karger, D. R., Crowell, D., and Panovich, K. Soylent: A word processor with a crowd inside. In VIST '10 (2010), 313-322
6. Bernstein, M. S., Teevan, J., Dumais, S., Liebling, D., and Horvitz, E. Direct answers for search queries in the long tail. In CHI '12' (2012), 237-246
7. Catrambone, R. The subgoal learning model: Creating better examples so that students can solve novel problems. Journal of Experimental Psychology: General 127, 4 (1998), 355
8. Chi, P.-Y., Ahn, S., Ren, A., Dontcheva, M., Li, W., and Hartmann, B. Mixt: Automatic generation of step-by-step mixed media tutorial. In VIST '12 (2012)
9. Chi, P.-Y. P., Liu, J., Linder, J., Dontcheva, M., Li, W., and Hartmann, B. Democut: Generating concise instructional videos for physical demonstrations. In VIST '13, ACM (2013)
10. Dow, S. P., Glassco, A., Kass, J., Schwarz, M., Schwartz, D. L., and Klemmer, S. R. Parallel prototyping leads to better design results, more divergence, and increased self-efficacy. ACM Trans. Comput.-Hum. Interact. 17, 4 (Dec. 2010), 18:1-18:24
11. Eiriksdottir, E., and Catrambone, R. Procedural instructions, principles, and examples: How to structure instructions for procedural tasks to enhance performance, learning, and transfer. Hum Factors 53, 6 (2011), 749-70
12. Ester, M., Kriegel, H.-P., Sander, J., and Xu, X. A density-based algorithm for discovering clusters in large spatial databases with noise. In KDD, vol. 96 (1996)
13. Ferguson, E. L., and Hegarty, M. Learning with real machines or diagrams: Application of knowledge to real-world problems. Cognition and Instruction 13, 1 (1995), 129-160
14. Grabler, F., Agrawala, M., Li, W., Dontcheva, M., and Igarashi, T. Generating photo manipulation tutorials by demonstration. In SIGGRAPH '09 (2009), 1-9
15. Grossman, T., Matejka, J., and Fitzmaurice, G. Chronicle: Capture, exploration, and playback of document workflow histories. In VIST '10 (2010)
16. Hadidi, R., and Sung, C.-H. Students' acceptance of web-based course offerings: An empirical assessment. AMCIS 1998 (1998)
17. Jaro, M. A. Advances in record-linkage methodology as applied to matching the 1985 census of tampa, florida. Journal of the American Statistical Association 84, 406 (1989), 414-120
18. Kim, J. Toolscape: Enhancing the learning experience of how-to videos. In CHI EA '13 (2013), 2707-2712
19. Kuhn, H. W. The hungarian method for the assignment problem. Naval research logistics quarterly 2, 1-2 (1955), 83-97
20. Lafreniere, B., Grossman, T., and Fitzmaurice, G. Community enhanced tutorials: Improving tutorials with multiple demonstrations. In CHI'13 (2013), 1779-1788
21. Lasecki, W. S., Song, Y. C., Kautz, H., and Bigham, J. P. Real-time crowd labeling for deployable activity recognition. In CSCW '13 (2013), 1203-1212
22. Li, F. C., Gupta, A., Sanocki, E., He, L.-w., and Rui, Y. Browsing digital video. In CHI '00, ACM (2000)
23. Nguyen, P., Kim, J., and Miller, R. C. Generating annotations for how-to videos using crowdsourcing. In CHI EA ' 13, ACM (2013), 835-840
24. Noronha, J., Hysen, E., Zhang, H., and Gajos, K. Z. Platemate: Crowdsourcing nutritional analysis from food photographs. In VIST ' 11 (2011), 1-12
25. Park, S., Mohammadi, G., Artstein, R., and Morency, L.-P. Crowdsourcing micro-level multimedia annotations: The challenges of evaluation and interface. In CrowdMM Workshop (2012)
26. Pongnumkul, S., Dontcheva, M., Li, W., Wang, J., Bourdev, L., Avidan, S., and Cohen, M. Pause-and-play: Automatically linking screencast video tutorials with applications. In VIST 2011 (2011)
27. Schunk, D. Goal setting and self-efficacy during self-regulated learning. Educational psychologist 25, 1 (1990), 71-86
28. Tversky, B., Morrison, J. B., and Betrancourt, M. Animation: Can it facilitate? International journal of human-computer studies 57, 4 (2002), 247-262
29. van der Meij, H., Blijleven, P., and Jansen, L. What makes up a procedure? Content & Complexity (2003)
30. Vondrick, C., Ramanan, D., and Patterson, D. Efficiently scaling up video annotation with crowdsourced marketplaces. In ECCV2010. Springer, 2010, 610-623
31. Yuen, J., Russell, B., Liu, C., and Torralba, A. Labelme video: Building a video database with human annotations. In ICCV2009, IEEE (2009), 1451-1458
32. Zhang, D., Zhou, L., Briggs, R. O., and Jr., J. F. N. Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & Management 43, 1 (2006), 15-27
33. Zimmerman, B. J., Bandura, A., and Martinez-Pons, M. Self-motivation for academic attainment: The role of self-efficacy beliefs and personal goal setting. American Educational Research Journal 29, 3 (1992), 663-676.