Motion capture from body-mounted cameras

ACM Transactions on Graphics

Volumn 30, Issue 4, 2011, Pages

  Shiratori, Takaaki ^a   Park, Hyun Soo ^b   Sigal, Leonid ^a   Sheikh, Yaser ^b   Hodginsy, Jessica K ^a,b  

^a DISNEY RESEARCH   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Articulated motion; Motion capture; Structure from motion; Wearable cameras

Indexed keywords

ARTICULATED MOTION; GLOBAL MOTION; JOINT ANGLE; MOTION CAPTURE; MOTION CAPTURE DATA; MOTION CAPTURE SYSTEM; MOTION RECONSTRUCTION; NON-LINEAR OPTIMIZATION; OPTIMIZATION OBJECTIVE FUNCTION; SKELETON STRUCTURE; STRUCTURE FROM MOTION; TEMPORAL CONTINUITY; THEORY AND PRACTICE; WEARABLE CAMERAS;

IMAGE MATCHING; INTERACTIVE COMPUTER GRAPHICS; OPTICAL SYSTEMS; OPTIMIZATION;

CAMERAS;

EID: 80051864215     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1964921.1964926     Document Type: Article

References (37)

1. AGARWAL, S., SNAVELY, N., SIMON, I., SEITZ, S. M., AND SZELISKI, R. 2009. Building Rome in a day. In Proc. International Conference on Computer Vision, 72-79.
2. BALLAN, L., PUWEIN, J., BROSTOW, G., AND POLLETEYS, M. 2010. Unstructured video-based rendering: Interactive exploration of casually captured videos. ACM Transactions on Graphics 29, 4.
3. CHEUNG, G. K., BAKER, S., AND KANADE, T. 2003. Shapefrom- silhouette of articulated objects and its use for human body kinematics estimation and motion capture. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 77-84.
4. CORAZZA, S., MüNDERMANN, L., CHAUDHARI, A., DEMATTIO, T., COBELLI, C., AND ANDRIACCHI, T. 2006. A markerless motion capture system to study musculoskeletal biomechanics: Visual hull and simulated annealing approach. Annals of Biomedical Engineering 34, 6, 1019-1029. (Pubitemid 43954334)
5. CORAZZA, S., GAMBARETTO, E., MÜNDERMANN, L., AND ANDRIACCHI, T. 2010. Automatic generation of a subject-specific model for accurate markerless motion capture and biomechanical applications. IEEE Transactions on Biomedical Engineering 57, 4, 806-812.
6. DAVISON, A., REID, I., MOLTON, N., AND STASSE, O. 2007. MonoSLAM: Real-time single camera SLAM. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 6, 1052-1067. (Pubitemid 46667415)
7. DEUTSCHER, J., AND REID, I. 2005. Articulated body motion capture by stochastic search. International Journal of Computer Vision 61, 2, 185-205.
8. DEVERNAY, F., AND FAUGERAS, O. 2000. Straight lines have to be straight. Machine Vision and Applications 13, 1, 14-24. (Pubitemid 32774944)
9. DUNCAN, J. 2010. Avatar. Cinefex 120 (January), 68-146.
10. FISCHLER, M., AND BOLLES, R. 1981. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24, 6, 381-395. (Pubitemid 12444102)
11. FRAHM, J.-M., GEORGEL, P., GALLUP, D., JOHNSON, T., RAGURAM, R., WU, C., JEN, Y.-H., DUNN, E., CLIPP, B., LAZEBNIK, S., AND POLLEFEYS, M. 2010. Building Rome on a cloudless day. In Proc. European Conference on Computer Vision, 368-381.
12. HARTLEY, R. I., AND ZISSERMAN, A. 2004. Multiple View Geometry in Computer Vision. Cambridge University Press.
13. HASLER, N., ROSENHAHN, B., THORMÄHLEN, T., WAND, M., GALL, J., AND SEIDEL, H.-P. 2009. Markerless motion capture with unsynchronized moving cameras. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 224-231.
14. KELLY, P., CONAIRE, C. Ó., AND O'CONNOR, N. E. 2010. Human motion reconstruction using wearable accelerometers. In Proc. ACM SIGGRAPH / Eurographics Symposium on Computer Animation (Poster).
15. KLEIN, G., AND MURRAY, D. 2007. Parallel tracking and mapping for small AR workspaces. In Proc. IEEE and ACM International Symposium on Mixed and Augmented Reality, 225-234.
16. LEPETIT, V., MORENO-NOGUER, F., AND FUA, P. 2009. EPnP: An accurate O(n) solution to the PnP problem. International Journal of Computer Vision 81, 2, 155-166.
17. LOURAKIS, M. A., AND ARGYROS, A. 2009. SBA: A software package for generic sparse bundle adjustment. ACM Transactions on Mathematical Software 36, 1, 1-30.
18. LOWE, D. 2004. Distinctive image features from scale-invariant key points. International Journal of Computer Vision 60, 2, 91-110.
19. MOESLUND, T. B., HILTON, A., AND KRÜ GER, V. 2006. A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding 104, 90-126. (Pubitemid 44573873)
20. MUJA, M., AND LOWE, D. G. 2009. Fast approximate nearest neighbors with automatic algorithm configuration. In Proc. International Conference on Computer Vision Theory and Application, 331-340.
21. NÍSTER, D., NARODITSKY, O., AND BERGEN, J. 2006. Visual odometry for ground vehicle applications. Journal of Field Robotics 23, 1, 3-20.
22. O'BRIEN, J. F., BODENHEIMER, R. E., BROSTOW, G. J., AND HODGINS, J. K. 2000. Automatic joint parameter estimation from magnetic motion capture data. In Proc. Graphics Interface, 53-60.
23. OSKIPER, T., ZHU, Z., SAMARASEKERA, S., AND KUMAR, R. 2007. Visual odometry system using multiple stereo cameras and inertial measurement unit. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition
24. POLLEFEYS, M., GOOL, L. V., VERGAUWEN, M., VERBIEST, F., CORNELIS, K., TOPS, J., AND KOCH, R. 2004. Visual modeling with a hand-held camera. International Journal of Computer Vision 59, 3, 207-232.
25. RASKAR, R., NII, H., DE DECKER, B., HASHIMOTO, Y., SUMMET, J., MOORE, D., ZHAO, Y., WESTHUES, J., DIETZ, P., INAMI, M., NAYAR, S., BARNWELL, J., NOLAND, M., BEKAERT, P., BRANZOI, V., AND BRUNS, E. 2007. Prakash: Lighting-aware motion capture using photosensing markers and multiplexed illuminators. ACM Transactions on Graphics 26, 3.
26. SCHWARZ, L. A., MATEUS, D., AND NAVAB, N. 2010. Multipleactivity human body tracking in unconstrained environments. In Proc. International Conference on Articulated Motion and Deformable Objects, 192-202.
27. SLYPER, R., AND HODGINS, J. K. 2008. Action capture with accelerometers. In Proc. ACM SIGGRAPH / Eurographics Symposium on Computer Animation.
28. SNAVELY, N., SEITZ, S. M., AND SZELISKI, R. 2006. Photo tourism: Exploring photo collections in 3D. ACM Transactions on Graphics 25, 3, 835-846. (Pubitemid 44481045)
29. TAUTGES, J., ZINKE, A., KRÜ GER, B., BAUMANN, J., WEBER, A., HELTEN, T., MÜLLER, M., SEIDEL, H.-P., AND EBERHARDT, B. 2011. Motion reconstruction using sparse accelerometer data. ACM Transactions on Graphics 30, 3.
30. VLASIC, D., ADELSBERGER, R., VANNUCCI, G., BARNWELL, J., GROSS, M., MATUSIK, W., AND POPOVIć, J. 2007. Practical motion capture in everyday surroundings. ACM Transactions on Graphics 26, 3, 35.
31. WELCH, G., AND FOXLIN, E. 2002. Motion tracking: No silver bullet, but a respectable arsenal. IEEE Computer Graphics and Applications 22, 6, 24-38. (Pubitemid 35421716)
32. WELCH, G., BISHOP, G., VICCI, L., BRUMBACK, S., KELLER, K., AND COLUCCI, D. 1999. The HiBall tracker: Highperformance wide-area tracking for virtual and augmented environments. In Proc. ACM Symposium on Virtual Reality Software and Technology, 1-10.
33. WOLTRING, H. 1974. New possibilities for human motion studies by real-time light spot position measurement. Biotelemetry 1, 3.
34. XIE, L., KUMAR, M., CAO, Y., GRACANIN, D., AND QUEK, F. 2008. Data-driven motion estimation with low-cost sensors. In Proc. International Conference on Visual Information Engineering.
35. ZHANG, Z., WU, Z., CHEN, J., AND WU, J.-K. 2009. Ubiquitous human body motion capture using micro-sensors. In Proc. IEEE International Conference on Pervasive Computing and Communications.
36. ZHU, Z., OSKIPER, T., SAMARASEKERA, S., SAWHNEY, H., AND KUMAR, R. 2007. Ten-fold improvement in visual odometry using landmark matching. In Proc. International Conference on Computer Vision.
37. ZHU, Z., OSKIPER, T., SAMARASEKERA, S., KUMAR, R., AND SAWHNEY, H. 2008. Real-time global localization with a prebuilt visual landmark database. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition.