Perception-motivated interpolation of image sequences

ACM Transactions on Applied Perception

Volumn 8, Issue 2, 2011, Pages

  Stich, Timo ^a   Linz, Christian ^a   Wallraven, Christian ^b   Cunningham, Douglas ^c   Magnor, Marcus ^a  

^a TECHNICAL UNIVERSITY OF BRAUNSCHWEIG   (Germany)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^c UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Image interpolation; Morphing; Perception

Indexed keywords

COHERENT MOTION; HIGH QUALITY; HOMOGENEOUS REGIONS; HUMAN OBSERVERS; HUMAN VISION; IMAGE INTERPOLATIONS; IMAGE SEQUENCE; MORPHING; PERCEIVED QUALITY; PERCEPTION; USER STUDY; VISUAL QUALITIES;

INTERPOLATION;

EID: 79551714517     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1870076.1870079     Document Type: Article

References (65)

1. ADELSON, E. AND BERGEN, J. 1991. The plenoptic function and the elements of early vision. In Computational Models of Visual Processing, M. Landy and J. Movshon Eds., MIT Press, Cambridge, MA, 3-20.
2. BAKER, S. AND MATTHEWS, I. 2004. Lucas-Kanade 20 years on: A unifying framework. Int. J. Comput. Vision 56, 3, 221-255.
3. BAKER, S., SCHARSTEIN, D., LEWIS, J., TH, S. R., BLACK, M., AND SZELISKI, R. 2007. A database and evaluation methodology for optical flow. In Proceedings of the International Conference on Computer Vision (ICCV'07). IEEE, los Alamitos, CA, 1-8.
4. BARRON, J., FLEET, D., AND BEAUCHEMIN, S. 1994. Performance of optical flow techniques. Int. J. Comput. Vision 12, 1, 43-77.
5. BEIER, T. AND NEELY, S. 1992. Feature-based image metamorphosis. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH). ACM, New York, 35-42.
6. BELONGIE, S., MALIK, J., AND PUZICHA, J. 2001. Matching shapes. In Proceedings of the International Conference on Computer Vision (ICCV'01). IEEE, los Alamitos, CA, 454-461.
7. BERTSEKAS, D. 1992. Auction algorithms for network flow problems: A tutorial introduction. Comput. Optim. Appl. 1, 7-66.
8. BLACK, M. J. AND ANANDAN, P. 1996. The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. Comput. Vision Image Understand. 63, 1, 75-104.
9. BOUGUET, J. Y. 2000. Pyramidal implementation of the lucas-kanade feature tracker: Description of the algorithm. Tech. rep., Intel Microprocessor Research Labs.
10. BROX, T., BRUHN, A., PAPENBERG, N., AND WEICKERT, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proceedings of the European Conference on Computer Vision (ECCV'04). Springer-Verlag, Berlin, 25-36.
11. BRUHN, A., WEICKERT, J., AND SCHNÖRR, C. 2005. Lucas/kanade meets horn/schunck: Combining local and global optic flow methods. Int. J. Comput. Vision 61, 3, 211-231.
12. BUEHLER, C., BOSSE, M., MCMILLAN, L., GORTLER, S., AND COHEN, M. 2001. Unstructured Lumigraph Rendering. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'01). ACM, New York, 425-432.
13. CANNY, J. 1986. A computational approach to edge detection. Trans. Patt. Anal. Mach. Intell. 8, 679-714.
14. CARRANZA, J., THEOBALT, C., MAGNOR, M., AND SEIDEL, H. P. 2003. Free-viewpoint video Of human actors. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'03). ACM, New York, 569-577.
15. CHEN, S. AND WILLIAMS, L. 1993. View interpolation for image synthesis. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'93). ACM, New York, 279-288.
16. COOKE, T., CUNNINGHAM, D., AND BÜLTHOFF, H. 2004. The perceptual influence of spatiotemporal noise on the reconstruction of shape from dynamic occlusion. In Proceedings of the 26th DAGM Symposium on Pattern Recognition. Springer-Verlag, Berlin, 407-414.
17. CUNNINGHAM, D., SHIPLEY, T., AND KELLMAN, P. 1998. The dynamic specification of surfaces and boundaries. Perception 27, 4, 403-416.
18. DEBEVEC, P., BORSHUKOV, G., AND YU, Y. 1998. Efficient view-dependent image-based rendering with projective texturemapping. In Proceedings of the Eurographics Rendering Workshop (EGRW'98). Springer-Verlag, Berlin, 105-116.
19. EXNER, S. 1894. Entwurf zu einer physiologischen Erklärung der psychischen Erscheinungen. F. Deuticke, Leipzig Wien.
20. FELZENSZWALB, P. AND HUTTENLOCHER, D. 2004. Efficient graph-based image segmentation. Int. J. Comput. Vision 59, 167-181.
21. FU, M. F., AU, O., AND CHAN, W. C. 2002. Temporal interpolation using wavelet domain motion estimation and motion compensation. In Proceedings of the International Conference on Image Processing (ICIP'02). IEEE, los Alamtios, CA, 393-396.
22. GIBSON, J. 1955. The Perception of the Visual World. Cambridge University Press, Cambridg, UK.
23. GIBSON, J., KAPLAN, G., JR., H. R., AND WHEELER, K. 1969. The change from visible to invisible: a study of optic transitions. Percept. Psychophys. 5, 2, 116-131.
24. GORTLER, S., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. 1996. The Lumigraph. In Proceedings Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'96). ACM, New York, 43-54.
25. HARTLEY, R. AND ZISSERMAN, H. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge, UK.
26. HEEGER, D., BOYNTON, G., DEMB, J., SEIDEMANN, E., AND NEWSOME, W. 1999. Motion opponency in visual cortex. J. Neurosci. 19, 7162-7174.
27. HORN, B. AND SCHUNCK, B. 1981. Determining optical flow. Artif. Intell. 17, 185-203.
28. HUBEL, D. 1995. Eye, Brain, and Vision 2nd Ed. W. H. Freeman, New York.
29. ISAKSEN, A., MCMILLAN, L., AND GORTLER, S. 2000. Dynamically reparameterized light fields. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'00). ACM, New York, 297-306.
30. JAIN, J. AND JAIN, A. 1981. Displacement measurement and its application in interframe image coding. IEEE Trans. Comm. 29, 12, 1799-1808.
31. KELLMAN, P. J. AND SHIPLEY, T. F. 1992. Perceiving objects across gaps in space and time. Curr. Directions Psych. Science 1, 6, 193-199.
32. LEVOY, M. AND HANRAHAN, P. 1996. Light Field Rendering. In Proceedings Conference on Computer Graphics and Interactive Techniques (SIGGRAPH). 31-42.
33. LUCAS, B. AND KANADE, T. 1981. "an iterative image registration technique with an application to stereo vision". In Proceedings of the International Joint Conference on Artificial Intelligence. 674-679.
34. MARK, W., MCMILLAN, L., AND BISHOP, G. 1997. Post-Rendering 3D Warping. In Proceedings of the Symposium on Interactive 3D Graphics. 7-16.
35. MARR, D. 1983. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. W. H. Freeman.
36. MATUSIK, W., BUEHLER, C., RASKAR, R., GORTLER, S., AND MCMILLAN, L. 2000. Image-Based Visual Hulls. In Proceedings Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'00). 369-374.
37. MATUSIK, W. AND PFISTER, H. 2004. 3D TV: A scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. In Proceedings Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'04). ACM, New York 814-824.
38. MCMILLAN, L. AND BISHOP, G. 1995. Plenoptic modeling: an image-based rendering system. In Proceedings Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'95). ACM, New York, 39-46.
39. Microsoft Corporation. Media player 9 video quality demos. http://www.microsoft.com/windows/windowsmedia/demos/videoqualitydemos.aspx.
40. O'SULLIVAN, C., HOWLETT., S., MCDONNELL, R., MORVAN, Y., AND O'CONOR, K. 2004. Perceptually adaptive graphics. In Eurographics, State-of-the-art-Report 6.
41. PERONA, P. AND MALIK, J. 1990. Scale-space and edge detection using anisotropic diffusion. Trans. Patt. Anal. Mach. Intell. 12, 7, 629-639.
42. QIAN, N. AND ANDERSEN, R. 1997. A physiological model for motion-stereo integration and a unified explanation of Pulfrich-like phenomena. Vision Res. 37, 1683-1698.
43. RAMANARAYANAN, G., BALA, K., AND FERWERDA, J. 2008. Perception of complex aggregates. In Proceedings Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'08). ACM, New York, 1-10.
44. RAMANARAYANAN, G., FERWERDA, J., WALTER, B., AND BALA, K. 2007. Visual equivalence: Towards a new standard for image fidelity. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'07). ACM, New York, 654-663.
45. REICHARDT, W. 1961. Autocorrelation, A principle for the evaluation of sensory information by the central nervous system. In Sensory communication, W. Rosenblith Ed., MIT Press-Wiley, New York, 303-317.
46. RUZON, M. AND TOMASI, C. 1999. Color edge detection with the compass operator. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR'99). IEEE, los Alamitos, 160-166.
47. SCHAEFER, S., MCPHAIL, T., AND WARREN, J. 2006. Image deformation using moving least squares. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'06). ACM, New York, 533-540.
48. SEITZ, S. AND DYER, C. 1996. View morphing. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'96). ACM, New York, 21-30.
49. SHIPLEY, T. AND CUNNINGHAM, D. 2001. Perception of occluding and occluded objects over time: Spatiotemporal segmentation and unit formation. In From Fragments to Object: Segmentation and Grouping in Vision. Elsevier Science Ltd., Oxford, UK, 557-585.
50. SNAVELY, N., SEITZ, S., AND SZELISKI, R. 2006. Photo tourism: Exploring photo collections in 3D. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'06). ACM, New York, 835-846.
51. STICH, T., LINZ, C., ALBUQUERQUE, G., AND MAGNOR, M. 2008a. View and time interpolation in image space. Comput. Graphics Forum 27, 7, 1781-1787.
52. STICH, T., LINZ, C., WALLRAVEN, C., CUNNINGHAM, D., AND MAGNOR, M. 2008b. Perception motivated interpolation of image sequences. In Proceedings of the Symposium on Applied Perception in Graphics and Visualization (APGV'08). ACM, New York, 97-106.
53. TOURAPIS, A., CHEONG, H., LIOU, M., AND AU, O. 2001. Temporal interpolation of video sequences using zonal based algorithms. In Proceedings of the International Conference on Image Processing (ICIP'01). IEEE, los Alamitos, CA, 895-898.
54. VAN SANTEN, J. P. H. AND SPERLING, G. 1985. Elaborated reichardt detectors. J. Opt. Soc. Am. A, 2, 300-320.
55. VANGORP, P. AND DUTRÉ, P. 2008. Shape-dependent gloss correction. In Proceedings of the Symposium on Applied Perception in Graphics and Visualization (APGV'08). ACM, New York, 123-130.
56. VANGORP, P., LAURIJSSEN, J., AND DUTRÉ, P. 2007. The influence of shape on the perception of material reflectance. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'07). ACM, New York, 1-9.
57. VEDULA, S., BAKER, S., AND KANADE, T. 2005. Image based spatio-temporal modeling and view interpolation of dynamic events. ACM Trans. Graphics 24, 2, 240-261.
58. WALLACH, H. 1935. Ueber visuell wahrgenommene Bewegungsrichtung. Psychologische Forschung 20, 325-380.
59. WALLRAVEN, C., BÜLTHOFF, H. H., FISCHER, J., CUNNINGHAM, D. W., AND BARTZ, D. 2007. The evaluation of real-world and computer-generated stylized facial expressions. ACM Trans. Appl. Percept. 4, 3, 1-24.
60. WERTHEIMER, M. 1938. Laws of organization in perceptual forms. In A Source Book of Gestalt Psychology, W. Ellis, Ed. Kegan Paul, Trench, Trubner & Co. Ltd., London, 71-88.
61. WOLBERG, G. 1998. Image warping: a survey. Visual Comput. 14, 360-372.
62. WOOD, D., AZUMA, D., ALDINGER, K., CURLESS, B., DUCHAMP, T., SALESIN, D., AND STUETZLE, W. 2000. Surface light fields for 3D photography. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'00). ACM, New York, 287-296.
63. YUILLE, A. L. AND POGGIO, T. A. 1986. Scaling theorems for zero crossings. IEEE Trans. Pattern Anal. Mach. Intell. 8, 1, 15-25.
64. ZITNICK, C., JOJIC, N., AND KANG, S. B. 2005. Consistent segmentation for optical flow estimation. In Proceedings of the International Conference on Computer Vision (ICCV'05) 2, 1308-1315.
65. ZITNICK, C., KANG, S., UYTTENDAELE, M., WINDER, S., AND SZELISKI, R. 2004. High-quality video view interpolation using a layered representation. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'04). ACM, New York, 600-608.