Sketching Shiny Surfaces: 3D Shape Extraction and Depiction of Specular Surfaces

ACM Transactions on Applied Perception

Volumn 3, Issue 3, 2006, Pages 262-285

  Weidenbacher, Ulrich ^a   Bayerl, Pierre ^a   Neumann, Heiko ^a   Fleming, Roland ^b  

^a UNIVERSITY OF ULM   (Germany)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

3D shape perception; human visual perception; Nonphotorealistic rendering; perfectly specular surfaces

Indexed keywords

EID: 84992181765     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1166087.1166094     Document Type: Article

References (72)

1. Attneave, F. 1954. Some informational aspects of visual perception. Psychological Review 61, 183-193.
2. Bair, A., House, D., and Ware, C. 2005. A perceptually optimizing textures for layered surfaces. Applied Perception in Graphics and Visualization. 67-74.
3. Beck, J. and Prazdny, S. 1981. Highlights and the perception of glossiness. Perception & Psychophysics 30, 4, 407-410.
4. Benson, P. J. and Perrett, D. I. 1991. Perception and recognition of photographic quality facial caricatures: Implications for the recognition of natural images. European Journal of Cognitive Psychology 3, 1, 105-135.
5. Biederman, I. 1987. Recognition-by-components: A theory of human image understanding. Psychological Review 94, 2, 115-147.
6. Blake, A. 1985. Specular stereo. In Proceedings of the 9th International Joint Conference on Artificial Intelligence. 973-976.
7. Blake, A. and Brelstaff, G. 1988. Geometry from specularity. In Proceedings of ICCV. 394-403.
8. Blake, A. and Bulthoff, H. H. 1990. Does the brain know the physics of specular reflection? Nature (London) 343, 165-168. ACM Transactions on Applied Perception, Vol. 3, No. 3, July 2006.
9. Blake, A. and Bulthoff, H. H. 1991. Shape from specularities: Computation and psychophysics. Philosophical Transactions of the Royal Society of London B 331, 237-252.
10. Bruckstein, A. M. 1988. On shape from shading. Comput. Vision Graph. Image Process. 44, 2, 139-154.
11. Bullier, J. H., Mccourt, M. E., and Henry., G. H. 1988. Physiological studies of the feedback connection to the striate cortex from areas 18 and 19 of the cat. Exp. Brain Res. 70, 90-98.
12. Cabral, B. and Leedom, L. C. 1993. Image vector fields using line integral convolution. In SIGGRAPH. 263-270.
13. Chen, H., Liu, Z., C. Rose, Xu, Y., Shum, H., and Salesin, D. 2004. Example-based composite sketching of human portraits. In Proc. 3rd International Symposium on Non-Photorealistic Animation and Rendering.
14. Collomosse, J. P. and Hall, P. M. 2003. Cubist style rendering from photographs. IEEE Transactions on Visualization and Computer Graphics 9, 4, 443-453.
15. Curtis, C. J., Anderson, S. E., Seims, J. E., Fleischer, K. W., and Salesin, D. H. 1997. Computer-generated watercolor. In SIGGRAPH '97: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press/Addison-Wesley Publishing, New York. 421-430.
16. Daugman, J. 1988. Complete discrete 2d gabor transforms by neural networks for image analysis and compression. Trans. Acoustics, Speech, and Signal Proc. 36, 7, 1169-1179.
17. Debevec, P. E., Hawkins, T., Tchou, C., Duiker, H. P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. Computer Graphics (SIGGRAPH).
18. Decarlo, D. and Santella, A. 2002. Stylization and abstraction of photographs. ACM Trans. Graph. 21, 3, 769-776.
19. Deussen, O. and Strothotte, T. 2000. Computer-generated pen-and-ink illustration of trees. In SIGGRAPH. 13-18.
20. Do Carmo, M. P. 1976. Differential Geometry of Curves and Surfaces. Prentice Hall, Englewood Cliffs, NJ.
21. Durand, F., Ostromoukhov, V., Mathieu Miller, F. D., and Dorsey, J. 2001. Decoupling strokes and high-level attributes for interactive traditional drawing. in Proceedings of the 12th Eurographics Workshop on Rendering.
22. Dwyer, F. M. J. 1967. Adapting visual illustrations for effective learning. Harvard Educational Review 37, 250-263.
23. Feldman, J. and Singh, M. 2005. Information along contours and object boundaries. Psychological Review 112, 243-252.
24. Fleming, R., Torralba, A., and Adelson, E. Three Dimensional Shape Perception (in press). Springer, Chapter Shape From Sheen.
25. Fleming, R., Torralba, A., Dror, R. O., and Adelson, E. H. 2003. How image statistics drive shape-from-texture and shape-from-specularity. J. Vision 3, 9, 73.
26. Fleming, R. W., Torralba, A., and Adelson, E. H. 2004. Specular reflections and the perception of shape. J. Vision 4, 9, 798-820.
27. Fraisse, P. and Elkin, E. H. 1963. Etude genetique de l'influence des modes de presentation sur le seuil de reconnaissance d'objets familiers. Annee Psychologique 63, 1-12.
28. Gooch, A., Gooch, B., Shirley, P., and Cohen, E. 1998. A nonphotorealistic lighting model for automatic technical illustration. SIGGRAPH. 447-452.
29. Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and psychophysical evaluation. ACM Transactions on Graphics 23, 1, 27-44.
30. Grossberg, S. and Mingolla, E. 1985. Neural dynamics of form perception: Boundary completion, illusory figures and neon color spreading. Psych. Rev. 92, 2, 173-211.
31. Hadamard, J. 1902. Sur les problemes aux derivees partielles et leur signification physique. Princeton University Bulletin, 49-52.
32. Hartung, B. and Kersten, D. 2003. How does the perception of shape interact with the perception of shiny material? J. Vis. 3, 9 (10), 59.
33. Hausner, A. 2001. Simulating decorative mosaics. In SIGGRAPH. 573-580.
34. Hays, J. and Essa, I. 2004. Image and video based painterly animation. In NPAR '04: Proceedings of the 3rd International Symposium on Non-Photorealistic Animation and Rendering. ACM Press, New York. 113-120.
35. Hertzmann, A. 1998. Painterly rendering with curved brush strokes of multiple sizes. In SIGGRAPH. 453-460.
36. Horn, B. and BROOKS, M. 1985. Shape and source from shading. In Proceedings of International Joint Conference on Artificial Intelligence. 932-936.
37. Horn, B. and Brooks, M. 1989. Shape from Shading. Book, MIT Press, Cambridge, MA.
38. Hubel, D. H. and Wiesel, T. N. 1968. Receptive fields and functional architecture of monkey striate cortex. J. Physiology (London) 195, 215-243.
39. Ikeuchi, K. 1981. Recognition of 3-d objects using the extended gaussian image. In Proc. of the 7th International Joint Conference on Artificial Intelligence. 595-600.
40. Interrante, V. and Kim, S. 2001. Investigating the effect of texture orientation on shape perception. Proc. Human Vision and Electronic Imaging 6, 330-339.
41. Interrante, V., Kim, S., and Hagh-Shenas, H. 2002. Conveying 3d shape with texture: Recent advances and experimental findings. Proc. Human Vision and Electronic Imaging 7, 197-206.
42. Jin, W., Hujun, B., Weihua, Z., Qunsheng, P., and Yingqing, X. 2002. Automatic image-based pencil sketch rendering. J. Comput. Sci. Technol. 17, 3, 347-355.
43. Kang, H., He, W., Chui, C., and Chakraborty, U. 2005. Interactive sketch generation. The Visual Computer 21, 9, 821-830.
44. Kim, S., Hagh-Shenas, H., and Interrante, V. 2003. Showing shape with texture: Two directions seem better than one. In Proc. Human Vision and Electronic Imaging 8, 332-339.
45. Koenderink, J. and Van Doorn, A. 1980. Photometric invariants related to solid shape. Optica Acta 27, 7, 981-996.
46. Koenderink, J. J. 1984. What does the occluding contour tell us about solid shape. Perc. 13, 312-330.
47. Litwinowicz, P. 1997. Processing images and video for an impressionist effect. In SIGGRAPH '97: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press/Addison-Wesley Publishing, New York. 407-414.
48. Longuet-Higgins, M. S. 1960. Reflection and refraction at a random moving surface. i. pattern and paths of specular points. Journal of the Optical Society of America 50, 9, 838-844.
49. Neumann, H. and Sepp, W. 1999. Recurrent v1-v2 interactions in early boundary processing. Biol. Cybern. 81, 425-444.
50. Norman, J. F., Todd, J. T., and Orban, G. A. 2004. Perception of three-dimensional shape from specular highlights, deformations of shading, and other types of visual information. Psychological Science 15, 565-570.
51. Oren, M. and Nayar, S. 1996. A theory of specular surface geometry. Int. J. Computer Vision 24, 105-124.
52. Rhodes, G., Brennan, S., and Carey, S. 1987. Identification and ratings of caricatures: Implications for mental representations of faces. Cognitive Psychology 19, 473-497.
53. Ryan, T. and Schwartz, C. 1956. Speed of perception as a function of mode of presentation. American Journal of Psychology 69, 60-69.
54. Samaras, D. and Metaxas, D. 1999. Coupled lighting direction and shape estimation from single images. In ICCV '99: Proceedings of the International Conference on Computer Vision-Volume 2. IEEE Computer Society, Washington, DC. 868.
55. Sanderson, A. S., Weiss, L. E., and Nayar, S. K. 1988. Structured highlight inspection of specular surfaces. IEEE Trans. Pattern Anal. Mach. Intell. 10, 1, 44-55.
56. Savarese, S., Fei-Fei, L., and Perona, P. 2004. What do reflections tell us about the shape of a mirror? In Proc. Appl. Perc. in Graph. and Visual. 1, 115-118.
57. Savarese, S. and Perona, P. 2001. Local analysis for 3d reconstruction of specular surfaces. In Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 738-745.
58. Savarese, S. and Perona, P. 2002. Local analysis for 3d reconstruction of specular surfaces-part ii. In Proc. 7th European Conference on Computer Vision. 759-774.
59. Shiraishi, M. and Yamaguchi, Y. 2000. An algorithm for automatic painterly rendering based on local source image approximation. In NPAR '00: Proceedings of the 1st International Symposium on Non-Photorealistic Animation and Rendering. ACM Press, New York. 53-58.
60. Stalling, D. and Hege, H.-C. 1995. Fast and resolution independent line integral convolution. In SIGGRAPH. 249-256.
61. Tinbergen, N. 1951. The Study of Instinct. Clarendon, Oxford.
62. Tinbergen, N. and Perdeck, A. C. 1950. On the stimulus situation releasing the begging response in the newly hatched herring gull chick (larus argentatus argentatus pont). Behaviour 3, 1-39.
63. Todd, J. Andmingolla, E. 1983. Perception of surface curvature and direction of illumination from patterns of shading. Journal of Experimental Psychology: Human Perception and Performance 10, 740-745.
64. Todd, J., Norman, J., Koenderink, J., and Kappers, A. M. L. 1997. Effects of texture, illumination and surface reflectance on stereoscopic shape perception. Perception 26, 806-822.
65. Todd, J. T. 2004. The visual perception of 3d shape. Trends in Cognitive Sciences 9, 3, 115-121.
66. Todd, J. T., Norman, J. F., and Mingolla, E. 2004. Lightness constancy in the presence of specular highlights. Psychological Science 15, 1, 33-39.
67. Von Der Heydt, R., Peterhans, E., and Baumgartner, G. 1984. Illusory contours and cortical neuron responses. Science 224, 1260-1262.
68. Yamamoto, S., Mao, X., Tanii, K., and Imamiya, A. 2004. Enhanced lic pencil filter. Proceedings of International Conference on Computer Graphics, Imaging and Visualization. 251-256.
69. Zhang, R., Tsai, P.-S., Cryer, J. E., and Shah, M. 1999. Shape from shading: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 21, 8, 690-706.
70. Zheng, J. Y. and Murata, A. 2000. Acquiring a complete 3d model from specular motion under the illumination of circularshaped light sources. IEEE Trans. Pattern Anal. Mach. Intell. 22, 8, 913-920.
71. Zheng, Q. and Chellapa., R. 1991. Estimation of illuminant direction, albedo, and shape from shading. IEEE Transactions on Pattern Analysis and Machine Intelligence. 13, 7, 680-702.
72. Zisserman, A., Giblin, P. J., and Blake, A. 1989. The information available to a moving observer from specularities. Image Vision Comput. 7, 1, 38-42.