Humanistic computing: "WearComp" as a new framework and application for intelligent signal processing

Proceedings of the IEEE

Volumn 86, Issue 11, 1998, Pages 2123-2151

  Mann, Steve ^a,b  

^a UNIVERSITY OF TORONTO   (Canada)

^b IEEE   (Canada)

Author keywords

Consumer electronics; Cybernetic sciences; Human factors; Humanistic property protection; Image processing; Machine vision; Mobile communication; Photoquantigraphic imaging; Signals

Indexed keywords

ARTIFICIAL INTELLIGENCE; CAMERAS; COMPUTER VISION; CONSUMER ELECTRONICS; UNIX;

HUMANISTIC COMPUTING; PHOTOQUANTIGRAPHIC IMAGING;

DIGITAL SIGNAL PROCESSING;

EID: 0032205169     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/5.726784     Document Type: Article

References (75)

1. W. A. S. Buxton and R. M. Baecker, Readings in Human-Computer Interaction a Multidisciplinary Approach, ch. 1, 2, 1987.
2. S. Haykin, Neural Networks: A Comprehensive Foundation. New York: McMillan, 1994.
3. _, "Radar vision," presented at 2nd Int. Specialist Seminar Parallel Digital Processors, Portugal, Apr. 15-19, 1992.
4. D. E. Rumelhart and J. L. McMelland, Eds., Parallel Distributed Processing Cambridge, MA: MIT, 1986.
5. T. Poggio and F. Girosi, "Networks for approximation and learning," Proc. IEEE, vol. 78, pp. 1481-1487, Sept. 1990.
6. B. Kosko, Fuzzy Thinking: The New Science of Fuzzy Logic New York: Hyperion, 1993.
7. B. Kosko and S. Isaka, Fuzzy Logic, vol. 269. New York: Scientific American, 1993, pp. 76-81.
8. P. Laplante and M. Minsky, Eds., "Steps toward artificial intelligence," in Great Papers on Computer Science. St. Paul, MN: West 1996.
9. D. C. Engelbart, "Augmenting human intellect. A conceptual framework," Stanford Research Institute, Menlo Park, CA, Res. Rep. AFOSR-3223, 1962. [Online]. Available WWW: http://www.histech.rwth-aachen.de/www/quellen/ engelbart./ahi62index.html.
10. _, "A conceptual framework for the augmentation of man's intellect," in Vistas in Information Handling, P. D. Howerton and D. C. Weeks, Eds. Washington, DC: Spartan, 1963.
11. S. Mann and R. W. Picard, "Method and apparatus for relating and combining multiple images of the same scene or object(s)," U.S. Patent 5706416, Jan. 6, 1998.
12. S. Mann, "Wearable computing: A first step toward personal imaging," IEEE Trans. Comput., vol. 30, pp. 25-32, Feb. 1997. [Online]. Available WWW: http://hi.eecgitoronto.edu/ieeecomputer/index.html.
13. M. Foucault, Discipline and Punish (translated from Surveiller et Punir). New York: Pantheon, 1977.
14. S. M. Kosslyn, Image and Brain The Resolution of the Imagery Debate Cambridge, MA: MIT, 1994.
15. S. Mann, "'WearStation': With today's technology, it is now possible to build a fully equipped ham radio station, complete with internet connection, into your clothing," CQ-VHF, pp 1-46, Jan. 1997.
16. _, "Mediated reality'," Media Lab Perceptual Computing Section, MIT, Cambridge, MA, Tech. Rep. 260, 1994. [Online]. Available WWW: http://wearcam.org/ mediated-reality/index.html.
17. J. D. Meindl, "Low power microelectronics: Retrospect and prospect," Proc. IEEE, vol. 83, pp. 619-635, Apr. 1995.
18. S. Mann, "An historical account of the 'WearComp' and 'WearCam' projects developed for 'personal imaging'," presented at IEEE Int. Symp. Wearable Computing, Cambridge, MA, Oct. 13-14, 1997.
19. _, "Personal imaging," Ph.D. dissertation, MIT, Cambridge, MA, 1997.
20. _, "Further developments on 'headcam': Joint estimation of camera rotation + gain group of transformations for wearable bi-foveated cameras," in Proc. IEEE Int. Conf. Acoustics, Speech Signal Processing, Munich, Germany, Apr. 1997, vol. 4, pp. 2909-2912.
21. E. J. Lind and R. Eisler, "A sensate liner for personnel monitoring application," presented at IEEE Int. Symp. Wearable Computing, Oct. 13-14, 1997.
22. R. W. Picard and J. Healey, "Affective wearables," in Proc. 1st Int. Symp. Wearable Computers, Cambridge, MA, Oct. 1997, pp. 90-97.
23. S. Mann, "Smart clothing: The wearable computer and wearcam," Personal Technol., vol. 1, no. 1, pp. 21-27, Mar. 1997.
24. R. W. Picard, Affective Computing. Cambridge, MA: MIT, 1997.
25. D. Norman, Turn Signals Are the Facial Expressions of Automobiles. Reading, MA: Addison Wesley, 1992.
26. S. Mann, '"Smart clothing': Wearable multimedia and 'personal imaging' to restore the balance between people and their intelligent environments," in Proc. ACM Multimedia '96, Boston, MA, Nov. 18-22 1996, pp. 163-164.
27. _, "Humanistic intelligence," in Proc. Ars Electronica, Sept. 8-13, 1997, pp. 217-231, [Online]. Available WWW: http://wearcam.org/ars/; http://www.aec.at/fleshfactor.
28. _, "Lightspace," submitted for publication.
29. T. G. Stockham, Jr., "Image processing in the context of a visual model," Proc. IEEE, vol. 60, pp. 828-842, July 1972.
30. E. H. Land, "The retinex theory of color vision," Sci. Amer., pp. 108-129, 1977.
31. D. Forsyth, "A novel algorithm for color constancy," Int. J. Comput. Vision, vol. 5, no. 1, pp. 5-36, Aug. 1990.
32. A. N. Venetsanopoulos, "Nonlinear mean filters in image processing," IEEE Trans. Audio, Speech, Signal Processing, vol. 34, pp. 573-584, June 1986.
33. S. Mann, "Compositing multiple pictures of the same scene," in Proc. 46th Ann. IS&T Conference, Cambridge, MA, May 9-14, 1993, pp. 50-52.
34. _, "'Pencigraphy' with AGC: Joint parameter estimation in both domain and range of functions in same orbit of the projective-Wyckoff group," MIT Media Lab., Cambridge, MA, Tech. Rep. 384, Dec. 1994. [Online]. Available WWW: http://hi.eecg.toronto.edu/icip96/index.html. Also appears in Proc. IEEE Int. Conf. Image Processing (ICIP-96), Lausanne, Switzerland, pp. 193-196.
35. S. Mann and R. W. Picard, "Virtual bellows: Constructing high-quality images from video," in Proc. IEEE 1st Int. Conf. Image Processing, Austin, Texas, Nov. 13-16, 1994, pp. 363-367.
36. C. W. Wyckoff, "An experimental extended response film," S.P.I.E. Newslett., pp. 16-20, June-July 1962.
37. _, "An experimental extended response film," Edgerton, Germeshausen & Grier, Inc., Boston, MA, Tech. Rep. no. B-321, Mar. 1961.
38. O. D. Faugeras and F. Lustman, "Motion and structure from motion in a piecewise planar environment," Int. J. Pattern Recognition Artificial Intell., vol. 2, no. 3, pp. 485-508, 1988.
39. G. Adiv, "Determining 3D Motion and structure from optical flow generated by several moving objects," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 384-401, July 1985.
40. A. Shashua and N. Navab, "Relative Affine: Theory and application to 3D reconstruction from perspective views," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 1994, pp. 483-489.
41. H. S. Sawhney, "Simplifying motion and structure analysis using planar parallax and image warping," in Proc. 12th ICPR, vol. 1, Oct. 1994, pp. 403-408.
42. N. Navab and S. Mann, "Recovery of relative affine structure using the motion flow field of a rigid planar patch.," presented at Mustererkennung 1994, Tagungsband, Germany.
43. R. Kumar, P. Anandan, and K. Hanna, "Shape recovery from multiple views: A parallax based approach," presented at ARPA Image Understanding Workshop, Nov. 10, 1994.
44. W. A. Radlinski, Manual of Photogrammetry (Schaum's Outline series), 3rd ed., M. M. Thompson, R. C. Eller, and J. L. Speert, Eds. Falls Church, VA: McGraw-Hill, 1966.
45. M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP, vol. 53, pp. 231-239, May 1991.
46. A. M. Tekalp, M. K. Ozkan, and M. I. Sezan, "High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration," in Proc. IEEE Int. Conf. Acoustics, Speech Signal Processing, San Francisco, CA, Mar. 23-26, 1992, pp. 111-169.
47. L. Campbell and A. Bobick, "Correcting for radial lens distortion: A simple implementation," MIT Media Lab., Perceptual Computing Sect., Cambridge, MA, Tech. Rep. 322, Apr. 1995.
48. K. Levenberg, "A method for the solution of certain nonlinear problems in least squares," Quart. J. of Appl. Math., vol. 2, pp. 164-168, 1944.
49. D. W. Marquardt, "An algorithm for the estimation of nonlinear parameters," SIAM J., vol. 11, pp. 431-441, 1963.
50. R. Szeliski and J. Coughlan, "Hierarchical spline-based image registration," CVPR, pp. 194-201, June 1994.
51. S. Mann and R. W. Picard, "Video orbits of the projective group; a simple approach to featureless estimation of parameters," MIT, Cambridge, MA, Tech. Rep. 338. [On-line]. Available WWW: http://n1nlf-1.eecg.toronto.edu/tip.html, 1995. Also appears in IEEE Trans. Image Processing, vol. 6, pp. 1281-1295, Sept. 1997.
52. S. S. Beauchemin, J. L. Barron, and D. J. Fleet, "Systems and experiment performance of optical flow techniques," Int. J. Comput. Vision, vol. 12, no. 1, pp. 43-77, 1994.
53. Q. Zheng and R. Chellappa, "A computational vision approach to image registration," IEEE Trans. Image Processing, vol. 2, pp. 311-325, July 1993.
54. L. Teodosio and W. Bender, "Salient video stills: Content and context preserved," in Proc. ACM Multimedia Conf., New York, Aug. 1993, pp. 39-46.
55. R. Y. Tsai and T. S. Huang, "Estimating three-dimensional motion parameters of a rigid planar patch," Trans. Acoustics, Speech, Signal Processing, vol. 29, no. 6, pp. 1147-1152, Dec. 1981.
56. M. Artin, Algebra. Englewood Cliffs, NJ: Prentice-Hall, 1991.
57. W. C. Hoffman, "The lie algebra of visual perception," J. Math. Psychology, vol. 4, pp. 348-349, 1967.
58. R. I. Hartley, "Self-calibration of stationary cameras," G.E., Schenectady, NY, Tech. Rep. 12301.
59. B. Horn and B. Schunk, "Determining optical flow," Artificial Intell., 1981.
60. B. Girod and D. Kuo, "Direct estimation of displacement histograms," presented at OSA Meeting Image Understanding Machine Vision, June 1989.
61. Y. Sheng, C. Lejeune, and H. H. Arsenault, "Frequency-domain Fourier-Mellin descriptors for invariant pattern recognition," Opt. Eng., vol. 27, no. 5, pp. 354-357, May 1988.
62. S. Mann, "Wavelets and chirplets: Time-frequency perspectives, with applications," in Advances in Machine Vision, Strategies and Applications (World Scientific series in computer science), 32nd ed., Pctriu Archibald, Ed. Singapore: World Scientific, 1992.
63. R. Wilson, A. D. Calway, and E. R. S. Pearson, "A generalized wavelet transform for Fourier analysis: The multiresolution Fourier transform and its application to image and audio signal analysis," IEEE Trans. Inform. Theory, vol. 38, pp. 674-690, Mar. 1992.
64. S. R. Curtis and A. V. Oppenheim, "Signal reconstruction from Fourier transform sign information," MIT Res. Lab. Electron., Cambridge, MA, Tech. Rep. 500, May 1984.
65. S. Mann and R. W. Picard, "Being 'undigital' with digital cameras: Extending dynamic range by combining differently exposed pictures," MIT Media Lab. Perceptual Comput. Sec., Boston, MA, Tech. Rep. 323, 1994. Also appears in Proc. IS&T's 48th Ann. Conf., Washington, DC, May 1995, pp. 422-428. [Online]. Available WWW: http://wearcam.org/ist98.htm
66. J. Campbell, "QuickTime VR," Oct. 18, 1996. [Online]. Available WWW: http://www.webreference. com/content/qtvr/.
67. I. Kohler, The Formation and Transformation of the Perceptual World, vol. 3 of Psychological Issues [monograph 12]. New York: International Univ. Press, 1964.
68. H. Dolezal, Living in a World Transformed (Academic Press series in cognition and perception). Chicago: Academic, 1982.
69. S. Feiner, B. MacIntyre, and D. Seligmann, "Knowledge-based augmented reality," Commun. ACM, vol. 36, no. 7, pp. 52-62, July 1993.
70. S. Feiner, A. Webster, T. Krueger, B. MacIntyre, and E. Keller, "Architectural anatomy," Presence, vol. 4, no. 3, pp. 318-325, 1995.
71. S. Mann. (1994). Wearable wireless webcam [Online]. Available WWW: http://wearcam.org.
72. R. E. Cytowic, Synesthesia: A Union of the Senses. New York: Springer-Verlag, 1989.
73. S. Mann and S. Haykin, "The chirplet transform: Physical considerations," IEEE Trans. Signal Processing, vol. 43, no. 11, pp. 2745-2761, Nov. 1995.
74. M. Weiser. (1988-1994). Ubiquitous computing [Online]. Available WWW: http://sandbox.parc. xerox.com/ubicomp.
75. J. Cooperstock. Reactive room [Online]. Available WWW: http://www.dgp.toronto.edu/rroom/ research/papers/.