Materializing movement-designing for movement-based digital interaction

International Journal of Design

Volumn 8, Issue 1, 2014, Pages 29-42

  Hansen, Lise Amy ^a   Morrison, Andrew ^a  

^a OSLO SCHOOL OF ARCHITECTURE AND DESIGN   (Norway)

Author keywords

Communication; Design materials; Full body movement; Interaction design; Social semiotics; Visualization

Indexed keywords

EID: 84899787300     PISSN: 19913761     EISSN: 1994036X     Source Type: Journal    
DOI: None     Document Type: Article

References (92)

1. Ashbrook, D., & Starner, T. (2010). Magic: A motion gesture design tool. In G. Fitzpatrick, C. Hudson, K. Edwards, & T. Rodden (Eds.), Proceedings of the 28th International Conference on Human Factors in Computing Systems. New York, NY: ACM press.
2. Bacigalupi, M. (1998). The craft of movement in interaction design. In T. Catarci, M. F. Costabile, G. Santucci, & L. Taranfno (Eds.), Proceedings of the Working Conference on Advanced Visual Interfaces (pp. 174-184). New York, NY: ACM press.
3. Badler, N. I., & Smoliar, S. W. (1979). Digital representations of human movement. ACM Computing Surveys, 11(1), 19-38.
4. Bastien, M. (2007). Notation-in-progress. In S. deLahunta (Ed.), Capturing intention (pp. 48-55). Amsterdam, the Netherlands: Emio Greco |PC and Amsterdam School of the Arts.
5. Birringer, J. (2002). Dance and media technologies. A Journal of Performance and Art, 24(1), 84-93.
6. Blaauw, G. A., & Brooks, F. P. (1997). Computer architecture: Concepts and evolution. Reading, MA: Addison-Wesley.
7. Bleeker, M. (2008). Visuality in the theatre: The locus of looking. Basingstoke, UK: Palgrave Macmillan.
8. Blevis, E., Lim, Y. -K., & Stolterman, E. (2006). Regarding software as a material of design. In Proceedings of International Conference of Design Research Society. Lisbon, Portugal: Instituto de Artes Visuais.
9. Boehner, K., Sengers, P., & Warner, S. (2008). Interfaces with the ineffable: Meeting aesthetic experience on its own terms. ACM Transactions on Computer-Human Interaction, 15(3), 1-29.
10. Carlson, K., Schiphorst, T., & Shaw, C. (2011). ActionPlot: A visualization tool for contemporary dance analysis. In S. N. Spencer (Ed.), Proceedings of the International Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging(pp. 113-120). New York, NY: ACM Press.
11. Chi, D., Costa, M., Zhao, L., & Badler, N. (2000). The EMOTE model for effort and shape. In J. R. Brown, & K, Akeley (Eds.), Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (pp. 173-182). New York, NY: ACM Press.
12. Csordas, T. J. (2002). Body/meaning/healing. Basingstoke, UK: Palgrave.
13. Dearden, A. (2006). Designing as a conversation with digital materials. Design Studies, 27(3), 399-421.
14. Dutta, T. (2012). Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. Applied Ergonomics, 43(4), 645-649.
15. Eikenes, J. O. H., & Morrison, A. (2010) Navimation: Exploring time, space & motion in the design of screen based interfaces. International Journal of Design, 4(1), 1-16.
16. Farnell, B. (1999a). It goes without saying - But not always. In T. J. Bucklans (Ed.), Dance in the feld: Theory, methods, and issues in dance ethnography (pp. 145-160). Basingstoke, UK: Macillan.
17. Farnell, B. (1999b). Moving bodies, acting selves. Annual Review of Anthropology, 28, 341-373.
18. Farnell, B., & Varela, C. R. (2008). The second somatic revolution. Journal for the Theory of Social Behaviour, 38(3), 215-240.
19. Foster, S. L. (1995). Choreographing history. Bloomington, IN: Indiana University Press.
20. Foster, S. L. (1998). Choreographies of gender. Signs, 24(1), 1-33.
21. Franko, M. (1995). Mimique. In J. S. Murphy, & E. W. Goellner (Eds.), Bodies of the text (pp. 205-216). New Brunswick, Canada: Rutgers University Press.
22. Fry, B. (2007). Visualizing data. Beijing, China: O'Reilly.
23. Gaver, W. (2011). Making spaces: How design workbooks work. In G. Fitzpatrick, C. Gutwin, B. Begole, & W. A. Kellogg (Eds.), Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (pp. 1551-1560). New York, NY: ACM Press.
24. Gavrila, D. M. (1999). The visual analysis of human movement: A survey. Computer Vision and Image Understanding, 73(1), 82-98.
25. Goffman, E. (1959). The presentation of self in everyday life. Garden City, NY: Doubleday.
26. Goffman, E. (1986). Frame analysis. Boston, MA: Northeastern University Press.
27. Goodwin, C. (1994). Professional vision. American Anthropologist, 96(3), 606-633.
28. Guest, A. H. (1989). Choreo-graphics: A comparison of dance notation systems from the ffteenth century to the present. New York, NY: Gordon and Breach.
29. Guest, A. H. (2005). Labanotation: The system of analyzing and recording movement. New York, NY: Routledge.
30. Haigh, T. (2009). How data got its base: Information Storage Software in the 1950s and 1960s. Annals of the History of Computing, 31(4), 6-25.
31. Hall, E. T. (1966). The hidden dimension. New York, NY: Anchor books, Doubleday.
32. Halliday, M. A. K., & Matthiessen, C. M. I. M. (2004). An introduction to functional grammar. London, UK: Arnold.
33. Hallnäs, L. (2011). On the foundations of interaction design aesthetics: Revisiting the notions of form and expression. International Journal of Design, 5 (1).
34. Hallnäs, L., Melin, L., & Redström, J. (2002). Textile displays: Using textiles to investigate computational technology as design material. Proceedings of the 2nd Nordic Conference on Human-Computer Interaction.
35. Hansen, L. A. (2011). Full-body movement as material for interaction design. Digital Creativity, 22(4), 247-262.
36. Hansen, L. A. (2013). Making do & making new - Performative moves into interaction design. International Journal of Performance Arts and Digital Media, 9(1), 133-149.
37. Hollan, J., & Stornetta, S. (1992). Beyond being there. In P. Bauerdfeld, J. Bennett, & G. Lynch (Eds.), Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 119-125). New York, NY: ACM Press.
38. Horaud, R., Niskanen, M., Dewaele, G., & Boyer, E. (2009). Human motion tracking by registering an articulated surface to 3D points and normals. Intell Pattern Analysis and Machine Intelligence, IEEE Transactions, 31(1), 158-163.
39. Hummels, C., Overbeeke, K. C., & Klooster, S. (2007). Move to get moved: A search for methods, tools and knowledge to design for expressive and rich movement-based interaction. Personal Ubiquitous Computing 11(8), 677-690.
40. Ingold, T. (2007). Lines: A brief history. London, UK: Routledge.
41. Kendon, A. (1990). Conducting interaction. Cambridge, UK: Cambridge University Press.
42. Kendon, A. (1995). Sociality, social interaction, and sign language in aboriginal Australia. In B. Farnell (Ed.), Human action signs in cultural context:The visible and the invisible in movement and dance. Metuchen, NJ: Scarecrow Press.
43. Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge, UK: Cambridge University Press.
44. Kirsch, D. (2013). Embodied cognition and the magical future of interaction design. ACM Transactions on Computer-Human Interaction, 20(1), 1-30.
45. Klemmer, S. R., Hartmann, B., & Takayama, L. (2006). How bodies matter: Five themes for interaction design. In S. Bødker, & J. Coughlin (Eds.), Proceedings of the 6th conference on Designing Interactive systems (pp. 140-149). New York, NY: ACM Press.
46. Knapp, M. L., & Hall, J. A. (2006). Nonverbal communication in human interaction. Belmont, CA: Thomson/Wadsworth.
47. Koskinen, I. (2011). Design research through practice: From the lab, feld, and showroom. Waltham, MA: Morgan Kaufmann.
48. Kress, G., & van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. London, UK: Arnold.
49. Kulkarni, K., Boyer, E., Horaud, R., & Kale, A. (2011). An Unsupervised Framework for Action Recognition Using Actemes. In R. Kimmel, R. Klette, & A. Sugimoto (Eds.), Computer Vision ACCV 2010 (Vol. 6495, pp. 592-605). Berlin & Heidelberg, Germany: Springer.
50. Levin, G. (n.d.). Ask me anything video for FITC. Retrieved 2 December, 2012, from https://vimeo.com/35858119
51. Loke, L., & Robertson, T. (2013). Moving and making strange: An embodied approach to movement-based interaction design. ACM Transactions on Computer-Human Interaction, 20(1), 1-25.
52. Löwgren, J., & Stolterman, E. (2004). Thoughtful interaction design: A design perspective on information technology. Cambridge, MA: The MIT Press.
53. Lucena, M., Blanca, N. P., Fuertes, J. M., & Marín-Jiménez, M. J. (2009). Human Action Recognition Using Optical Flow Accumulated Local Histograms. In H. Araujo, A. Mendonça, A. Pinho, & M. a. s. Torres (Eds.), Pattern Recognition and Image Analysis (Vol. 5524, pp. 32-39). Berlin & Heidelberg, Germany: Springer.
54. Mazé, R., & Redström, J. (2005). Form and the computational object. Digital Creativity, 16(1), 7-18.
55. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
56. Moeslund, T. B., Hilton, A., & Krüger, V. (2006). A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding, 104(2), 90-126.
57. Morrison, A. (2010) (Ed.). Inside multimodal composition. Cresskill, NJ: Hampton Press.
58. Morrison, J. B., & Tversky, B. (2005). Bodies and their parts. Memory & cognition, 33(4), 696-709.
59. Newlove, J., & Dalby, J. (2009). Laban for all. London, UK: Nick Hern books.
60. Niebles, J. C., Chen, C.-W., & Fei-Fei, L. (2010). Modeling temporal structure of decomposable motion segments for activity classifcation. Proceedings of the 11th European conference on Computer vision (pp. 392-405). Berlin & Heidelberg, Germany: Springer.
61. Noland, C. (2009). Agency & embodiment - Performing gestures/Producing culture. Cambridge, MA.: Harvard University Press.
62. Nordby, K. (2010). Conceptual designing and technology: Short-range RFID as design material. International Journal of Design, 4(1), 29-44.
63. Pers, J., Sulic, V., Kristan, M., Perse, M., Polanec, K., & Kovacic, S. (2010). Histograms of optical fow for effcient representation of body motion. Pattern Recognition Letters, 31(11), 1369-1376.
64. Poppe, R. (2007). Vision-based human motion analysis: An overview. Computer vision and image understanding, 108(1-2), 4-18.
65. Poppe, R. (2010). A survey on vision-based human action recognition. Image Vision Computing, 28(6), 976-990.
66. Puri, R., & Hart-Johnson, D. (1995). Thinking with movement: improvising versus composing? In B. Farnell (Ed.), Human action signs in cultural context: The visible and the invisible in movement and dance (pp. 158-181). Metuchen, NJ.: Scarecrow Press.
67. Reed, S. A. (1998). The politics and poetics of dance. Annual Review of Anthropology, 27, 503-532.
68. Sanders, E. B. N., & Stappers, P. J. (2008). Co-creation and the new landscapes of design. CoDesign, 4(1), 5-18.
69. Schiller, G. (2006). Kinaesthetic traces across material forms: stretching the screen's stage. In S. Broadhurst, & J. Machon (Ed.), Performance and technology: Practices of virtual embodiment and interactivity (pp. 100-111). Basingstoke, UK: Palgrave Macmillan.
70. Schön, D. A. (1991). The refective practitioner: How professionals think in action. Aldershot: Avebury.
71. Schrader, C. (2005). A sense of dance: Exploring your movement potential. Champaign, IL.: Human Kinetics.
72. Sennett, R. (2008). The craftsman. New Haven, CT: Yale University Press.
73. Sheets-Johnstone, M. (1999a). Emotion and movement. A beginning empirical-phenomenological analysis of their relationship. Journal of Consciousness Studies, 6(11-12), 259-277.
74. Sheets-Johnstone, M. (1999b). The primacy of movement. Amsterdam, the Netherlands: John Benjamin.
75. Sheets-Johnstone, M. (2011). The imaginative consciousness of movement: Linear quality, kinaesthesia, language and life. In T. Ingold (Ed.), Redrawing anthropology: materials, movements, lines (pp. 115-128). Farnham: Ashgate.
76. Sigal, L., Balan, A. O., & Black, M. J. (2010). HumanEva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. International Journal of Computer Vision, 87(1-2), 4-27.
77. Silver, M. (2003). Traces and simulations. In M. Silver, & D. Balmori (Eds.), Mapping in the age of digital media: The Yale symposium (pp. 108-119). Chichester, UK: Wiley-Academy.
78. Sklar, D. (2008). Remembering kinesthesia: An inquiry into embodied cultural knowledge. In C. Noland, & S. A. Ness (Eds.), Migrations of gesture (pp. 85-111). Minneapolis: University of Minnesota Press.
79. Sminchisescu, C., Kanaujia, A., & Metaxas, D. (2006). Conditional models for contextual human motion recognition. Computer Vision and Image Understanding, 104(2), 210-220.
80. Stern, D. N. (2010). Forms of vitality: Exploring dynamic experience in psychology, the arts, psychotherapy, and development. Oxford, UK: Oxford University Press.
81. Streeck, J., Goodwin, C., & LeBaron, C. D. (2011). Embodied interaction: Language and body in the material world. Cambridge, UK: Cambridge University Press.
82. Thomas, H. (2003). The body, dance and cultural theory. Basingstoke, UK: Palgrave Macmillan.
83. Tversky, B., Morrison, J. B., & Zacks, J. (2002). On bodies and events. In A. N. Meltzoff & W. Prinz (Eds.), The Imitative mind (pp. 221-232). Cambridge, UK: Cambridge University Press.
84. Utterback, C. (2004). Unusual positions - Embodied interaction with symbolic spaces. In P. Harrigan & N. Wardrip-Fruin (Eds.), First person: New media as story, performance, and game (pp. 218-226). Cambridge, MA.: The MIT Press.
85. Vallgårda, A., & Redström, J. (2007). Computational composites. In M. B. Rosson, & D. Gilmore Proceedings of the 25th SIGCHI Conference on Human Factors in Computing Systems. New York, NY: ACM press.
86. van Leeuwen, T. (1999). Speech, music, sound. Basingstoke, UK: Macmillan.
87. van Leeuwen, T. (2005). Introducing social semiotics. London, UK: Routledge.
88. Victor, B. (n.d.) Inventing on Principle. Retrieved 2 December, 2012, from http://vimeo.com/36579366
89. Vinciarelli, A., Pantic, M., Herv, Bourlard, & Pentland, A. (2008). Social signal processing: state-of-the-art and future perspectives of an emerging domain. In C. Griwodz, A. Del Bimbo, K. S. Candan, & A. Jaimes Proceedings of the 16th ACM International Conference on Multimedia. New york, NY.: ACM press.
90. Wachsmuth, I., Lenzen, M., & Knoblich, G. (2008). Embodied communication in humans and machines. Oxford, UK: Oxford University Press.
91. Wang, L., Hu, W., & Tan, T. (2003). Recent developments in human motion analysis. Pattern Recognition, 36(3), 585-601.
92. Williams, D. (2004). Anthropology and the dance: Ten lectures. Urbana, IL.: University of Illinois Press.