A natural, tiered and executable UIDL for 3D user interfaces based on concept-oriented design

ACM Transactions on Computer-Human Interaction

Volumn 16, Issue 4, 2009, Pages

  Wingrave, Chadwick A ^a   Laviola Jr , Joseph J ^a   Bowman, Doug A ^b  

^a University of Central Florida   (United States)

^b State University   (United States)

Author keywords

3DUI; Chasm; Concept oriented design; Interaction techniques; Natural programming; Non WIMP interfaces; UIDL; UIMS

Indexed keywords

3D USER INTERFACE; CONCEPT-ORIENTED DESIGN; DESIGN AND DEVELOPMENT; DOMAIN EXPERTS; INTERACTION TECHNIQUES; NATURAL PROGRAMMING; NATURAL REPRESENTATION; REDUCED COMPLEXITY; SOFTWARE DEVELOPMENT; UNDERSTANDABILITY; USER INTERFACE DESCRIPTION LANGUAGES;

MACHINE DESIGN; THREE DIMENSIONAL;

USER INTERFACES;

EID: 71449107247     PISSN: 10730516     EISSN: 15577325     Source Type: Journal    
DOI: 10.1145/1614390.1614396     Document Type: Article

References (79)

1. ABELSON, H. AND SUSSMAN, G. 1996. Structure and Interpretation of Computer Programs, 2nd ed. The MIT Press.
2. ALLARD, J., GOURANTON, V., LECOINTRE, L., LIMET, S., MELIN, E., RAFFIN, B., AND ROBERT, S. 2004. FlowVR: A middleware for large scale virtual reality applications. In Proceedings of the Euro-Par Conference.
3. ALUR, R. AND DILL, D. L. 1994. A theory of timed automata. Theoretical Comput. Sci. 126, 2, 183-236.
4. BADILLO, B. 2007. Migrating three dimensional interaction techniques. Ph. D. Thesis, Virginia Tech.
5. BIERBAUM, A., JUST, C., HARTLING, P., MEINERT, K., BAKER, A., AND CRUZ-NEIRA, C. 2001. VR Juggler: A virtual platform for virtual reality application development. In Proceedings of the IEEE Virtual Reality Conference. 89.
6. BLACKWELL, A. AND GREEN, T. 2000. A cognitive dimensions questionnaire optimized for users. In Proceedings of the 12th Workshop of the Psychology of Programming Interest Group. 137-154.
7. BLOM, K. AND BECKHAUS, S. 2007. Supporting the creation of dynamic, interactive virtual environments. In Proceedings of the ACM Symposium on Virtual Reality Software and Technologies. 51-54.
8. BOECK, J. D., VANACKEN, D., RAYMAEKERS, C., AND CONINX, K. 2007. High-Level modeling of multimodal interaction techniques using NiMMiT. J. Virtual Reality Broadcast. 4, 2.
9. BOWMAN, D., BADILLO, B., ANDMANEK, D. 2007. Evaluating the need for display-specific and devicespecific 3D interaction techniques. In Proceedings of the Virtual Reality International Conference. Lecture Notes in Computer Science, vol.4563. Springer, 195-204.
10. BOWMAN, D., CHEN, J., WINGRAVE, C., LUCAS, J., POLYS, A., LI, N., HACIAHMETOGLU, Q., ET AL. 2006. New directions in 3D user interfaces. Int. J. Virtual Reality 5, 2, 3-14.
11. BOWMAN, D. AND HODGES, L. 1997. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In Proceedings of the Symposium on Interactive 3D Graphics.
12. BOWMAN, D., KRUIJFF, E., LAVIOLA, J., AND POUPYREV, I. 2004. 3D User Interfaces: Theory and Practice. Addison-Wesley Professional.
13. BROOKS, F. 1987. No silver bullet: Essence and accidents of software engineering. Comput. 24, 4, 10-19.
14. BROOKS, F. 1999. What's real about virtual reality? IEEE Comput. Graph. Appl. 19, 6, 16-27.
15. CALDER, M., KOLBERG, M., MAGILL, E. H., AND REIFF-MARGANIEC, S. 2003. Feature interaction: A critical review and considered forecast. Computer Netw. 41, 1, 115-141.
16. COCKBURN, A. 2001. Writing Effective Use Cases. Addison-Wesley Longman. DACHSELT, R. 2001. CONTIGRA-Towards a document-based approach to 3D components. In Proceedings of the Workshop on Structured Design of Virtual Environments and 3D-Components (WEB 3D'01).
17. DACHSELT, R., FIGUEROA, P., AND LINDT, I. 2006. Workshop on the specification of mixed reality user interfaces: Approaches, languages, standardization. In Proceedings of the IEEE Symposium on Virtual Reality.
18. DACHSELT, R., FIGUEROA, P., LINDT, I., AND BROLL, W. 2007. Workshop on the mixed reality user interfaces: Specification, authoring, adaptation. In Proceedings of the IEEE Symposium on Virtual Reality.
19. DIJKSTRA, E. 1982. On the role of scientific thought. In Selected Writings on Computing: A Personal Perspective. Springer, 60-66.
20. FIGUEROA, P., GREEN, M., AND HOOVER, H. J. 2002. InTml: A description language for VR applications. In Proceedings of theWeb3D Conference.
21. FRY, Z. P., SHEPHERD, D., HILL, E., POLLOCK, L., AND VIJAY-SHANKER, K. 2008. Analysing source code: Looking for useful verb-direct object pairs in all the right places. IET Softw. 2, 1. (Special Section on Natural Language in Software Engineering).
22. GALL, C. S., LUKINS, S., ETZKORN, L., GHOLSTON, S., FARRINGTON, P., UTLEY, D., FORTUNE, J., AND VIRANI, S. 2008. Semantic software metrics computed from natural language design specifications. IET Softw. 2, 1. (Special Section on Natural Language in Software Engineering).
23. GAMMA, E., HELM, R., JOHNSON, R., AND VLISSIDES, J. 1994. Design Patterns: Elements of Reusable Object-Oriented Software. Addison Wesley.
24. GLASER, B. AND STRAUSS, A. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Weidenfeld and Nicolson, London.
25. GOSLIN, M. AND MINE, M. 2004. The Panda3D graphics engine. Comput. 37, 10, 112-114.
26. GREEN, M. 1986. A survey of three dialog models. ACM Trans. Graph. 5, 3.
27. GREEN, M. AND JACOB, R. 1991. SIGGRAPH '90 workshop report: Software architectures and metaphors for non-WIMP user interfaces. Comput. Graph. 25, 3.
28. GREEN, T. R. G. AND PETRE, M. 1996. Usability analysis of visual programming environments: A cognitive dimensions' framework. J. Visual Lang. Comput. 7, 131-174.
29. HAREL, D. AND POLITI, M. 1998. Modeling Reactive Systems with Statecharts: The Statemate Approach. McGraw-Hill Publishing.
30. HERNDON, K. P., VAN DAM, A., AND GLEICHER, M. 1994. Workshop on the challenges of 3D interaction. SIGCHI Bull. 26, 4, 1-9.
31. HORSTMANN, C. 2005. Object-Oriented Design and Patterns, 2nd Ed. Wiley.
32. JACOB, R., DELIGIANNIDIS, L., AND MORRISON, S. 1999. A software model and specification language for non-WIMP user interfaces. ACM Trans. Comput.-Hum. Interact. 6, 1, 1-46.
33. JACOB, R. J. K.,GIROUARD, A., HIRSHFIELD, L. M., HORN, M. S., SHAER, O., SOLOVEY, E. T., AND ZIGELBAUM, J. 2008. Reality-Based interaction: A framework for post-WIMP interfaces. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems. ACM Press, 201-210.
34. JOHNSTON, W., PAUL HANNA, J., AND MILLAR, R. 2004. Advances in dataflow programming. ACM Comput. Surv. 36, 1.
35. KATO, H., BILLINGHURST, M., POUPYREV, I., IMAMOTO, K., AND TACHIBANA, K. 2000. Virtual object manipulation on a table-top AR environment. In Proceedings of the International Symposium on Augmented Reality. 111-119.
36. KELSO, J., SATTERFIELD, S., ARSENAULT, L., KETCHAN, P., AND KRIZ, R. 2003. DIVERSE: A framework for building extensible and reconfigurable device-independent virtual environments and distributed asynchronous simulations. Presence: Teleoper. Virtual Environ. 12, 1, 19-36.
37. KENT, S. 2002. Model-Driven engineering. In Integrated Formal Methods. Lecture Notes in Computer Science, vol.2335. Springer, 286-298.
38. KICZALES,G., IRWIN, J., LAMPING, J., LOINGTIER, J., LOPES, C., ANDMAEDAMENDHEKAR,A. 1996. Aspect- Oriented programming. ACM Comput. Surv. 28.
39. KNUTH, D. 1992. Literate programming. Center for the Study of Language and Information- Lecture Notes.
40. LATOSCHIK,M. E., REINERS, D., BLACH, R., FIGUEROA, P., AND DACHSELT, R. 2008. Workshop SEARISSoftware engineering and architectures for realtime interactive systems. In Proceedings of the IEEE Symposium on Virtual Reality.
41. LAVIOLA, J. 2008. Bringing VR and spatial 3D interaction to the masses through video games. IEEE Comput. Graph. Appl. 28, 5,10-15.
42. MANKOFF, J., ABOWD, G. D., AND HUDSON, S. 2000. Providing integrated toolkit-level support for ambiguity in recognition-based interfaces. In Proceedings of the Conference on Computer-Human Interaction (CHI).
43. MEYER, B. 1997. Object-Oriented Software Construction, 2nd Ed. Prentice Hall PTR.
44. MILLER, L. A. 1981. Natural language programming: Styles, strategies, and contrasts. IBM Syst. J. 20, 184-215.
45. MOORE, E. F. 1956. Gedanken-Experiments on sequential machines. Automata Studies. In Annals of Mathematical Studies, 34. Princeton, 129-153.
46. MORRISON, J. P. 1994. Flow-Based Programming: A New Approach to Application Development. van Nostrand Reinhold.
47. MYERS,B. 1991. Separating application code from toolkits: Eliminating the spaghetti of callbacks. In Proceedings of the User Interface Software and Technology Conference. 211-220.
48. MYERS, B., HUDSON, S. E., AND PAUSCH, R. 1999. Past, present and future of user interface software tools. ACM Trans. Comput.-Hum. Interact. 7, 1, 3-28.
49. MYERS, B. A., PANE, J. F., AND KO, A. 2004. Natural programming languages and environments. Comm. ACM (Special Issue on End-User Development) 47, 9, 47-52.
50. MYERS, B., PARK, S., NAKANO, Y.,MUELLER, G., AND KO, A. 2008. How designers design and program interactive behaviors. In Proceedings of the IEEE Symposium on Visual Languages and Human- Centric Computing (VL/HCC'08). 177-184.
51. NIELSEN, J. AND MACK, R. L. (EDS.). 1994. Usability Inspection Methods. John Wiley and Sons, New York.
52. PANE, J. F., RATANAMAHATANA, C. A., AND MYERS, B. A. 2001. Studying the language and structure in non-programmers' solutions to programming problems. Int. J. Hum.-Comput. Studies 54, 2, 237-264.
53. PANE, J. F. AND MYERS, B. A. 2002. The impact of human-centered features on the usability of a programming system for children. In Proceedings of the Conference on Human Factors in Computing Systems: CHI Extended Abstracts. ACM Press, 684-685.
54. PANE, J. F., MYERS, B. A., AND MILLER, L. B. 2002. Using HCI techniques to design a more usable programming system. In Proceedings of the IEEE Symposia on Human Centric Computing Languages and Environments (HCC'02). 198-206.
55. PARNAS, D. L. 1972. On the criteria to be used in decomposing systems into modules. Comm. ACM 15, 12.
56. PAUSCH, R.,CONWAY, M., ANDDELINE,R. 1992. Lessons learned from SUIT, the simple user interface toolkit. ACM Trans. Inform. Syst. 10, 4, 320-344.
57. PIERCE, J., STEARNS, B., AND PAUSCH, R. 1999. Voodoo dolls: Seamless interaction at multiple scales in virtual environments. In Proceedings of the Symposium on Interactive 3D Graphics. 141-145.
58. POLYS, N. AND RAY, A. 2006. Supporting mixed reality interfaces through X3D specification. In Proceedings of the Workshop on Specification of Mixed Reality User Interfaces: Approaches, Languages, Standardization, IEEE Symposium on Virtual Reality.
59. RAY, A. 2008. The interaction framework for innovation: A method to create reusable three dimensional interaction techniques. Ph.D. Dissertation, Virginia Tech.
60. ROSSON, M. B. AND CARROLL, J. M. 2002. Usability Engineering: Scenario-Based Development of Human Computer Interaction. Morgan Kaufmann.
61. SCHÖN, D. 1983. The Reflective Practitioner. How Professionals Think in Action. Temple Smith, London.
62. SCHMALSTIEG, D., FUHRMANN, A., HESINA, G., SZALAV́ARI, Z., ENCARNAÇÄO, L. M., GERVAUTZ, M., AND PURGATHOFER, W. 2002. The studierstube augmented reality project. Presence 11, 1.
63. SELIC, B. 2003. The pragmatics of model-driven development. IEEE Softw. 20, 5, 19-25.
64. SHAER, O., JACOB, R., GREEN, M., AND LUYTEN, K. 2008. User interface description languages for next generation user interfaces. In Proceedings of the Extended Abstracts on Human Factors in Computing Systems (CHI'08). 3949-3952.
65. SHAW, M. 2001. The coming-of-age in software architecture research. In Proceedings of the International Conference on Software Engineering.
66. STEED, A. 2008. Some useful abstractions for re-usable virtual environment platforms. In Proceedings of the IEEE Virtual Reality Workshop for Software Engineering and Architectures for Realtime Interactive Systems.
67. STOAKLEY, C. AND PAUSCH, R. 1995. Virtual reality on a WIM: Interactive worlds in miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). 265-272.
68. TARR, P., OSSHER, H., HARRISON, W., AND SUTTON, S. M. JR. 1999. N-Degrees of separation: Multi- Dimensional separation of concerns. In Proceedings of the International Conference on Software Engineering (ICSE).
69. TAYLOR II, R. M., HUDSON, T. C., SEEGER, A.,WEBER, H., JULIANO, J., AND HELSER, A. T. 2001. VRPN: A device-independent, network-transparent VR peripheral system. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology.
70. VON DER BEECK, M. A. 1994. Comparison of statecharts variants. In Proceedings of the Symposium Organized Jointly with the Working Group on Provably Correct Systems on Formal Techniques in Real-Time and Fault-Tolerant Systems. Lecture Notes in Computer Science, vol.863. Springer, 128-148.
71. WILLANS, J. S. AND HARRISON, M. D. 2001. A toolset supported approach for designing and testing virtual environment interaction techniques. Int. J. Hum.-Comput. Studies 55, 2.
72. WINGRAVE, C. A. 2008. Concept-Oriented design in Chasm: Conversational domain language inspired 3D user interface design and development. Ph.D. Dissertation, Virginia Tech.
73. WINGRAVE, C. AND BOWMAN, D. 2005. Baseline factors for raycasting selection. In Proceedings of the HCI International Conference.
74. WINGRAVE, C. AND BOWMAN, D. 2008. Tiered developer-centric representations for 3D interfaces: Concept-Oriented design in Chasm. In Proceedings of the IEEE Symposium on Virtual Reality.
75. WINGRAVE, C. AND LAVIOLA, J. 2009. Reflection on virtual environment behavioral design and development. Presence: Teleoper. Virtual Environ. (Special Issue on Reflections on the Design and Implementation of Virtual Environment Systems). To appear.
76. WIRTH, N. 1971. Program development by stepwise refinement. Comm. ACM 14, 4.
77. WITTE, R., LI, Q., ZHANG, Y., AND RILLING, J. 2008. Text mining and software engineering: An integrated source code and document analysis approach. IET Softw. 2, 1. (Special Section on Natural Language in Software Engineering).
78. WULF, W. AND SHAW, M. 1973. Global variable considered harmful. ACM SIGPLAN Not. 8, 2, 28-34.
79. YOURDON, E. AND CONSTANTINE, L. L. 1979. Structured Design: Fundamentals of a Discipline of Computer Program and Systems Design. Prentice-Hall, Upper Saddle River, NJ.