The development and validation of the ARI questionnaire: An instrument for measuring immersion in location-based augmented reality settings

International Journal of Human Computer Studies

Volumn 98, Issue , 2017, Pages 24-37

  Georgiou, Yiannis ^a   Kyza, Eleni A ^a  

^a CYPRUS UNIVERSITY OF TECHNOLOGY   (Cyprus)

Author keywords

ARI questionnaire; Augmented reality; Immersion; Location aware applications; Questionnaire development

Indexed keywords

AUGMENTED REALITY; FACTOR ANALYSIS; MULTIVARIANT ANALYSIS; SURVEYS;

ARI QUESTIONNAIRE; CONFIRMATORY FACTOR ANALYSIS; EXPLORATORY FACTOR ANALYSIS; HIGH SCHOOL STUDENTS; IMMERSION; LOCATION-AWARE APPLICATION; MULTIDIMENSIONALITY; QUESTIONNAIRE DEVELOPMENT;

LOCATION;

EID: 84991608996     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2016.09.014     Document Type: Article

References (75)

1. Agarwal, R., Karahanna, E., Time flies when you're having fun: cognitive absorption and beliefs about information technology usage. MIS Q. Manag. Inf. Syst. 24 (2000), 665–694.
2. Apostolou, M., Psychometric properties of the achievement goal questionnaire-revised administered to Greek University students. Psychol. Rep. 113 (2013), 380–403.
3. Avouris, N., Yiannoutsou, N., A review of mobile location-based games for learning across physical and virtual spaces. J. Univers. Comput. Sci. 18 (2012), 2120–2142.
4. Azuma, R.T., A survey of augmented reality. Presence Teleoper. Virtual Environ. 6 (1997), 355–385.
5. Bagozzi, R.P., Yi, Y., On the evaluation of structural equation models. JAMS 16 (1988), 74–94.
6. Baños, R.M., Botella, C., Alcañiz, M., Liaño, V., Guerrero, B., Rey, B., Immersion and emotion: their impact on the sense of presence. Cyber. Behav. 7 (2004), 734–741.
7. Barnette, J.J., Effects of stem and Likert response option reversals on survey internal consistency: if you feel the need, there is a better alternative to using those negatively worded stems. Educ. Psychol. Meas. 60 (2000), 361–370.
8. Bentler, P.M., Bonett, D.G., Significance tests and goodness of fit in the analysis of covariance structures. Psychol. Bull. 88 (1980), 588–606.
9. Bentler, P.M., Chou, C.-P., Practical issues in structural modeling. Sociol. Methods Res. 16 (1987), 78–117.
10. Benyon, D., Presence in blended spaces. Inter. Comput 24 (2012), 219–226.
11. Bowen, N.K., Guo, S., Structural Equation Modeling, 2011, Oxford University Press, Oxford.
12. Bressler, D.M., Bodzin, A.M., A mixed methods assessment of students' flow experiences during a mobile augmented reality science game. J. Comput. Assist. Learn 29 (2013), 505–517.
13. Brooks, K., 2003. There is nothing virtual about immersion: Narrative immersion for VR and other interfaces. Retrieved from 〈http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.87.8043&rep=rep1&type=pdf 〉.
14. Brown, E., Cairns, P., A grounded investigation of game immersion. Conf. Hum. Fact. Comput Syst. Proc., 2004, 1297–1300.
15. Brown, T.A., Confirmatory Factor Analyses for Applied Research, 2006, The Guilford Press, New York.
16. Bunting, B.S., Hughes, J., Hetland, T., The player as author: exploring the effects of mobile gaming and the location-aware Interface on storytelling. Future Internet 4 (2012), 142–160.
17. Bystrom, K.-E., Barfield, W., Hendrix, C., A conceptual model of the sense of presence in virtual environments. Presence Teleoper. Virtual Environ. 8 (1999), 241–244.
18. Cheng, K.-H., Tsai, C.-C., Affordances of augmented reality in science learning: suggestions for future. Res. J. Sci. Educ. Technol. 22 (2013), 449–462.
19. Cheng, M.-T., She, H.-C., Annetta, L.A., Game immersion experience: its hierarchical structure and impact on game-based science learning. J. Comput. Assist. Learn 31 (2015), 232–253.
20. Chung, J., Gardner, H.J., Temporal presence variation in immersive computer games. Int. J. Hum. Comput. Interact. 28 (2012), 511–529.
21. Costello, A.B., Osborne, J.W., Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval., 2005, 10.
22. Csikszentmihalyi, M., Flow: The Psychology of Optimal Experience, 1991, Harper Perennial, New York.
23. De Souza E Silva, A., Delacruz, G.C., Hybrid reality games reframed: potential uses in educational contexts. Games Cult. 1 (2006), 231–251.
24. De Souza E Silva, A., Hjorth, L., Playful urban spaces a historical approach to mobile games. Simul. Gaming, 2009, 40.
25. Dede, C., Immersive interfaces for engagement and learning. Science 2:323 (2009), 66–69.
26. DeVellis, R.F., Scale Development: Theory and Applications. 2003, Sage, Newbury Park, CA.
27. Dunleavy, M., Dede, C., Mitchell, R., Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. J. Sci. Educ. Technol. 18 (2009), 7–22.
28. Dunleavy, M., Dede, C., Augmented reality teaching and learning. Spector, J.M., Merrill, M.D., Elen, J., Bishop, M.J., (eds.) The Handbook of Research for Educational Communications and Technology, 4th ed., 2013, Springer, New York.
29. Ermi, L., Mäyrä, F., 2005. Fundamental components of the gameplay experience: Analysing immersion. In: Proceedings DiGRA Conference: Changing Views - Worlds Play.
30. Field, A., Discovering Statistics using SPSS. 3rd edition, 2009, Sage Publications, London.
31. Fitzgerald, E., Ferguson, R., Adams, A., Gaved, M., Mor, Y., Thomas, R., Augmented reality and mobile learning: the state of the art. Int. J. Mob. Blended Learn. 5 (2013), 43–58.
32. Fornell, C., Larcker, D.F., Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 18 (1981), 39–50.
33. Gagné, P., Hancock, G.R., Measurement model quality, sample size, and solution propriety in confirmatory factor models. Multivar. Behav. Res. 41 (2006), 65–83.
34. Grüter, B.M., McCall, R., Braun, A.−, Baillie, L., Methodological issues in studying player experiences of location aware games. Pers. Ubiquitous Comp. 15 (2011), 1–2.
35. Hair, J.F., Anderson, R.E., Tatham, R.L., Black, W.C., Multivariate Data Analysis, 5th ed., 1998, Prentice-Hall International, Upper Saddle River, New Jersey.
36. Harrington, D., Confirmatory Factor. Analysis, 2009, Oxford University Press, New York.
37. Hartlep, N.D., Lowinger, R.J., An exploratory study of undergraduates' attitudes toward affirmative action policies for Asian Americans in college. Equity Excell. Educ. 47 (2014), 370–384.
38. Heeter, C., Being there: the subjective experience of presence. Presence:Teleoperators Virtual Environ. 1 (1992), 262–271.
39. Henriksson, A., Andershed, B., Benzein, E., Årestedt, K., Adaptation and psychometric evaluation of the preparedness for caregiving scale, caregiver competence scale and rewards of caregiving scale in a sample of Swedish family members of patients with life-threatening illness. Palliat. Med. 26 (2012), 930–938.
40. Hu, L.-T., Bentler, P.M., Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol. Methods 3 (1998), 424–453.
41. Ijsselsteijn, W.A., de Ridder, H., Freeman, J., Avons, S.E., 2000. Presence: Concept, determinants and measurement. In: Rogowitz, B.E., Pappas, T.N. (Eds.), Proceedings of SPIE: Human Vision and Electronic Imaging. SPIE, Bellingham, pp. 520–529.
42. Jennett, C., Cox, A.L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., Walton, A., Measuring and defining the experience of immersion in games. Int J. Hum. Comput Stud. 66 (2008), 641–661.
43. Kaiser, H.F., The application of electronic computers to factor analysis. Educ. Psychol. Meas. 20 (1960), 141–151.
44. Kim, M.J., A framework for context immersion in mobile augmented reality. Autom. Constr. 33 (2013), 79–85.
45. Klopfer, E., Augmented Learning: Research and Design of Mobile Educational Games, 2008, MIT Press, Cambridge, MA.
46. Manly, B.F.J., Factor analysis. Manly, B.F.J., (eds.) Multivariate statistical methods: A primer, 1994, Chapman & Hall, London, 93–106.
47. Marsh, H.W., The bias of negatively worded items in rating scales for young children: a cognitive-developmental phenomenon. Dev. Psychol. 22 (1986), 37–49.
48. Marsh, H.W., Hau, K.-T., Balla, J.R., Grayson, D., Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivar. Behav. Res. 33 (1998), 181–220.
49. Martin, S., Diaz, G., Sancristobal, E., Gil, R., Castro, M., Peire, J., New technology trends in education: seven years of forecasts and convergence. Comput. Educ. 57 (2011), 1893–1906.
50. McCall, R., Wetzel, R., Löschner, J., Braun, A.-K., Using Presence Eval. Augment. Real. Locat. Aware. game. Pers. Ubiquitous Comp. 15 (2011), 25–35.
51. McMahan, A. (2003). Immersion, engagement, and presence: A method for analyzing 3-D video games. In, Wolf, M.J.P., Perron, B. (Eds.) The Video Game Theory Reader, New York, 67–86.
52. McMahon, M., Ojeda, C., 2008. A model of immersion to guide the design of serious games.In: Richards, G. (Ed.), Proceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education. AACE, Cesapeake, VA, pp. 1833–1842.
53. Mount, N.J., Chambers, C., Weaver, D., Priestnall, G., Learner immersion engagement in the 3D virtual world: principles emerging from the DELVE project. ITALICS 8 (2009), 40–55.
54. Nash, E.B., Edwards, G.W., Thompson, J.A., Barfield, W., A review of presence and performance in virtual environments. Int. J. Hum. Comput. Interact. 12 (2000), 1–41.
55. Nilsson, E.M., Svingby, G., Gaming as actions: students playing a mobile educational computer game. Hum. IT 10 (2009), 26–59.
56. Örtqvist, D., Liljedahl, M., Immersion and gameplay experience: a contingency framework. Int. J. Comput. Game Technol., 2010.
57. Qin, H., Patrick Rau, P.-, Salvendy, G., Measuring player immersion in the computer game narrative. Int. J. Hum. Comput. Interact. 25 (2009), 107–133.
58. Raubenheimer, J., An item selection procedure to maximise scale reliability and validity. SA J. Ind. Psychol. 30 (2004), 59–64.
59. Regenbrecht, H., Schubert, T., 2002. Measuring presence in augmented reality environments: Design and a first test of a questionnaire. In: Proceedings of the Fifth Annual InternationalWorkshop Presence 2002, Porto, Portugal. October 9–11.
60. Reid, J., Hull, R., Cater, K., Fleuriot, C., Magic Moments Situated Mediascapes, 2005, 290–293.
61. Reid, J., 2008. Design for coincidence: incorporating real world artifacts in location based games. In: Proceedings of ACM DIMEA, 18–25.
62. Reid, J., Geelhoed, E., Hull, R., Cater, K., Clayton, B., Parallel worlds: immersion in location-based experiences. Conf. Hum. Fact. Comput Syst. Proc., 2005, 1733–1736.
63. Reid, J., Hull, R., Clayton, B., Melamed, T., Stenton, P., A research methodology for evaluating location aware experiences. Pers. Ubiquitous Comp. 15 (2011), 53–60.
64. Scoresby, J., Shelton, B.E., Visual perspectives within educational computer games: effects on presence and flow within virtual immersive learning environments. Instrum. Sci. 39 (2011), 227–254.
65. Slater, M., Wilbur, S., A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence Teleoper. Virtual Environ. 6 (1997), 603–616.
66. Slater, M., Measuring presence: A response to the witmer and singer presence questionnaire. Presence: Teleoperators & Virtual Environments 8:5 (1999), 560–566.
67. Uncle Roy All Around You [Computer software], 2003. United Kingdom: Blast Theory & The Mixed Reality Lab. Retrieved June 17, 2016, from 〈http://www.blasttheory.co.uk/projects/uncle-roy-all-around-you/〉.
68. Von Der Pütten, A.M., Klatt, J., Ten Broeke, S., McCall, R., Krämer, N.C., Wetzel, R., Blum, L., Oppermann, L., Klatt, J., Subjective and behavioral presence measurement and interactivity in the collaborative augmented reality game TimeWarp. Inter. Comput 24 (2012), 317–325.
69. Wagner, I., Broll, W., Jacucci, G., Kuutii, K., McCall, R., Morrison, A., Schmalstieg, D., Terrin, J.-J., On the role of presence in mixed reality. Presence Teleoper. Virtual Environ. 18 (2009), 249–276.
70. Weibel, D., Wissmath, B., Immersion in computer games: the role of spatial presence and flow. Int. J. Comput. Game Technol., 2011.
71. Weibel, D., Wissmath, B., Mast, F.W., Immersion in mediated environments: the role of personality traits. Cyber. Behav. Soc. Netw. 13 (2010), 251–256.
72. West, S.G., Finch, J.F., Curran, P.J., Structural equation models with nonnormal variables. Hoyle, R.H., (eds.) Structural Equation Modeling, 1995, Sage Publications, London, 56–75.
73. Wille, G.W., 1996. A Stepwise Procedure for the Empirical Assessment of Latent Variable Models. University of Port Elizabeth, Port Elizabeth.
74. Witmer, B.G., Singer, M.J., Measuring presence in virtual environments: a presence questionnaire. Presence Teleoper. Virtual Environ. 7 (1998), 225–240.
75. Yuen, S., Yaoyuneyong, G., Johnson, E., Augmented reality: an overview and five directions for AR in education. J. Educ. Technol. Dev. Exch. 4, 2011, 119–140.