Environmental Visualization and Exploration in Mobile Augmented Reality Games: Redefining the Spatial Affordances

Marta Fernández-Ruiz, David Ruiz-Torres, Héctor Puente Bienvenido
pp.  69 – 88, download
(https://doi.org/10.55612/s-5002-056-004)

Abstract

While spatiality in desktop and console interface video games has been widely studied, not many approaches have been made in the context of mobile augmented reality (MAR), an environment from which popular games such as Pokemon Go have emerged. On the one hand, this paper retakes the notion of spatial affordance that Janet Murray introduced for digital environments and proposes a reinterpretation of the concept throughout the integration of the MAR features. On the other, it seeks to approach the impact that these characteristics have on the gameplay experience. For this purpose, 46 mobile augmented reality video games of different genres were analyzed. The study reveals that augmented reality is still a superfluous element rather than a central aspect of the gameplay in most MAR video games, although trends involving new hybrid game experiences have been observed. Finally, we propose a tool for classifying MAR video games according to two axes that assess up to what extent physical space is integrated into the gameplay: gameworld spaces (representational layer) and gameplay spaces (interactive layer, interaction with the game rules and mechanics).

Keywords: mobile augmented reality, game studies, spatial affordance, visualization, 6DoF, gameplay experience.

References

1. Chatzopoulos, D., Bermejo, C., Huang, Z., Hui, P.: Mobile augmented reality survey: From where we are to where we go. Ieee Access, 5, pp. 6917-6950 (2017). doi: https://doi.org/10.1109/ACCESS.2017.2698164
2. Bolter, J.D, Engberg, M., MacIntyre, B.: Reality Media. Augmented and Virtual Reality. The MIT Press, London / Cambridge, (2021).
3. Plinge, A., Schlecht, S.J., Thiergart, O., Robotham, T., Rummukainen, O., and Habets, E.: Six-degrees-of-freedom binaural audio reproduction of first-order Ambisonics with distance information. In: AES International Conference on Audio for Virtual and Augmented Reality (AVAR), pp. 203-212 (2018).
4. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE computer graphics and applications, 21(6), pp. 34-47, (2001). doi: https://doi.org/10.1109/38.963459
5. Milgram, P. and Kishino, F.: A Taxonomy of Mixed Reality Visual Displays. IEICE Transactions on Information and Systems. E77-D. 12(12), pp. 1321-1329, (1994). doi: https://doi.org/10.1.1.102.4646
6. Merino, L., Schwarzl, M., Kraus, M., Sedlmair, M., Schmalstieg, D., Weiskopf, D.: Evaluating mixed and augmented reality: A systematic literature review (2009-2019). In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 438-451, IEEE, (2020). doi: https://doi.org/10.48550/arXiv.2010.05988
7. Zhou, F., Duh, H. B. L., Billinghurst, M.: Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In: 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 193-202. IEEE, (2008). doi: https://doi.org/10.1109/ISMAR.2008.4637362
8. Billinghurst, M., Clark, A., Lee, G.: A survey of augmented reality. Foundations and Trends in Human-Computer Interaction, 8(2-3), pp. 73-272, (2015). doi: https://doi.org/10.1561/1100000049
9. Kim, K., Billinghurst, M., Bruder, G., Duh, H. B. L., Welch, G. F.: Revisiting trends in augmented reality research: A review of the 2nd decade of ISMAR (2008-2017). In: IEEE transactions on visualization and computer graphics, 24(11), pp. 2947-2962. IEEE, (2018). doi: https://doi.org/10.1109/TVCG.2018.2868591
10. Siriwardhana, Y., Porambage, P., Liyanage, M.,Ylianttila, M.: A survey on mobile augmented reality with 5G mobile edge computing: architectures, applications, and technical aspects. IEEE Communications Surveys & Tutorials, 23(2), pp. 1160-1192, (2021). doi: https://doi.org/10.1109/COMST.2021.3061981
11. Murray, J.: Inventing the Medium. Principles of Interaction Design as a Cultural Practice. London / Cambridge, The MIT Press, (2012).
12. Durrant-Whyte H., Bailey T. Simultaneous localization and mapping: part I, IEEE Robotics & Automation magazine. 13(2), PP. 99-110 (2013). doi: https://doi.org/10.1109/MRA.2006.1638022
13. Hidalgo, F., Bräunl, T. Review of underwater SLAM techniques. In 2015 6th International Conference on Automation, Robotics and Applications (ICARA). IEEE, pp. 306-311 (2015). doi: https://doi.org/10.1145/3366194.3366262
14. Hernández Barbosa, S. Vidas excitadas. Sensorialidad y capitalismo en la cultura moderna. Sans Soleil Ediciones, Vitoria-Gasteiz (2022).
15. Steffen, J., Gaskin J., Meservy, T., Jenkins, J., Wolman, I. Framework of affordances for virtual reality and augmented reality. Journal of Management Information Systems. 36(3), pp. 683-729 (2019). doi: https://doi.org/10.1080/07421222.2019.162887719.
16. Scolere, L., & Malinin, L. The building that teaches: Exploring augmented reality affordances in academic incubators, Journal of Interior Design, 48(1), pp. 64-79 (2023). doi: https://doi.org/10.1111/joid.12229
17. Bacca J., Baldiris S., Fabregat, R, Graf, S. and Kinshuk, D. Augmented reality trends in education: a systematic review of research and applications. Educational Technology & Society, ;17(4), pp. 133-149 (2014).
18. MacCallum, K., Jamieson, J. . Exploring augmented reality in education viewed through the affordance lens. Proceedings of the 8th Annual Conference of Computing and Information Technology Education and Research in New Zealand. Napier, New Zealand. CITRENZ (2017).
19. Shin, J., Yoon, B., Kim, D., Woo, W. A User-Oriented Approach to Space-Adaptive Augmentation: The Effects of Spatial Affordance on Narrative Experience in an Augmented Reality Detective Game. In CHI Conference on Human Factors in Computing Systems (2021). https://doi.org/10.1145/3411764.3445675
20. Dong, Z., Zhang, J., Lindeman, R., & Piumsomboon, T. Surface vs motion gestures for mobile augmented reality, Proceedings of the 2020 ACM Symposium on Spatial User Interaction, pp. 1-2 (2020). doi: https://doi.org/10.1145/3385959.3422694
21. Innocent, T., Leorke, D. Heightened intensity: Reflecting on player experiences in Wayfinder Live. Convergence, 25(1), pp. 18-39 (2019). doi: https://doi.org/10.1177/1354856518822427.
22. Azuma, R. Location-based mixed and augmented reality storytelling. Fundamentals of Wearable Computers and Augmented Reality, CRC Press, pp. 259-276 (2015).
23. Ruiz, Miguel Àngel. The (de)territorialization of cyberspace: the validity of ethnographic methodology in the virtual environment. II Online Congress of the Observatory for CyberSociety (2004). http://www.cibersociedad.net/congres2004/index_es.html
24. De Souza, A., Clover, R. Hybrid Play: Crossing Boundaries in Game Design, Players Identities and Play Spaces. Routledge (2020).
25. Fernández-Vara, C., Zagal, J. Evolution Of Space Configuration In Video Games. Digital Games Research Conference, Changing Views: Worlds in Play, Vancouver, British Columbia, Canada (2005).
26. Aarseth, E. Allegories of Space. The Question of Spatiability in Computer Games. In Borries, F., Walz, S.P and Böltger, M. (eds.): Space Time Play. Computer Games, Architecture and Urbanism: The Next Level, pp. 44-55, Basel/Boston/Berlin, Birkhäuser(2007)
27. Azémar, O. Working as a Space Gameplay Architect, in Borries, F., Walz, S.P and Böltger, M. (eds.): Space Time Play. Computer Games, Architecture and Urbanism: The Next Level, pp. 132 – 133, Basel/Boston/Berlin, Birkhäuser (2007).
28. Nitsche, M. Video Game Spaces: Image, Play, and Structure in 3D Worlds, The MIT Press (2008).
29. Boullón Sabín, A.: Evolución tridimensional en la representación visual de los videojuegos y su repercusión en la jugabilidad, Comunicación: revista Internacional de Comunicación Audiovisual, Publicidad y Estudios Culturales, 1(7), pp. 116-133 (2009).
30. Wetzel, R., Blum, L., Broll, W. and Oppermann, L.: Designing Mobile Augmented Reality Games, in B. Furht (Ed.). Handbook of Augmented Reality, pp. 513 – 539, Springer (2011). doi: https://doi.org/10.1007/978-1-4614-0064-6_25
31. Bienvenido, H., Fernández Ruiz, M., Ruiz Torres, D.:Affordances de interacción, emergencia y socialidad en videojuegos con realidad aumentada móvil. Hipertext.net, 5, pp. 123-136 (2022). https://doi.org/10.31009/hipertext.net.2022.i25.12
32. Rogers R.: Digital Methods, The MIT Press (2015).
33. Boellstorff, T., Nardi, B., Pearce, C., Taylor, T.L., Marcus, G.: Ethnography and Virtual worlds. A Handbook of Method, Princeton University Press (2012).
34. Montañés, M.: Scientific Design of Structural Samples, in Congreso Nacional sobre Metodología de la Investigación en Comunicación pp. 841-856 (2013).
35. Otzen, T. & Manterola C.: Sampling techniques on a population under study, Int. J. Morphol., 35(1), pp. 227-232 (2017).

back to Table of Contents