Digital Avatars as storytellers to produce natural and humanized museum visits with Extended Reality

Paper

Friday, April 30, 2021: 9:00am - 10:30am - - Paper Session

Ana Martí Testón, Universitat Politècnica de Valencia, Spain, Adolfo Muñoz, Universitat Politècnica de València, Spain

Published paper: Digital avatars as humanized museum guides in the convergence of extended reality

This article analyzes the role of Digital Avatars in the museum context. It takes an exploratory approach to analyzing different interfaces to achieve natural and humanized behavior in a museum visit with digital content. The main objective is to facilitate intuitive interaction with avatar guides only by registering the natural behavior of visitors when they move around the room looking at items or interacting with digital holograms.
With the intention of stimulating more extended dialogue in the museum sector, this article provides a framework that can help museums to produce more natural and humanized visits. The work is based on the design and implementation of a holographic guide utilizing Hololens Glasses in the Almoina, an archaeological museum in Valencia (Spain). The results of the usability tests conducted to check the impact of the natural experience are presented and analyzed in this paper. In designing this project, we accepted the challenge of immersing visitors in the contents of the museum in a way that encouraged them to discover the hidden stories of the ancient city of Valencia.
In our study, we conclude that avatar solutions will emerge as cost-effective, empathic mediums to engage new audiences and democratize the Museum 4.0 experience.

Bibliography:
Bourdieu, P., & Darbel, A. (1997). Love of Art: European Art Museums and their Public. Malden: Polity Press.
Breuss-Schneeweis, P. (2016). “The Speaking Celt – Augmented Reality Avatars Guide Through a Museum – Case Study. UbiComp '16” in Pervasive and Ubiquitous Computing (eds.). Proceedings of the 2016 ACM International Joint Conference. Heidelberg, Germany: ACM. 1484-1491. doi: https://doi.org/10.1145/2968219.2974044
Carrozzino, M., Colombo, M., TecchiaChiara, F., Evangelista, & Bergamasco, M. (2018). “Comparing Different Storytelling Approaches for Virtual Guides in Digital Immersive Museums”. In C. Springer (Ed.), International Conference on Augmented Reality, Virtual Reality and Computer Graphics. 292-302. doi: https://doi.org/10.1007/978-3-319-95282-6_22
Eghbal-Azar, K., Merkt, M., Bahnmueller, J., & Schwan, S. (2015). “Use of digital guides in museum galleries: Determinants of information selection”. Computers in Human Behavior, 133-142.
Falk, J. H. (2009). Identity and the Museum Visitor Experience. Nueva York: Routledge.
Gillam, S. (2017). “Spotlight VR/AR: Innovation in transformative storytelling”. In MW17: Museums and the Web 2017. Cleveland Ohio. Retrieved February 11, 2018, from https://mw17.mwconf.org/paper/spotlight-vrar-innovation-in-transformative-storytelling/
Hammady, R., Ma, M., AL Kalha, Z., & Strathearn, C. (2021). “A framework for constructing and evaluating the role of MR as a holographic virtual guide in museums”. Virtual Reality. doi: https://doi.org/10.1007/s10055-020-00497-9
Hammady, R., Ma, M., Strathern, C., & Mohamad, M. (2019). “Design and development of a spatial mixed reality touring guide to the Egyptian museum”. Multimedia Tools and Applications, 79, 3465–3494. doi: https://doi.org/10.1007/s11042-019-08026-w
Hooper-Greenhill, E. (2016). “Changing Values in Art Museum. Rethinking Communication and Learning”. In B. M. Carbonell, Museum Studies. An athology of Contexts. Oxford: Blackwell Publishing Ltd. 517-532.
Kalning, K. (2011). If Second Life isn't a game, what is it? Consulted January 15, 2021, from NBC News: Available https://www.nbcnews.com/id/wbna17538999#.U9uyeEi49yw
Kefi, H., & Pallud, J. (2011). “The role of technologies in cultural mediation in museums: anActor-Network Theory view applied in France”. Museum Management and Curatorship, 26(3), 273-289.
Kenderdine, S. (2014, abril 11). “How will museums of the future look?” In TEDxGateway 2013. Consulted January 10, 2016, from https://www.youtube.com/watch?v=VXhtwFCA_Kc
Kipman, A. (2016). “A futuristic vision of the age of holograms” In TED talk. Consulted October 4, 2017, Consulted from: https://www.ted.com/talks/alex_kipman_the_dawn_of_the_age_of_holograms
Manovich, L. (2002). The language of new Media. Mit Press.
Martí Testón, A. (2018). “Hacia una museografía 4.0. Diseño de experiencias inmersivas con dispositivos de realidad aumentada”. Tesis Doctoral. Valencia: Universitat Politècnica de València. Available https://riunet.upv.es/handle/10251/107375
Mäyrä, F. (2008). An Introduction to Game Studies. London: SAGE Publications.
Mu, B., Yang, Y., & Zhang, J. (2009). “Implementation of the Interactive Gestures of Virtual Avatar Based on a Multi-user Virtual Learning Environment”. International Conference on Information Technology and Computer Science. IEEE Computer Society. 613- 617 doi: 10.1109/ITCS.2009.134
Muñoz, A., & Martí, A. (2018). “Holomuseum: A Hololens Application for Creating Extensible and Customizable Holographic Exhibitions”. EDULEARN18 Proceedings, 2303-2310.
Muñoz, A., & Martí, A. (2020). New Storytelling for Archaeological Museums Based on Augmented Reality Glasses. In S. Hageneuer, Communicating the Past in the Digital Age. London: Ubiquity Press. doi:https://doi.org/10.5334/bch.g
Murawski, M. (2018). “Towards a More Human-Centered Museum: Part 1, Rethinking Hierarchies”. Art Museum Teaching. Consulted January 31, 2018, https://artmuseumteaching.com/2018/01/22/rethinking-hierarchies/
Parry, R. (2013). “The Trusted Artifice, Reconnecting with the Museum's Fictive Tradition Online”. In Drotner & Schrøder, Museum Communication and Social Media. Routledge Ltd.
Robertson, A. (2020). Nreal’s augmented reality glasses are shipping this month in Korea. Consulted January 20, 2021. https://www.theverge.com/2020/8/10/21362407/nreal-light-ar-glasses-lg-uplus-samsung-galaxy-note-retail-launch-availability-price
Roussou, M., Trahanias, P., Giannoulis, G., Kamarinos, G., Argyros, A., Tsakiris, D., Vassilis S. (2001). “Experiences from the Use of a Robotic Avatar in a Museum Setting”. Conference on Virtual Reality, Archeology, and Cultural Heritage. Glyfada, Greece. 153-160. Doi: 10.1145/584993.585017
Sharples, M., FitzGerald, E., Mulholland, P., & Jones, R. (2013). “Weaving Location and Narrative for Mobile Guides”. In K. C. Kirsten Drotner, Museum communication and social media the connected museum. New York. 177-196.
Suh, K., Kim, H., & Suh, E. K. (2011). “What If Your Avatar Looks Like You?” Dual-Congruity Perspectives for Avatar Use. MIS Quarterly, 35(3), 711-729. Doi/10.5555/2208923.2208935
Swartout, W., Traum, D., Artstein, R., Noren, D., Debevec, P., Bronnenkant, K., White, P. A.-Y. (2010). “Ada and Grace: Toward Realistic and Engaging Virtual Museum Guides”. International Conference on Intelligent Virtual Agents. Springer. 286-300.
Sylaiou, S., Kasapakis, V., Gavalas, D., & Dzardanova, E. (2020). “Avatars as storytellers: affective narratives in virtual museums”. Personal and Ubiquitous Computing, 24, 829–841. https://doi.org/10.1007/s00779-019-01358-2
Wang, X., Meng, X., Yang, C., & Zhang, J. (2009). “Data Driven Avatars Roaming in Digital”. The International Journal of Virtual Reality, 8(3), 13-18. Doi: https://doi.org/10.20870/IJVR.2009.8.3.2736
Weiser, M. (1991). “The computer for the 21st century”. Scientific American, 265(3), 94-104.
Winesmith, K. (2017). How SFMOMA made it’s audio-first, location aware app. MuseumNext. Melbourne. Consulted December 22, 2019. Available How SFMOMA Created it's Location Aware Audio Tour - MuseumNext
Witcom, A. (2016). “Interactivity in museums. The Politics of Narrative Style”. In B. M. Carbonell, Museum Studies. An anthology of Contexts. Oxford: Blackwell Publishing Ltd, 580-589.
Witcomb, A. (2003). Re-Imagining the Museum. Beyond the Mausoleum. New York: Routledge.
Wong, A. (2015). “The whole story, and then some: ‘digital storytelling’ in evolving museum practice”. MW 2015 Museums and the Web 2015. Chicago: Museums and the Web. Consulted February 11, 2018. https://mw2015.museumsandtheweb.com/paper/the-whole-story-and-then-some-digital-storytelling-in-evolving-museum-practice/
Zhang, J., & Yang, Y. (2009). “Design and Implementation of Virtual Museum Based on Web3D”. In C. A. Pan Z., Transactions on Edutainment III. Berlin: Springer. Vol. 5940, 154-165 doi: https://doi.org/10.1007/978-3-642-11245-4_14