Skip to main content

2024 | OriginalPaper | Buchkapitel

4. Augmented Imagination: Creating Immersive and Playful Reading Experiences

verfasst von : Cuauhtli Campos, Julie Ducasse, Klen Čopič Pucihar, Vladimir Geroimenko, Matjaž Kljun

Erschienen in: Augmented Reality Games II

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this chapter, we investigate physical and digital approaches to the phenomenon of book augmentation. Physical approaches do not embed any electronic elements into the book. On the contrary, in digital approaches interactivity is supported by embedding electronic devices into the physical book, holding devices above the book or by placing electronic devices around the reader. Firstly, we describe and analyse ten augmented books that use different augmentation techniques (along the following three dimensions: the modalities being used, the type of content on offer and the impact of the augmentation on the reading flow). We then emphasise the need for further investigation of the ways for delivering multimodal and immersive content, in which the processes of reading the original text, interacting and consuming the digital content merge into one unified experience that does not disrupt the reading flow and enhances the sense of immersion in the story. Finally, we illustrate how we could move towards this vision of a unified augmented reading experience using different technologies, such as speech recognition systems, eye- and head-tracking systems, generative AI, olfactory displays, smell synthesisers and digitally controlled food delivery systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
PISA 2022 results https://​www.​oecd.​org/​publication/​pisa-2022-results. Last accessed on 5 December 2023.
 
2
Tap the Magic Tree by Christie Matheson: https://​www.​youtube.​com/​watch?​v=​3e7FFxElbw4. Last accessed on 5 December 2023.
 
3
StoryBook by Hallmark Inc.: https://​www.​hallmark.​com/​gifts/​books/​recordable-storybooks/​. Last accessed on 5 December 2023.
 
4
Sensory fiction https://​vimeo.​com/​84412874. Last accessed on 5 December 2023.
 
5
PhoneBook by Mobile Art: https://​www.​youtube.​com/​watch?​v=​LBhgC42mMjg. Last accessed on 5 December 2023.
 
6
Augmented Reality Books: Safari Animals, World of Fairy Tales (Paparmali). https://​www.​youtube.​com/​watch?​v=​jH4PmVLq3Xc&​t=​12s. Last accessed on 5 December 2023.
 
7
Marty Swant. Sanni surprises readers of Aku Ankka magazine. Adweek, 21 September 2018. https://​www.​adweek.​com/​digital/​to-promote-her-upcoming-show-this-finnish-pop-star-appeared-as-an-ar-cartoon-in-a-donald-duck-comic-book/​. Last accessed on 5 December 2023.
 
8
PopOut! The Tale of Peter Rabbit-Loud Crow Interactive Inc. https://​www.​youtube.​com/​watch?​v=​tfjcdK38iUM. Last accessed on 5 December 2023.
 
Literatur
Zurück zum Zitat Back M, Cohen J, Gold R et al (2001) Listen reader: an electronically augmented paper-based book. In: Proceedings of the SIGCHI conference on human factors in computing systems—CHI ‘01. ACM Press, New York, NY, pp 23–29. https://doi.org/10.1145/365024.365031 Back M, Cohen J, Gold R et al (2001) Listen reader: an electronically augmented paper-based book. In: Proceedings of the SIGCHI conference on human factors in computing systems—CHI ‘01. ACM Press, New York, NY, pp 23–29. https://​doi.​org/​10.​1145/​365024.​365031
Zurück zum Zitat Campagna D, Kavka C, Onesti L (2014) Enhancing BPMN 2.0 support for service interaction patterns. In: Proceedings of the 9th international conference on software engineering and applications. SCITEPRESS—Science and Technology Publications, pp 199–208 Campagna D, Kavka C, Onesti L (2014) Enhancing BPMN 2.0 support for service interaction patterns. In: Proceedings of the 9th international conference on software engineering and applications. SCITEPRESS—Science and Technology Publications, pp 199–208
Zurück zum Zitat Campos C, Matjaž K, Čopič Pucihar K (2022a) Dynamic pinhole paper: interacting with horizontal displays through perforated paper. Proc ACM Hum-Comput Interact 6(ISS):254–276. Article 567. https://doi.org/10.1145/3567720 Campos C, Matjaž K, Čopič Pucihar K (2022a) Dynamic pinhole paper: interacting with horizontal displays through perforated paper. Proc ACM Hum-Comput Interact 6(ISS):254–276. Article 567. https://​doi.​org/​10.​1145/​3567720
Zurück zum Zitat Campos C, Matjaž K, Sandak J, Čopič Pucihar K (2022b) LightMeUp: back-print illumination paper display with multi-stable visuals. Proc ACM Hum-Comput Interact 6(ISS):407–429. Article 573. https://doi.org/10.1145/3570333 Campos C, Matjaž K, Sandak J, Čopič Pucihar K (2022b) LightMeUp: back-print illumination paper display with multi-stable visuals. Proc ACM Hum-Comput Interact 6(ISS):407–429. Article 573. https://​doi.​org/​10.​1145/​3570333
Zurück zum Zitat Gray JH, Bulat J, Jaynes C, Cunningham A (2009) LeapFrog learning design: playful approaches to literacy. In: Mobile technology for children. Elsevier, pp 171–194 Gray JH, Bulat J, Jaynes C, Cunningham A (2009) LeapFrog learning design: playful approaches to literacy. In: Mobile technology for children. Elsevier, pp 171–194
Zurück zum Zitat Hupfeld A, Sellen A, O’Hara K, Rodden T (2013) Leisure-based reading and the place of E-books in everyday life. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), pp 1–18. https://doi.org/10.1007/978-3-642-40480-1_1 Hupfeld A, Sellen A, O’Hara K, Rodden T (2013) Leisure-based reading and the place of E-books in everyday life. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), pp 1–18. https://​doi.​org/​10.​1007/​978-3-642-40480-1_​1
Zurück zum Zitat Klamka K, Dachselt R (2017) IllumiPaper: illuminated interactive paper. In: Proceedings of the 2017 CHI conference on human factors in computing systems (CHI ‘17). Association for Computing Machinery, New York, NY, pp 5605–5618. https://doi.org/10.1145/3025453.3025525 Klamka K, Dachselt R (2017) IllumiPaper: illuminated interactive paper. In: Proceedings of the 2017 CHI conference on human factors in computing systems (CHI ‘17). Association for Computing Machinery, New York, NY, pp 5605–5618. https://​doi.​org/​10.​1145/​3025453.​3025525
Zurück zum Zitat Kljun M, Čopič Pucihar K, Alexander J et al (2019) Augmentation not duplication: considerations for the design of digitally-augmented comic books. In: Proceedings of the 2019 CHI conference on human factors in computing systems (CHI ‘19). https://doi.org/10.1145/3290605.3300333 Kljun M, Čopič Pucihar K, Alexander J et al (2019) Augmentation not duplication: considerations for the design of digitally-augmented comic books. In: Proceedings of the 2019 CHI conference on human factors in computing systems (CHI ‘19). https://​doi.​org/​10.​1145/​3290605.​3300333
Zurück zum Zitat Laput G, Ahuja K, Goel M, Harrison C (2018) Ubicoustics: plug-and-play acoustic activity recognition. In: The 31st annual ACM symposium on user interface software and technology—UIST ‘18. ACM Press, New York, NY, pp 213–224. https://doi.org/10.1145/3242587.3242609 Laput G, Ahuja K, Goel M, Harrison C (2018) Ubicoustics: plug-and-play acoustic activity recognition. In: The 31st annual ACM symposium on user interface software and technology—UIST ‘18. ACM Press, New York, NY, pp 213–224. https://​doi.​org/​10.​1145/​3242587.​3242609
Zurück zum Zitat Li H, Brockmeyer E, Carter EJ et al (2016) PaperID: a technique for drawing functional battery-free wireless interfaces on paper. In: Proceedings of the 2016 CHI conference on human factors in computing systems—CHI ‘16. ACM Press, New York, NY, pp 5885–5896. https://doi.org/10.1145/2858036.2858249 Li H, Brockmeyer E, Carter EJ et al (2016) PaperID: a technique for drawing functional battery-free wireless interfaces on paper. In: Proceedings of the 2016 CHI conference on human factors in computing systems—CHI ‘16. ACM Press, New York, NY, pp 5885–5896. https://​doi.​org/​10.​1145/​2858036.​2858249
Zurück zum Zitat Narumi T, Nishizaka S, Kajinami T et al (2011) Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction. In: Proceedings of the 2011 annual conference on human factors in computing systems—CHI ‘11. ACM Press, New York, NY. https://doi.org/10.1145/1978942.1978957 Narumi T, Nishizaka S, Kajinami T et al (2011) Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction. In: Proceedings of the 2011 annual conference on human factors in computing systems—CHI ‘11. ACM Press, New York, NY. https://​doi.​org/​10.​1145/​1978942.​1978957
Zurück zum Zitat Park A, Lee KJ, Casalegno F (2010) The three dimensions of book evolution in ubiquitous computing age: digitalization, augmentation, and hypermediation. In: 2010 IEEE international conference on sensor networks, ubiquitous, and trustworthy computing. IEEE, pp 374–378. https://doi.org/10.1109/SUTC.2010.50 Park A, Lee KJ, Casalegno F (2010) The three dimensions of book evolution in ubiquitous computing age: digitalization, augmentation, and hypermediation. In: 2010 IEEE international conference on sensor networks, ubiquitous, and trustworthy computing. IEEE, pp 374–378. https://​doi.​org/​10.​1109/​SUTC.​2010.​50
Zurück zum Zitat Qi J, Buechley L (2010) Electronic popables: exploring paper-based computing through an interactive pop-up book. In: Proceedings of the fourth international conference on tangible, embedded, and embodied interaction—TEI ‘10. ACM Press, New York, NY. https://doi.org/10.1145/1709886.1709909 Qi J, Buechley L (2010) Electronic popables: exploring paper-based computing through an interactive pop-up book. In: Proceedings of the fourth international conference on tangible, embedded, and embodied interaction—TEI ‘10. ACM Press, New York, NY. https://​doi.​org/​10.​1145/​1709886.​1709909
Zurück zum Zitat Ramirez Leyva EM (2009) ¿ Qué es leer?¿ Qué es la lectura? Redalyc 23:161–188 Ramirez Leyva EM (2009) ¿ Qué es leer?¿ Qué es la lectura? Redalyc 23:161–188
Zurück zum Zitat Ranasinghe N, Suthokumar G, Lee KY, Do EY (2014) Digital flavor interface. In: Proceedings of the adjunct publication of the 27th annual ACM symposium on user interface software and technology—UIST ‘14 adjunct. ACM Press, New York, NY, pp 47–48. https://doi.org/10.1145/2658779.2659107 Ranasinghe N, Suthokumar G, Lee KY, Do EY (2014) Digital flavor interface. In: Proceedings of the adjunct publication of the 27th annual ACM symposium on user interface software and technology—UIST ‘14 adjunct. ACM Press, New York, NY, pp 47–48. https://​doi.​org/​10.​1145/​2658779.​2659107
Zurück zum Zitat Schilit BN, Golovchinsky G, Price MN (1998) Beyond paper: supporting active reading with free form digital ink annotations. In: Proceedings of the SIGCHI conference on human factors in computing systems—CHI ‘98. ACM Press, New York, NY, pp 249–256. https://doi.org/10.1145/274644.274680 Schilit BN, Golovchinsky G, Price MN (1998) Beyond paper: supporting active reading with free form digital ink annotations. In: Proceedings of the SIGCHI conference on human factors in computing systems—CHI ‘98. ACM Press, New York, NY, pp 249–256. https://​doi.​org/​10.​1145/​274644.​274680
Zurück zum Zitat Snow CE, Sweet AP (2003) Reading for comprehension. In: Rethinking reading comprehension. Guilford Publications, pp 1–11 Snow CE, Sweet AP (2003) Reading for comprehension. In: Rethinking reading comprehension. Guilford Publications, pp 1–11
Zurück zum Zitat Vi CT, Marzo A, Ablart D, Memoli G, Subramanian S, Drinkwater B, Obrist M (2017) TastyFloats: a contactless food delivery system. In: Proceedings of the 2017 ACM international conference on interactive surfaces and spaces, pp 161–170. https://doi.org/10.1145/3132272.3134123 Vi CT, Marzo A, Ablart D, Memoli G, Subramanian S, Drinkwater B, Obrist M (2017) TastyFloats: a contactless food delivery system. In: Proceedings of the 2017 ACM international conference on interactive surfaces and spaces, pp 161–170. https://​doi.​org/​10.​1145/​3132272.​3134123
Zurück zum Zitat Von Sprecken D, Kim J, Krashen S (2000) The home run book: can one positive reading experience create a reader? Calif Sch Libr J 23(2):8–9 Von Sprecken D, Kim J, Krashen S (2000) The home run book: can one positive reading experience create a reader? Calif Sch Libr J 23(2):8–9
Zurück zum Zitat Weerasinghe M, Kljun M, Čopič Pucihar K, Quigley A (2018) Novel technologies in teaching and learning towards enhanced knowledge retention. In: womENcourage 2018, Belgrade, Serbia, 3–5 Oct 2018 Weerasinghe M, Kljun M, Čopič Pucihar K, Quigley A (2018) Novel technologies in teaching and learning towards enhanced knowledge retention. In: womENcourage 2018, Belgrade, Serbia, 3–5 Oct 2018
Metadaten
Titel
Augmented Imagination: Creating Immersive and Playful Reading Experiences
verfasst von
Cuauhtli Campos
Julie Ducasse
Klen Čopič Pucihar
Vladimir Geroimenko
Matjaž Kljun
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-54475-0_4