extended-abstract
- Authors:
- Mirjam de Haas University of Applied Sciences Utrecht, Netherlands
- Ranya Alali University of Applied Sciences Utrecht, Netherlands
- Merry Ashji University of Applied Sciences Utrecht, Netherlands
- Shireen Hussain The Hague University of Applied Sciences, Netherlands
- Charissa Ten Katen University of Applied Sciences Leiden, Netherlands
- Ahmad Salaymeh University of Applied Sciences Utrecht, Netherlands
- Veerle Hobbelink University of Applied Sciences Utrecht, Netherlands
- Rianne van den Berghe IPABO University of Applied Sciences, Netherlands
IPABO University of Applied Sciences, Netherlands
See AlsoWhat is Interaction Design (IxD)? — updated 202410 Interactive Design Examples to Inspire YouWas tun Sie, wenn Sie mit neuer Technologie immersive Spielerlebnisse schaffen möchten?The best interactive experiences for brands at EuropeSearch about this author
IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children ConferenceJune 2024Pages 696–700https://doi.org/10.1145/3628516.3659377
- 0citation
- 0
- Downloads
Metrics
Total Citations0Total Downloads0Last 12 Months0
Last 6 weeks0
- Get Citation Alerts
New Citation Alert added!
This alert has been successfully added and will be sent to:
You will be notified whenever a record that you have chosen has been cited.
To manage your alert preferences, click on the button below.
Manage my Alerts
New Citation Alert!
Please log in to your account
- Publisher Site
IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children Conference
Interactive Storytelling with Social Robots to Support Multilingual Children
Pages 696–700
PreviousChapterNextChapter
ABSTRACT
This study investigates the impact of an educational social storytelling robot on multilingual children aged 4-12 years by telling stories in their native language (Arabic). This work emphasizes the importance of using native languages within schools to stimulate inclusion and learning. Our experiment compared two conditions: one where the NAO robot engaged in interactive storytelling by using gestures and posing questions, and another where it merely told the story. Children enjoyed the sessions and the use of their native language in particular, and there was a trend suggesting that children knew more target words after the storytelling sessions. However, there were no significant differences in learning outcomes, engagement, enjoyment, or story comprehension between the interactive and non-interactive conditions. Together, these findings suggest a promising role for using educational robots in storytelling to support multilingual children.
References
- Tony Belpaeme, James Kennedy, Aditi Ramachandran, Brian Scassellati, and Fumihide Tanaka. 2018. Social robots for education: A review. Science Robotics 3, 21 (2018), eaat5954. https://doi.org/10.1126/scirobotics.aat5954Google Scholar
Cross Ref
- Huili Chen, HaeWon Park, and Cynthia Breazeal. 2020. Teaching and learning with children: Impact of reciprocal peer learning with a social robot on children’s learning and emotive engagement. Computers & Education 150 (2020), 103836. https://doi.org/10.1016/j.compedu.2020.103836Google Scholar
Digital Library
- Josephine co*ck and Beat Meier. 2012. Encyclopedia of the Sciences of Learning. Springer, Chapter Task sequencing and learning, 3266–3269.Google Scholar
- Daniela Conti, Alessandro DiNuovo, Carla Cirasa, and Santo DiNuovo. 2017. A Comparison of Kindergarten Storytelling by Human and Humanoid Robot with Different Social Behavior. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (Vienna, Austria) (HRI ’17). Association for Computing Machinery, New York, NY, USA, 97–98. https://doi.org/10.1145/3029798.3038359Google Scholar
Digital Library
- Mirjam de Haas, Paul Vogt, and Emiel Krahmer. 2020. The Effects of Feedback on Children’s Engagement and Learning Outcomes in Robot-Assisted Second Language Learning. Frontiers in Robotics and AI 7 (2020). https://doi.org/10.3389/frobt.2020.00101Google Scholar
Cross Ref
- Mirjam de Haas, Paul Vogt, Rianne van den Berghe, Paul Leseman, Ora Oudgenoeg-Paz, Bram Willemsen, Jan de Wit, and Emiel Krahmer. 2022. Engagement in longitudinal child-robot language learning interactions: Disentangling robot and task engagement. International Journal of Child-Computer Interaction 33 (2022), 100501. https://doi.org/10.1016/j.ijcci.2022.100501Google Scholar
Digital Library
- Jan de Wit, Arold Brandse, Emiel Krahmer, and Paul Vogt. 2020. Varied Human-Like Gestures for Social Robots: Investigating the Effects on Children’s Engagement and Language Learning. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI ’20). Association for Computing Machinery, New York, NY, USA, 359–367. https://doi.org/10.1145/3319502.3374815Google Scholar
Digital Library
- Jan de Wit, Paul Vogt, and Emiel Krahmer. 2023. The Design and Observed Effects of Robot-performed Manual Gestures: A Systematic Review. J. Hum.-Robot Interact. 12, 1, Article 1 (feb 2023), 62pages. https://doi.org/10.1145/3549530Google Scholar
Digital Library
- L.M. Dunn and D.M. Dunn. 1997. Peabody Picture Vocabulary Test–III. Circle Pines, MN: American Guidance Service.Google Scholar
- Linda Faas. 2019. De jongen en de walvis. Lemniscaat.Google Scholar
- Susan Goldin-Meadow and MarthaWagner Alibali. 2013. Gesture’s Role in Speaking, Learning, and Creating Language. Annual Review of Psychology 64, Volume 64, 2013 (2013), 257–283. https://doi.org/10.1146/annurev-psych-113011-143802Google Scholar
Cross Ref
- EllyA Konijn, Brechtje Jansen, Victoria MondacaBustos, VeerleLNF Hobbelink, and Daniel PreciadoVanegas. 2022. Social robots for (second) language learning in (migrant) primary school children. International Journal of Social Robotics (2022), 1–17. https://doi.org/10.1007/s12369-021-00824-3Google Scholar
Cross Ref
- EllyA Konijn, Matthijs Smakman, and Rianne Berghe. 2020. Use of robots in education. In The international encyclopedia of media psychology. Wiley, 1–8. https://doi.org/10.1002/9781119011071.iemp0318Google Scholar
Cross Ref
- TerryK Koo and MaeY Li. 2016. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of Chiropractic Medicine 15, 2 (2016), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012Google Scholar
Cross Ref
- JacquelineM. KoryWestlund, Sooyeon Jeong, HaeW. Park, Samuel Ronfard, Aradhana Adhikari, PaulL. Harris, David DeSteno, and CynthiaL. Breazeal. 2017. Flat vs. Expressive Storytelling: Young Children’s Learning and Retention of a Social Robot’s Narrative. Frontiers in Human Neuroscience 11 (2017). https://doi.org/10.3389/fnhum.2017.00295Google Scholar
Cross Ref
- Hanneke Leeuwestein, Marie Barking, Hande Sodacı, Ora Oudgenoeg-Paz, Josje Verhagen, Paul Vogt, Rian Aarts, Sybren Spit, Mirjam de Haas, Jan de Wit, and Paul Leseman. 2021. Teaching Turkish-Dutch kindergartners Dutch vocabulary with a social robot: Does the robot’s use of Turkish translations benefit children’s Dutch vocabulary learning?Journal of Computer Assisted Learning 37, 3 (2021), 603–620. https://doi.org/10.1111/jcal.12510Google Scholar
Cross Ref
- MikeE.U. Ligthart, MarkA. Neerincx, and KoenV. Hindriks. 2020. Design Patterns for an Interactive Storytelling Robot to Support Children’s Engagement and Agency. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI ’20). Association for Computing Machinery, New York, NY, USA, 409–418. https://doi.org/10.1145/3319502.3374826Google Scholar
Digital Library
- HaeWon Park, Ishaan Grover, Samuel Spaulding, Louis Gomez, and Cynthia Breazeal. 2019. A Model-Free Affective Reinforcement Learning Approach to Personalization of an Autonomous Social Robot Companion for Early Literacy Education. Proceedings of the AAAI Conference on Artificial Intelligence 33, 01 (Jul. 2019), 687–694. https://doi.org/10.1609/aaai.v33i01.3301687Google Scholar
Digital Library
- Ming Sun, Iolanda Leite, JillFain Lehman, and Boyang Li. 2017. Collaborative Storytelling between Robot and Child: A Feasibility Study. In Proceedings of the 2017 Conference on Interaction Design and Children (Stanford, California, USA) (IDC ’17). Association for Computing Machinery, New York, NY, USA, 205–214. https://doi.org/10.1145/3078072.3079714Google Scholar
Digital Library
- JerzyP. Szaflarski, VincentJ. Schmithorst, Mekibib Altaye, AnnaW. Byars, Jennifer Ret, Elena Plante, and ScottK. Holland. 2006. A longitudinal functional magnetic resonance imaging study of language development in children 5 to 11 years old. Annals of Neurology 59, 5 (2006), 796–807. https://doi.org/10.1002/ana.20817Google Scholar
Cross Ref
- Rianne vanden Berghe. 2022. Social robots in a translanguaging pedagogy: A review to identify opportunities for robot-assisted (language) learning. Frontiers in Robotics and AI 9 (2022). https://doi.org/10.3389/frobt.2022.958624Google Scholar
Cross Ref
- Rianne vanden Berghe, Josje Verhagen, Ora Oudgenoeg-Paz, Sanne vander Ven, and Paul Leseman. 2019. Social Robots for Language Learning: A Review. Review of Educational Research 89, 2 (2019), 259–295. https://doi.org/10.3102/0034654318821286Google Scholar
Cross Ref
- Inspectie vanhet Onderwijs. 2019. PEIL.MONDELINGE TAALVAARDIGHEID EINDE BASISONDERWIJS. Chapter2. https://www.onderwijsinspectie.nl/binaries/onderwijsinspectie/documenten/rapporten/2019/03/28/peil-mtv-hoofdstuk-2-taalachtergrond/peil+mtv+taalachtergrond.pdfGoogle Scholar
- Paul Vogt, Rianne vanden Berghe, Mirjam de Haas, Laura Hoffman, Junko Kanero, Ezgi Mamus, Jean-Marc Montanier, Cansu Oranç, Ora Oudgenoeg-Paz, DanielHernández García, Fotios Papadopoulos, Thorsten Schodde, Josje Verhagen, ChristopherD. Wallbridgell, Bram Willemsen, Jan de Wit, Tony Belpaeme, Tilbe Göksun, Stefan Kopp, Emiel Krahmer, AylinC. Küntay, Paul Leseman, and AmitKumar Pandey. 2019. Second Language Tutoring Using Social Robots: A Large-Scale Study. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 497–505. https://doi.org/10.1109/HRI.2019.8673077Google Scholar
Cross Ref
Cited By
View all
Index Terms
Interactive Storytelling with Social Robots to Support Multilingual Children
Applied computing
Education
Computer-assisted instruction
Human-centered computing
Human computer interaction (HCI)
Interaction paradigms
Collaborative interaction
Recommendations
- The experience of interactive storytelling: comparing “fahrenheit” with “façade”
ICEC'11: Proceedings of the 10th international conference on Entertainment Computing
At the intersection of multimedia, artificial intelligence, and gaming technology, new visions of future entertainment media arise that approximate the “Holodeck” ® idea of interactive storytelling. We report exploratory experiments on the user ...
Read More
- Design Patterns for an Interactive Storytelling Robot to Support Children's Engagement and Agency
HRI '20: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction
In this paper we specify and validate three interaction design patterns for an interactive storytelling experience with an autonomous social robot. The patterns enable the child to make decisions about the story by talking with the robot, reenact parts ...
Read More
- The Motivational Appeal of Interactive Storytelling: Towards a Dimensional Model of the User Experience
ICIDS '09: Proceedings of the 2nd Joint International Conference on Interactive Digital Storytelling: Interactive Storytelling
A conceptual account to the quality of the user experience that interactive storytelling intends to facilitate is introduced. Building on socialscientific research from `old' entertainment media, the experiential qualities of curiosity, suspense, ...
Read More
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in
Full Access
Get this Publication
- Information
- Contributors
Published in
IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children Conference
June 2024
1049 pages
ISBN:9798400704420
DOI:10.1145/3628516
Copyright © 2024 Owner/Author
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 17 June 2024
Author Tags
- Interactive Storytelling
- Language Learning
- Robot Tutors
- Social Robots
Qualifiers
- extended-abstract
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate172of578submissions,30%
Funding Sources
Other Metrics
View Article Metrics
- Bibliometrics
- Citations0
Article Metrics
- View Citations
Total Citations
Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Other Metrics
View Author Metrics
Cited By
This publication has not been cited yet
Digital Edition
View this article in digital edition.
View Digital Edition
- Figures
- Other
Close Figure Viewer
Browse AllReturn
Caption
View Table of Contents
Export Citations
Your Search Results Download Request
We are preparing your search results for download ...
We will inform you here when the file is ready.
Download now!
Your Search Results Download Request
Your file of search results citations is now ready.
Download now!
Your Search Results Download Request
Your search export query has expired. Please try again.