Interactive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (2024)

Interactive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (2)

Advanced Search

idc

extended-abstract

IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children ConferenceJune 2024Pages 696–700https://doi.org/10.1145/3628516.3659377

Published:17 June 2024Publication HistoryInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (11)

  • 0citation
  • 0
  • Downloads

Metrics

Total Citations0Total Downloads0

Last 12 Months0

Last 6 weeks0

  • Get Citation Alerts

    New Citation Alert added!

    This alert has been successfully added and will be sent to:

    You will be notified whenever a record that you have chosen has been cited.

    To manage your alert preferences, click on the button below.

    Manage my Alerts

    New Citation Alert!

    Please log in to your account

  • Publisher Site

IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children Conference

Interactive Storytelling with Social Robots to Support Multilingual Children

Pages 696–700

PreviousChapterNextChapter

Interactive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (12)

ABSTRACT

This study investigates the impact of an educational social storytelling robot on multilingual children aged 4-12 years by telling stories in their native language (Arabic). This work emphasizes the importance of using native languages within schools to stimulate inclusion and learning. Our experiment compared two conditions: one where the NAO robot engaged in interactive storytelling by using gestures and posing questions, and another where it merely told the story. Children enjoyed the sessions and the use of their native language in particular, and there was a trend suggesting that children knew more target words after the storytelling sessions. However, there were no significant differences in learning outcomes, engagement, enjoyment, or story comprehension between the interactive and non-interactive conditions. Together, these findings suggest a promising role for using educational robots in storytelling to support multilingual children.

References

  1. Tony Belpaeme, James Kennedy, Aditi Ramachandran, Brian Scassellati, and Fumihide Tanaka. 2018. Social robots for education: A review. Science Robotics 3, 21 (2018), eaat5954. https://doi.org/10.1126/scirobotics.aat5954Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (13)Cross Ref
  2. Huili Chen, HaeWon Park, and Cynthia Breazeal. 2020. Teaching and learning with children: Impact of reciprocal peer learning with a social robot on children’s learning and emotive engagement. Computers & Education 150 (2020), 103836. https://doi.org/10.1016/j.compedu.2020.103836Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (15)Digital Library
  3. Josephine co*ck and Beat Meier. 2012. Encyclopedia of the Sciences of Learning. Springer, Chapter Task sequencing and learning, 3266–3269.Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (17)
  4. Daniela Conti, Alessandro DiNuovo, Carla Cirasa, and Santo DiNuovo. 2017. A Comparison of Kindergarten Storytelling by Human and Humanoid Robot with Different Social Behavior. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (Vienna, Austria) (HRI ’17). Association for Computing Machinery, New York, NY, USA, 97–98. https://doi.org/10.1145/3029798.3038359Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (18)Digital Library
  5. Mirjam de Haas, Paul Vogt, and Emiel Krahmer. 2020. The Effects of Feedback on Children’s Engagement and Learning Outcomes in Robot-Assisted Second Language Learning. Frontiers in Robotics and AI 7 (2020). https://doi.org/10.3389/frobt.2020.00101Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (20)Cross Ref
  6. Mirjam de Haas, Paul Vogt, Rianne van den Berghe, Paul Leseman, Ora Oudgenoeg-Paz, Bram Willemsen, Jan de Wit, and Emiel Krahmer. 2022. Engagement in longitudinal child-robot language learning interactions: Disentangling robot and task engagement. International Journal of Child-Computer Interaction 33 (2022), 100501. https://doi.org/10.1016/j.ijcci.2022.100501Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (22)Digital Library
  7. Jan de Wit, Arold Brandse, Emiel Krahmer, and Paul Vogt. 2020. Varied Human-Like Gestures for Social Robots: Investigating the Effects on Children’s Engagement and Language Learning. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI ’20). Association for Computing Machinery, New York, NY, USA, 359–367. https://doi.org/10.1145/3319502.3374815Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (24)Digital Library
  8. Jan de Wit, Paul Vogt, and Emiel Krahmer. 2023. The Design and Observed Effects of Robot-performed Manual Gestures: A Systematic Review. J. Hum.-Robot Interact. 12, 1, Article 1 (feb 2023), 62pages. https://doi.org/10.1145/3549530Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (26)Digital Library
  9. L.M. Dunn and D.M. Dunn. 1997. Peabody Picture Vocabulary Test–III. Circle Pines, MN: American Guidance Service.Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (28)
  10. Linda Faas. 2019. De jongen en de walvis. Lemniscaat.Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (29)
  11. Susan Goldin-Meadow and MarthaWagner Alibali. 2013. Gesture’s Role in Speaking, Learning, and Creating Language. Annual Review of Psychology 64, Volume 64, 2013 (2013), 257–283. https://doi.org/10.1146/annurev-psych-113011-143802Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (30)Cross Ref
  12. EllyA Konijn, Brechtje Jansen, Victoria MondacaBustos, VeerleLNF Hobbelink, and Daniel PreciadoVanegas. 2022. Social robots for (second) language learning in (migrant) primary school children. International Journal of Social Robotics (2022), 1–17. https://doi.org/10.1007/s12369-021-00824-3Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (32)Cross Ref
  13. EllyA Konijn, Matthijs Smakman, and Rianne Berghe. 2020. Use of robots in education. In The international encyclopedia of media psychology. Wiley, 1–8. https://doi.org/10.1002/9781119011071.iemp0318Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (34)Cross Ref
  14. TerryK Koo and MaeY Li. 2016. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of Chiropractic Medicine 15, 2 (2016), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (36)Cross Ref
  15. JacquelineM. KoryWestlund, Sooyeon Jeong, HaeW. Park, Samuel Ronfard, Aradhana Adhikari, PaulL. Harris, David DeSteno, and CynthiaL. Breazeal. 2017. Flat vs. Expressive Storytelling: Young Children’s Learning and Retention of a Social Robot’s Narrative. Frontiers in Human Neuroscience 11 (2017). https://doi.org/10.3389/fnhum.2017.00295Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (38)Cross Ref
  16. Hanneke Leeuwestein, Marie Barking, Hande Sodacı, Ora Oudgenoeg-Paz, Josje Verhagen, Paul Vogt, Rian Aarts, Sybren Spit, Mirjam de Haas, Jan de Wit, and Paul Leseman. 2021. Teaching Turkish-Dutch kindergartners Dutch vocabulary with a social robot: Does the robot’s use of Turkish translations benefit children’s Dutch vocabulary learning?Journal of Computer Assisted Learning 37, 3 (2021), 603–620. https://doi.org/10.1111/jcal.12510Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (40)Cross Ref
  17. MikeE.U. Ligthart, MarkA. Neerincx, and KoenV. Hindriks. 2020. Design Patterns for an Interactive Storytelling Robot to Support Children’s Engagement and Agency. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI ’20). Association for Computing Machinery, New York, NY, USA, 409–418. https://doi.org/10.1145/3319502.3374826Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (42)Digital Library
  18. HaeWon Park, Ishaan Grover, Samuel Spaulding, Louis Gomez, and Cynthia Breazeal. 2019. A Model-Free Affective Reinforcement Learning Approach to Personalization of an Autonomous Social Robot Companion for Early Literacy Education. Proceedings of the AAAI Conference on Artificial Intelligence 33, 01 (Jul. 2019), 687–694. https://doi.org/10.1609/aaai.v33i01.3301687Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (44)Digital Library
  19. Ming Sun, Iolanda Leite, JillFain Lehman, and Boyang Li. 2017. Collaborative Storytelling between Robot and Child: A Feasibility Study. In Proceedings of the 2017 Conference on Interaction Design and Children (Stanford, California, USA) (IDC ’17). Association for Computing Machinery, New York, NY, USA, 205–214. https://doi.org/10.1145/3078072.3079714Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (46)Digital Library
  20. JerzyP. Szaflarski, VincentJ. Schmithorst, Mekibib Altaye, AnnaW. Byars, Jennifer Ret, Elena Plante, and ScottK. Holland. 2006. A longitudinal functional magnetic resonance imaging study of language development in children 5 to 11 years old. Annals of Neurology 59, 5 (2006), 796–807. https://doi.org/10.1002/ana.20817Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (48)Cross Ref
  21. Rianne vanden Berghe. 2022. Social robots in a translanguaging pedagogy: A review to identify opportunities for robot-assisted (language) learning. Frontiers in Robotics and AI 9 (2022). https://doi.org/10.3389/frobt.2022.958624Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (50)Cross Ref
  22. Rianne vanden Berghe, Josje Verhagen, Ora Oudgenoeg-Paz, Sanne vander Ven, and Paul Leseman. 2019. Social Robots for Language Learning: A Review. Review of Educational Research 89, 2 (2019), 259–295. https://doi.org/10.3102/0034654318821286Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (52)Cross Ref
  23. Inspectie vanhet Onderwijs. 2019. PEIL.MONDELINGE TAALVAARDIGHEID EINDE BASISONDERWIJS. Chapter2. https://www.onderwijsinspectie.nl/binaries/onderwijsinspectie/documenten/rapporten/2019/03/28/peil-mtv-hoofdstuk-2-taalachtergrond/peil+mtv+taalachtergrond.pdfGoogle ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (54)
  24. Paul Vogt, Rianne vanden Berghe, Mirjam de Haas, Laura Hoffman, Junko Kanero, Ezgi Mamus, Jean-Marc Montanier, Cansu Oranç, Ora Oudgenoeg-Paz, DanielHernández García, Fotios Papadopoulos, Thorsten Schodde, Josje Verhagen, ChristopherD. Wallbridgell, Bram Willemsen, Jan de Wit, Tony Belpaeme, Tilbe Göksun, Stefan Kopp, Emiel Krahmer, AylinC. Küntay, Paul Leseman, and AmitKumar Pandey. 2019. Second Language Tutoring Using Social Robots: A Large-Scale Study. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 497–505. https://doi.org/10.1109/HRI.2019.8673077Google ScholarInteractive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (55)Cross Ref

Cited By

View all

Interactive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (57)

    Index Terms

    1. Interactive Storytelling with Social Robots to Support Multilingual Children

      1. Applied computing

        1. Education

          1. Computer-assisted instruction

        2. Human-centered computing

          1. Human computer interaction (HCI)

            1. Interaction paradigms

        Recommendations

        • The experience of interactive storytelling: comparing “fahrenheit” with “façade”

          ICEC'11: Proceedings of the 10th international conference on Entertainment Computing

          At the intersection of multimedia, artificial intelligence, and gaming technology, new visions of future entertainment media arise that approximate the “Holodeck” ® idea of interactive storytelling. We report exploratory experiments on the user ...

          Read More

        • Design Patterns for an Interactive Storytelling Robot to Support Children's Engagement and Agency

          HRI '20: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction

          In this paper we specify and validate three interaction design patterns for an interactive storytelling experience with an autonomous social robot. The patterns enable the child to make decisions about the story by talking with the robot, reenact parts ...

          Read More

        • The Motivational Appeal of Interactive Storytelling: Towards a Dimensional Model of the User Experience

          ICIDS '09: Proceedings of the 2nd Joint International Conference on Interactive Digital Storytelling: Interactive Storytelling

          A conceptual account to the quality of the user experience that interactive storytelling intends to facilitate is introduced. Building on socialscientific research from `old' entertainment media, the experiential qualities of curiosity, suspense, ...

          Read More

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        Get this Publication

        • Information
        • Contributors
        • Published in

          Interactive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (58)

          IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children Conference

          June 2024

          1049 pages

          ISBN:9798400704420

          DOI:10.1145/3628516

          Copyright © 2024 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Sponsors

            In-Cooperation

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 17 June 2024

              Check for updates

              Interactive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (59)

              Author Tags

              • Interactive Storytelling
              • Language Learning
              • Robot Tutors
              • Social Robots

              Qualifiers

              • extended-abstract
              • Research
              • Refereed limited

              Conference

              Acceptance Rates

              Overall Acceptance Rate172of578submissions,30%

              Upcoming Conference

              IDC '24

              • Sponsor:
              • sigchi

              Interaction Design and Children

              June 17 - 20, 2024

              Delft , Netherlands

              Funding Sources

              • Interactive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (60)

                Other Metrics

                View Article Metrics

              • Bibliometrics
              • Citations0
              • Article Metrics

                • Total Citations

                  View Citations
                • Total Downloads

                • Downloads (Last 12 months)0
                • Downloads (Last 6 weeks)0

                Other Metrics

                View Author Metrics

              • Cited By

                This publication has not been cited yet

              Digital Edition

              View this article in digital edition.

              View Digital Edition

              • Figures
              • Other

                Close Figure Viewer

                Browse AllReturn

                Caption

                View Table of Contents

                Export Citations

                  Your Search Results Download Request

                  We are preparing your search results for download ...

                  We will inform you here when the file is ready.

                  Download now!

                  Your Search Results Download Request

                  Your file of search results citations is now ready.

                  Download now!

                  Your Search Results Download Request

                  Your search export query has expired. Please try again.

                  Interactive Storytelling with Social Robots to Support Multilingual Children | Proceedings of the 23rd Annual ACM Interaction Design and Children Conference (2024)

                  References

                  Top Articles
                  Latest Posts
                  Article information

                  Author: Nathanial Hackett

                  Last Updated:

                  Views: 5707

                  Rating: 4.1 / 5 (72 voted)

                  Reviews: 95% of readers found this page helpful

                  Author information

                  Name: Nathanial Hackett

                  Birthday: 1997-10-09

                  Address: Apt. 935 264 Abshire Canyon, South Nerissachester, NM 01800

                  Phone: +9752624861224

                  Job: Forward Technology Assistant

                  Hobby: Listening to music, Shopping, Vacation, Baton twirling, Flower arranging, Blacksmithing, Do it yourself

                  Introduction: My name is Nathanial Hackett, I am a lovely, curious, smiling, lively, thoughtful, courageous, lively person who loves writing and wants to share my knowledge and understanding with you.