piwik-script

Deutsch Intern
    Media Informatics

    Social Robots and Multimodal Storytelling

    Storytelling is an important and long-established human cultural technique. Fields of application include the transfer of knowledge between generations or single persons, communication of social norms, values or warning of danger, storytelling in health and medicine, or entertainment.

    Socially Interactive Agents (SIAs), with either a virtual or robotic embodiment, bear great potential as storytellers as they can enhance the storytelling experience though multiple channels. Our research addresses SIAs in storytelling scenarios from two sides: In controlled studies, we investigate how different multimodal behaviours, e.g. emotional facial display, affect the perception of human users. Based on finite state machines, we investigate how the SIAs’ behaviours can dynamically react to the interaction of the user, taking the current state of the story into account.    



    Related publications

    2022[ to top ]
    • Designing Social Robots’ Speech in the Hotel Context-A Series of Online Studies Steinhaeusser, Sophia C.; Lein, Martina; Donnermann, Melissa; Lugrin, Birgit in 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) (2022). 163–170.
    • Effects of Colored LEDs in Robotic Storytelling on Storytelling Experience and Robot Perception Steinhaeusser, Sophia C.; Lugrin, Birgit in Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction (HRI2022) (2022).
    2021[ to top ]
    • Anthropomorphize me! - Effects of Robot Gender on Listeners’ Perception of the Social Robot NAO in a Storytelling Use Case Steinhaeusser, Sophia C.; Schaper, Philipp; Akuffo, Ohenewa Bediako; Friedrich, Paula; Ön, Jülide; Lugrin, Birgit in Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (HRI 2021), C. Bethel, A. Paiva, E. Broadbent, D. Feil-Seifer, D. Szafir (eds.) (2021).
    • Comparing a Robotic Storyteller versus Audio Book with Integration of Sound Effects and Background Music Steinhaeusser, Sophia C.; Schaper, Philipp; Lugrin, Birgit in Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (HRI 2021), C. Bethel, A. Paiva, E. Broadbent, D. Feil-Seifer, D. Szafir (eds.) (2021).
    • Your New Friend NAO vs. Robot No. 783 - Effects of Personal or Impersonal Framing in a Robotic Storytelling Use Case Steinhaeusser, Sophia C.; Gabel, Juliane J.; Lugrin, Birgit in Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (HRI 2021), C. Bethel, A. Paiva, E. Broadbent, D. Feil-Seifer, D. Szafir (eds.) (2021).
    • The emotional robotic storyteller: On the influence of affect congruency on narrative transportation, robot perception, and persuasion Appel, Markus; Lugrin, Birgit; Kühle, Mayla; Heindl, Corinna in Computers in Human Behavior (2021). 106749.
    2019[ to top ]
    • Modeling and Evaluating Emotion, Contextual Head Movement and Voices for a Social Robot Storyteller Striepe, Hendrik; Donnermann, Melissa; Lein, Martina; Lugrin, Birgit in International Journal of Social Robotics (2019).
    • Towards Narrative-Driven Atmosphere for Virtual Classroom Lugrin, Jean-Luc; Latoschik, Marc Erich; Glémarec, Yann; Bosser, Anne-Gween; Chollet, Mathieu; Lugrin, Birgit in Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (2019). 1–6.
    2018[ to top ]
    • Follow the White Robot - A Role-Playing Game with a Robot Game Master Fischbach, Martin; Brandt, Michael; Zimmerer, Chris; Lugrin, Jean-Luc; Latoschik, Marc Erich; Lugrin, Birgit in 17th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS 2018), AAMAS \u002718 (2018). 1812–1814.
    2017[ to top ]
    • There Once Was a Robot Storyteller: Measuring the Effects of Emotion and Non-verbal Behaviour Striepe, Hendrik; Lugrin, Birgit in 9th International Conference on Social Robotics (ICSR 2017), LNCS (2017).
    2014[ to top ]
    • A Pictorial Interaction Language for Children to Communicate with Cultural Virtual Characters Endrass, Birgit; Hall, Lynne E.; Hume, Colette; Tazzyman, Sarah; André, Elisabeth in 16th International Conference on Human-Computer Interaction. Advanced Interaction Modalities and Techniques, LNCS, M. Kurosu (ed.) (2014). (Vol. 8511) 532–543.
    • Designing User-Character Dialog in Interactive Narratives: An Exploratory Experiment Endrass, Birgit; Klimmt, Christoph; Mehlmann, Gregor; André, Elisabeth; Roth, Christian in IEEE Transactions on Computational Intelligence and AI in Games (2014). 6(2) 166–173.
    • {Full Body Interaction with Virtual Characters in an Interactive Storytelling Scenario} Kistler, Felix; Endrass, Birgit; André, Elisabeth in 14th International Conference on Intelligent Virtual Agents (IVA 2014), LNCS, T. W. Bickmore, S. Marsella, C. L. Sidner (eds.) (2014). (Vol. 8637) 236–239.
    2011[ to top ]
    • Modeling Parallel State Charts for Multithreaded Multimodal Dialogues Mehlmann, Gregor; Endrass, Birgit; André, Elisabeth in 13th International Conference on Multimodal Interfaces (ICMI 2011), H. Bourlard, T. S. Huang, E. Vidal, D. Gatica-Perez, L.-P. Morency, N. Sebe (eds.) (2011). 385–392.
    • Exploration of User Reactions to Different Dialog-Based Interaction Styles Endrass, Birgit; Klimmt, Christoph; Mehlmann, Gregor; André, Elisabeth; Roth, Christian in 4th International Conference on Interactive Digital Storytelling (ICIDS 2011), LNCS, M. Si, D. Thue, E. André, J. C. Lester, J. Tanenbaum, V. Zammitto (eds.) (2011). (Vol. 7069) 243–248.
    2009[ to top ]
    • What Would You Do in Their Shoes? Experiencing Different Perspectives in an Interactive Drama for Multiple Users Endrass, Birgit; Boegler, Michael; Bee, Nikolaus; André, Elisabeth in 2nd International Conference on Interactive Digital Storytelling (ICIDS 2009), LNCS, I. Iurgel, N. Zagalo, P. Petta (eds.) (2009). (Vol. 5915) 258–268.
    2007[ to top ]
    • Integrating the user in the social group dynamics of agents Rehm, Matthias; Endrass, Birgit; Wissner, Michael in Social Intelligence Design (SID) (2007).