piwik-script

Deutsch Intern
    Media Informatics

    Intelligent Virtual Agents and Culture

    Intelligent Virtual Agents (IVAs) are interactive digital characters that exhibit human-like qualities and can communicate with humans and each other using natural human modalities such as facial expressions, speech and gesture. They are capable of real-time perception, cognition, emotion and action that allow them to participate in dynamic social environments. 

    Culture as a social phenomenon is researched with IVAs for about two decades. In our earlier research, we have focussed on modelling cultural background for IVAs based on national cultures or cultural dimensions. With IVAs that behave in a culture-specific manner (e.g. differences in verbal behaviour, communication management, gesture use, or body posture) differences between prototypical cultural behavioural features can be pointed out, cultural awareness can be raised, or specific user preferences can be met to increase the acceptance of IVAs.

    In our recent research, we investigate IVAs in mixed-cultural settings, particularly when native speakers and non-native speakers meet. A crucial question is how an IVA can be recognized as foreign/outgroup. For example, non-native speech needs to be adequately generated to investigate behavioural phenomena occurring in such mixed-cultural settings.  



    Related publications

    2022[ to top ]
    • The impact of mixed-cultural speech on the stereotypical perception of a virtual robot Obremski, David; Friedrich, Paula; Haak, Nora; Schaper, Philipp; Lugrin, Birgit in Frontiers in Robotics and AI (2022). 9
    • Exploratory Study on the Perception of Intelligent Virtual Agents With Non-Native Accents Using Synthetic and Natural Speech in German Obremski, David; Hering, Helena Babette; Friedrich, Paula; Lugrin, Birgit in INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (2022).
    2021[ to top ]
    • Non-native speaker perception of Intelligent Virtual Agents in two languages: the impact of amount and type of grammatical mistakes Obremski, David; Lugrin, Jean-Luc; Schaper, Philipp; Lugrin, Birgit in Journal on Multimodal User Interfaces (2021).
    2020[ to top ]
    • What if it speaks like it was from the village? Effects of a Robot speaking in Regional Language Variations on Users’ Evaluations Lugrin, B.; Ströle, E.; Obremski, D.; Schwab, F.; Lange, B. in 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2020) (2020). 1315–1320.
    2019[ to top ]
    • Non-Native Speaker Generation and Perception for Mixed-Cultural Settings Obremski, David; Lugrin, Jean-Luc; Schaper, Philipp; Lugrin, Birgit in ACM International Conference on Intelligent Virtual Agents 2019 (2019).
    2018[ to top ]
    • A Pilot Study on Adaptive Gesture Use in Interaction with Non-native Listeners Bergmann, Kirsten; Rull, Maria del Mar Cordero; Lugrin, Birgit in 4th International Workshop on Multimodal Analyses Enabling Artificial Agents in Human-Machine Interaction (2018). 26–32.
    • Adapted Foreigner-directed Communication towards Virtual Agents Lugrin, Birgit; Eckstein, Benjamin; Bergmann, Kirsten; Heindl, Corinna in 18th International Conference on Intelligent Virtual Agents (IVA 2018) (2018). 59–64.
    2017[ to top ]
    • Combining a Data-driven and a Theory-based Approach to Generate Culture-dependent Behaviours for Virtual Characters Lugrin, Birgit; Frommel, Julian; André, Elisabeth in Advances in Culturally-Aware Intelligent Systems and in Cross-Cultural Psychological Studies, C. Faucher (ed.) (2017).
    2015[ to top ]
    • Learning to Overcome Cultural Conflict through Engaging with Intelligent Agents in Synthetic Cultures Hall, L.; Tazzyman, S.; Hume, C.; Endrass, B.; Lim, M.; Hofstede, G.; Paiva, A.; André, E.; Kappas, A.; Aylett, R. in International Journal of Artificial Intelligence in Education (2015). 25(2) 291–317.
    • Modeling and Evaluating a Bayesian Network of Culture-dependent Behaviors Lugrin, Birgit; Frommel, Julian; André, Elisabeth in International Conference on Culture and Computing (2015).
    2014[ to top ]
    • Werewolves, Cheats, and Cultural Sensitivity Aylett, Ruth; Hall, Lynne E.; Tazzyman, Sarah; Endrass, Birgit; André, Elisabeth; Ritter, Christopher; Nazir, Asad; Paiva, Ana; Hofstede, Gert Jan; Kappas, Arvid in International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2014), A. L. C. Bazzan, M. N. Huhns, A. Lomuscio, P. Scerri (eds.) (2014). 1085–1092.
    • {MIXER: why the difference?} Nazir, Asad; Aylett, Ruth S.; Lim, Mei Yii; Endrass, Birgit; Hall, Lynne E.; Ritter, Christopher in International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2014), A. L. C. Bazzan, M. N. Huhns, A. Lomuscio, P. Scerri (eds.) (2014). 1687–1688.
    • Effects of Language Variety on Personality Perception in Embodied Conversational Agents Krenn, Brigitte; Endrass, Birgit; Kistler, Felix; André, Elisabeth in 16th International Conference on Human-Computer Interaction. Advanced Interaction Modalities and Techniques, LNCS, M. Kurosu (ed.) (2014). (Vol. 8511) 429–439.
    • {W}hat {I} {S}ee is {N}ot {W}hat {Y}ou {G}et: {W}hy {C}ulture-{S}pecific {B}ehaviours for {V}irtual {C}haracters {S}hould {B}e {U}ser-{T}ested {A}cross {C}ultures Degens, Nick; Endrass, Birgit; Hofstede, Gert Jan; Beulens, Adrie; André, Elisabeth in {AI} and {S}ociety (2014).
    • A hybrid Approach to model a Bayesian Network of Culture-specific Behavior Endrass, Birgit; Frommel, Julian; André, Elisabeth in International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2014), A. L. C. Bazzan, M. N. Huhns, A. Lomuscio, P. Scerri (eds.) (2014). 1395–1396.
    • Engaging with Virtual Characters using a Pictorial Interaction Language Endrass, Birgit; Hall, Lynne E.; Hume, Colette; Tazzyman, Sarah; André, Elisabeth; Aylett, Ruth in Extended Abstracts on Human Factors in Computing Systems (CHI EA 2014), M. Jones, P. A. Palanque, A. Schmidt, T. Grossman (eds.) (2014). 531–534.
    • {Integration of Cultural Factors into the Behavioural Models of Virtual Characters} B. Endrass, E. André in Natural Language Generation in Interactive Systems, A. Stent, S. Bangalore (eds.) (2014). 227–251.
    • A Pictorial Interaction Language for Children to Communicate with Cultural Virtual Characters Endrass, Birgit; Hall, Lynne E.; Hume, Colette; Tazzyman, Sarah; André, Elisabeth in 16th International Conference on Human-Computer Interaction. Advanced Interaction Modalities and Techniques, LNCS, M. Kurosu (ed.) (2014). (Vol. 8511) 532–543.
    2013[ to top ]
    • Cultural Diversity for Virtual Characters (Extended Abstract) Endrass, Birgit in International Joint Conference on Artificial Intelligence (IJCAI 2013), F. Rossi (ed.) (2013).
    • Investigating Culture-related Aspects of Behavior for Virtual Characters Endrass, Birgit; André, Elisabeth; Rehm, Matthias; Nakano, Yukiko in Autonomous Agents and Multi-Agent Systems (2013). 27(2) 277–304.
    • Investigating the Influence of Culture on Proxemic Behaviors for Humanoid Robots Eresha, Ghadeer; Häring, Markus; Endrass, Birgit; André, Elisabeth; Obaid, Mohammad in International Symposium on Robot and Human Interactive Communication (RO-MAN 2013) (2013). 430–435.
    2012[ to top ]
    • Cultural Diversity for Virtual Characters - Investigating Behavioral Aspects across Cultures. Endrass, Birgit PhD thesis, Universität Augsburg. (2012). I–IV, 1.
    • ECUTE: Difference is good! Nazir, A; Ritter, C; Aylett, R; Krumhuber, E; Swiderska, A; Degens, N; Endrass, B in International Conference on E-Learning, (IADIS) (2012). 425–429.
    • {Cultural Behaviors of Virtual Agents in an Augmented Reality Environment} Obaid, Mohammad; Damian, Ionut; Kistler, Felix; Endrass, Birgit; Wagner, Johannes; André, Elisabeth in 12th International Conference on Intelligent Virtual Agents (IVA 2012), LNCS, Y. I. Nakano, M. Neff, A. Paiva, M. A. Walker (eds.) (2012). (Vol. 7502) 412–418.
    • Natural Interaction with Culturally Adaptive Virtual Characters Kistler, Felix; Endrass, Birgit; Damian, Ionut; Dang, Chi Tai; André, Elisabeth in Multimodal User Interfaces (2012). 6(1-2) 39–47.
    2011[ to top ]
    • Integration and Evaluation of Prototypical Culture-related Differences Endrass, Birgit; Degens, Nick; Hofstede, Gert Jan; André, Elisabeth; Hodgson, John; Mascarenhas, Samuel; Mehlmann, Gregor; Paiva, Ana; Ritter, Christopher; Swiderska, Aleksandra in Workshop on Culturally Motivated Virtual Characters (CMVC 2011), in conjunction with IVA 2011 (2011).
    • Planning Small Talk Behavior with Cultural Influences for Multiagent Systems Endrass, Birgit; Rehm, Matthias; André, Elisabeth in Computer Speech \& Language (2011). 25(2) 158–174.
    • Culture-Related Topic Selection in Small Talk Conversations across Germany and Japan Endrass, Birgit; Nakano, Yukiko I.; Lipi, Afia Akhter; Rehm, Matthias; André, Elisabeth in 11th International Conference on Intelligent Virtual Agents (IVA 2011), LNCS, H. H. Vilhjálmsson, S. Kopp, S. Marsella, K. R. Thórisson (eds.) (2011). (Vol. 6895) 1–13.
    • {Culture-related Differences in Aspects of Behavior for Virtual Characters across Germany and Japan} Endrass, Birgit; André, Elisabeth; Rehm, Matthias; Lipi, Afia Akhter; Nakano, Yukiko I. in 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2011), L. Sonenberg, P. Stone, K. Tumer, P. Yolum (eds.) (2011). 441–448.
    2010[ to top ]
    • Generating Culture-Specific Gestures for Virtual Agent Dialogs Endrass, Birgit; Damian, Ionut; Huber, Peter; Rehm, Matthias; André, Elisabeth in 10th International Conference on Intelligent Virtual Agents (IVA 2010), LNCS, J. M. Allbeck, N. I. Badler, T. W. Bickmore, C. Pelachaud, A. Safonova (eds.) (2010). (Vol. 6356) 329–335.
    • A data-driven approach to model culture-specific communication management styles for virtual agents Endrass, Birgit; André, Elisabeth; Huang, Lixing; Gratch, Jonathan in 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2010), W. van der Hoek, G. A. Kaminka, Y. Lespérance, M. Luck, S. Sen (eds.) (2010). (Vol. 1) 99–108.
    • Towards Culturally-Aware Virtual Agent Systems Endrass, Birgit; André, Elisabeth; Rehm, Matthias in Handbook of Research on Culturally-Aware Information Technology: Perspectives and Models: Perspectives and Models, E. G. Blanchard, D. Allard (eds.) (2010). 412–430.
    2009[ to top ]
    • From observation to simulation: generating culture-specific behavior for interactive systems Rehm, Matthias; Nakano, Yukiko I.; André, Elisabeth; Nishida, Toyoaki; Bee, Nikolaus; Endrass, Birgit; Wissner, Michael; Lipi, Afia Akhter; Huang, Hung-Hsuan in {AI \& Society} (2009). 24(3) 267–280.
    • {Creating Standardized Video Recordings of Multimodal Interactions across Cultures} Rehm, Matthias; André, Elisabeth; Bee, Nikolaus; Endrass, Birgit; Wissner, Michael; Nakano, Yukiko I.; Lipi, Afia Akhter; Nishida, Toyoaki; Huang, Hung-Hsuan in Multimodal Corpora, M. Kipp, J.-C. Martin, P. Paggio, D. Heylen (eds.) (2009). (Vol. 5509) 138–159.
    • {Culture-specific Communication Management for Virtual Agents} Endrass, Birgit; Rehm, Matthias; André, Elisabeth in 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2009), AAMAS \u002709, C. Sierra, C. Castelfranchi, K. S. Decker, J. S. Sichman (eds.) (2009). (Vol. 1) 281–287.
    2008[ to top ]
    • Talk is silver, silence is golden: A cross-cultural study on the use of pauses in speech Endrass, Birgit; Rehm, Matthias; André, Elisabeth; Nakano, Yukiko in 4th International Workshop on Human-Computer Conversation (2008).
    2007[ to top ]
    • {The CUBE-G approach - Coaching culture-specific nonverbal behavior by virtual agents} Rehm, Matthias; André, Elisabeth; Nakano, Yukiko; Nishida, Toyoaki; Bee, Nikolaus; Endrass, Birgit; Huan, Hung-Hsuan; Wissner, Michael in Organizing and Learning through Gaming and Simulation (ISAGA 2007), I. Mayer, H. Mastik (eds.) (2007).