Social-Emotional, AI-Powered Avatar Simulations: Improving Communication & Building Empathy for all!
,
Colorado Convention Center, Innovation Arcade: Connections Theater
Presenters

Session description
Purpose & objective
Extended Reality (XR), Virtual Reality (VR), and Augmented Reality (AR) allow learners to immerse themselves in endless places, times, and roles— real or imagined, but what if we were to harness the power of these realistic simulations to evoke emotional responses from avatar individuals in a safe space to develop people-focused communication skills?
These interactive, low-stake interactions provide learners with opportunities to practice communication strategies with diverse audiences. Together we will walk through the process of how this was done in a variety of ways at the University of Colorado.
Through these interactive XR encounters, learners experience the cultural, racial, and ethnic differences among individuals having menopause symptoms to help reduce disparities in patients’ diagnosis and treatment of menopause. By using emotional avatars, safe scenarios are created where learning opportunities and adjustments are made, with formative feedback provided every step of the way. This technology is changing how we prepare learners to interact with others locally as well as around the world.
Outline
I will be presenting my portfolio of avatars and we will be building our own together and using A.I.). The time will be split between current projects, building our own, and Q&A. This will be highly interactive as we will build out a social-emotional avatar simply by playing MAD-LIBS together!
Supporting research
Carlson, C.G. Virtual and Augmented Simulations in Mental Health. Curr Psychiatry Rep (2023). https://doi.org/10.1007/s11920-023-01438-4
Frey-Vogel AS, Ching K, Dzara K, Mallory L. The Acceptability of Avatar Patients for Teaching and Assessing Pediatric Residents in Communicating Medical Ambiguity. J Grad Med Educ. 2022;14(6):696-703. doi: 10.4300/JGME-D-22-00088.1.
Löllgen RM, Berger-Estilita J, Rössler LA, Mileder LP. Avatar and distance simulation as a learning tool - virtual simulation technology as a facilitator or barrier? A questionnaire-based study on behalf of Netzwerk Kindersimulation e.V. Front Pediatr. 2022;10:853243. doi: 10.3389/fped.2022.853243.
Philippon AL, Legros P, Grattery F, Leygue A, Pierrot V, Faucher S, Khoury A, Pornin A, Truchot J, Bouilleau G. Innovating for a Safe Simulation Challenge During a Pandemic: An Avatar Simulation Concept. Simul Healthc. 2022 Apr 1;17(2):138-139. doi: 10.1097/SIH.0000000000000652.
Shorey S, Ang E, Yap J, Ng ED, Lau ST, Chui CK. A Virtual Counseling Application Using Artificial Intelligence for Communication Skills Training in Nursing Education: Development Study. J Med Internet Res. 2019 Oct 29;21(10):e14658. doi: 10.2196/14658. Erratum in: J Med Internet Res. 2019 Nov 26;21(11):e17064.
Session specifications
Visionary Planner
- Engage education stakeholders in developing and adopting a shared vision for using technology to improve student success, informed by the learning sciences.
- Empower educators to exercise professional agency, build teacher leadership skills and pursue personalized professional learning.
- Support educators in using technology to advance learning that meets the diverse learning, cultural, and social-emotional needs of individual students.