How To Build an Animated Instructor for VR Learning Applications
Speaker: Sergey Kirshner
Abstract
Recent breakthroughs in virtual reality and generative AI are transforming the landscape of education. Animated virtual instructors are emerging as essential guides in training simulations by anchoring learners' attention, delivering engaging voice instruction, and providing an intuitive bridge for interaction within complex VR environments.
In this talk, we recount our journey of developing "Celly," a cell-inspired virtual instructor crafted for hands-on skills training in a virtual biosciences laboratory. We delve into the core design principles and technical challenges that shaped Celly's creation, from the art of character modeling aimed at achieving a realistic yet welcoming presence to the implementation of real-time lip-sync and natural eye movements that bring her to life. We also explore innovative solutions for integrating dynamic voice synthesis alongside pre-baked lines, as well as custom-made navigation strategies that allow Celly to effortlessly traverse three-dimensional space. Additionally, we discuss how voice communication transforms Celly into an active source of information and a guide for internal navigation. By sharing our design strategies, technical workflows, and user insights, we aim to inspire new approaches in building AI-driven VR characters to transform education from a passive routine into a truly interactive adventure.
Presentation Video
Slides
About AWE
AWE (Augmented World Expo) is the world's leading AR+VR conference and expo with events in the USA, Asia and Europe. AWE events consistently bring together a mix of CEOs, CTOs, designers, developers, creative agencies, futurists, analysts, investors and top press in a unique opportunity to learn, inspire, partner and experience firsthand one of the most exciting industries of our times.
AWE USA 2025 marks the 16th edition of the must attend global XR industry event; now for the second time in our new home in Long Beach, California.
The 3-day AR VR conference is packed with sessions from 450+ top speakers across 14 tracks; covering tech and applications in many verticals. The Expo Hall features over 250 exhibitors offering hands-on experience with the latest spatial computing technologies.
Pre-conference workshops, community meetups, and networking opportunities give guests numerous ways to connect, learn, and grow their XR businesses at AWE USA.
Contact Fantastic Voyage Labs
For media inquiries about Destination Lab, please contact:
[email protected]