Improved Takeover System: Enabling Single Actor Control for Multi-Avatar Populated Virtual Realities

Published December 2, 2024 in 2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) by Jingyi Zhang, Anthony Steed

Abstract

Social virtual reality (SVR) has become more accessible to the general public. Just as in real life, users expect the possibility of engaging with many others within SVR. Creating open-ended, densely populated environments with highly interactive virtual humans remains challenging. Despite the advances in artificial intelligence and language understanding, we still see the need for human intervention to control unanticipated scenarios or answer questions. Previous work has allowed a single actor to take over control of multiple virtual humans when interaction with the user was needed. However, those works focused only on non-verbal interaction. This paper proposes a system that supports full-body avatars with six-point tracking and a simpler take-over procedure. We demonstrate a scenario that enables both verbal and non-verbal interactions.

Full-text PDF Publisher Page

Cite with BibTex

@INPROCEEDINGS{10765328,
  author={Zhang, Jingyi and Steed, Anthony},
  booktitle={2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)}, 
  title={Improved Takeover System: Enabling Single Actor Control for Multi-Avatar Populated Virtual Realities}, 
  year={2024},
  volume={},
  number={},
  pages={612-613},
  keywords={Human computer interaction;Avatars;Artificial intelligence;Augmented reality;Human computer interaction (HCI);virtual reality;social virtual reality},
  doi={10.1109/ISMAR-Adjunct64951.2024.00175}}