Optimal Planning for Redirected Walking Based on Reinforcement Learning in Multi-user Environment with Irregularly Shaped Physical Space
- 1 March 2020
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
Abstract
Redirected Walking (RDW) enables users to walk in both virtual and physical tracking spaces simultaneously, which is an effective method to increase presence in Virtual Reality (VR). Recently, RDW technologies have been developed in a multi-user environment where multiple users share the same physical tracking space and simultaneously explore the same virtual space. Meanwhile, in the Steer-To-Optimal-Target (S2OT) method, user actions are planned in RDW by introducing machine learning models such as reinforcement learning. In this paper, we propose a new predictive RDW algorithm "Multiuser-Steer-to-Optimal-Target (MS2OT)" that extends the S2OT method into an environment with multiple users and various types of tracking space. In addition to the steering actions used in S2OT, MS2OT considers pre-reset actions and uses more steering targets and an improved reward function. The locations of multiple users and tracking space information are treated as visual information to be the state of the reinforcement learning model in MS2OT. Hence, the artificial neural network of a multilayer three-dimensional convolutional neural network with a dueling double deep network architecture is learned through Q-Learning. MS2OT significantly reduces the total number of resets compared to the conventional RDW algorithms such as S2C and APF-RDW in a multi-user environment and improves the total distance and average distance between resets during the same period. Experimental results show that MS2OT can process up to 32 users in real-time.Keywords
This publication has 26 references indexed in Scilit:
- VoxNet: A 3D Convolutional Neural Network for real-time object recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Vection and visually induced motion sickness: how are they related?Frontiers in Psychology, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Subliminal Reorientation and Repositioning in Immersive Virtual Environments using Saccadic SuppressionIEEE Transactions on Visualization and Computer Graphics, 2015
- Optimizing Constrained-Environment Redirected Walking Instructions Using Search TechniquesIEEE Transactions on Visualization and Computer Graphics, 2013
- Collision prediction and prevention in a simultaneous two-user immersive virtual environmentPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Exploring large virtual environments with an HMD when physical space is limitedPublished by Association for Computing Machinery (ACM) ,2007
- Obstacle avoidance during walking in real and virtual environmentsACM Transactions on Applied Perception, 2007
- Q-learningMachine Learning, 1992
- Simulator Sickness Is Polygenic and polysymptomatic: Implications for ResearchThe International Journal of Aviation Psychology, 1992