AJOU Central Library Repository: A Study on Deep-Learning based In-place Locomotion Technique in Virtual Reality using Multimodal Data Pipeline

Graduate School of Ajou University Department of Artificial Intelligence 3. Theses(Master)

A Study on Deep-Learning based In-place Locomotion Technique in Virtual Reality using Multimodal Data Pipeline

Alternative Abstract: Movement is one of the key elements in virtual reality (VR) and significantly influences user experience. In particular, walking-in place is a method of supporting movement in a limited space, and many studies are being conducted on its effective support. However, most studies have focused on forward movement despite many situations in which backward movement is needed. In this paper, we present the development of a prediction model for forward/backward movement while considering a user’s orientation and the verification of the model’s effectiveness. We built a deep learning-based model by collecting sensor data through virtual data pipeline which contains a user’s head, waist, and feet. The study was conducted through two technical elements: a data pipeline for collecting signals that could represent a user and a prediction model for a user movement. We developed three realistic VR scenarios that involve backward movement, set three conditions (controller-based, treadmill-based, and model-based) for movement, and evaluated user experience in each condition through a study of 36 participants. As a result, the model-based condition showed the highest sensory sensitivity, effectiveness, and satisfaction and similar cognitive burden compared with the other two conditions. The results of our study demonstrated that movement support through modeling is possible, suggesting its potential for use in many VR applications.

Appears in Collections:: Graduate School of Ajou University > Department of Artificial Intelligence > 3. Theses(Master)

qrcode

AJOU Central Library Repository는 국립중앙도서관 OAK 보급사업으로 구축되었습니다.