A Study on Deep-Learning based In-place Locomotion Technique in Virtual Reality using Multimodal Data Pipeline

Author(s)
백승원
Advisor
유종빈
Department
일반대학원 인공지능학과
Publisher
The Graduate School, Ajou University
Publication Year
2022-08
Language
eng
Keyword
Deep learningLocomotionUser experienceVirtual Reality
Alternative Abstract
Movement is one of the key elements in virtual reality (VR) and significantly influences user experience. In particular, walking-in place is a method of supporting movement in a limited space, and many studies are being conducted on its effective support. However, most studies have focused on forward movement despite many situations in which backward movement is needed. In this paper, we present the development of a prediction model for forward/backward movement while considering a user’s orientation and the verification of the model’s effectiveness. We built a deep learning-based model by collecting sensor data through virtual data pipeline which contains a user’s head, waist, and feet. The study was conducted through two technical elements: a data pipeline for collecting signals that could represent a user and a prediction model for a user movement. We developed three realistic VR scenarios that involve backward movement, set three conditions (controller-based, treadmill-based, and model-based) for movement, and evaluated user experience in each condition through a study of 36 participants. As a result, the model-based condition showed the highest sensory sensitivity, effectiveness, and satisfaction and similar cognitive burden compared with the other two conditions. The results of our study demonstrated that movement support through modeling is possible, suggesting its potential for use in many VR applications.
URI
https://dspace.ajou.ac.kr/handle/2018.oak/20747
Fulltext

Appears in Collections:
Graduate School of Ajou University > Department of Artificial Intelligence > 3. Theses(Master)
Files in This Item:
There are no files associated with this item.
Export
RIS (EndNote)
XLS (Excel)
XML

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse