On October 7-8, 2024, at the ACM Symposium on Spatial User Interaction (SUI) 2024 held in Trier, Germany, Mr. Marvin Lehnort from Bonn-Rhein-Sieg University of Applied Sciences presented the results of our collaborative research.
- Alexander Marquardt, Marvin Lehnort, Hiromu Otsubo, Monica Perusquia-Hernandez, Melissa Steininger, Felix Dollack, Hideaki Uchiyama, Kiyoshi Kiyokawa, and Ernst Kruijff,
“Exploring Gesture Interaction in Underwater Virtual Reality”
(Abstract) An underwater virtual reality (UVR) system with gesture-based controls was developed to facilitate navigation and interaction while submerged. The system uses a waterproof head-mounted display and camera-based gesture recognition, originally trained for above-water conditions, employing three gestures: grab for navigation, pinch for single interactions, and point for continuous interactions. In an experimental study, we tested gesture recognition both above and underwater, and evaluated participant interaction within an immersive underwater scene. Results showed that underwater conditions slightly affected gesture accuracy, but the system maintained high performance. Participants reported a strong sense of presence and found the gestures intuitive while highlighting the need for further refinement to address usability challenges.
