Research Demos

A Software Architecture for Distributed AR Applications

Gregory de Oliveira Feij, Leonardo Pavanatto Soares, Vicenzo Abichequer Sangalli, Thomas Volpatto de Oliveira, and Márcio Sarroglia Pinho
Abstract: The recent advances in hardware technology expanded the scope of Augmented Reality applications to mobile devices such as tablets and smartphones.Given their limited battery resources, distributed computing becomes a tempting approach to develop AR applications. Although frameworks that support the development of distributed AR systems exist, they are mostly complex in their nature.In this article, we present asoftware architecture that mainly targets distributed AR systems. As a proof of concept, we developed three different applications based on this architecture. The applications use different devices such as smartphones, webcams and head mounted displays (HMD) and allows the user to interact with the system in many different ways, providingthe user with realistic AR experience.

An Ancient Roman ExperienceEnhanced by Using PIPES

Chauncey Frend
Abstract: This paper describes an experience that presents an enhanced virtual tour of the Piazza d’Oro Roman palace. This work explores the educational utility in presenting a historically accurate virtual environment to students studying ancient Rome. An Oculus Rift Head-Mounted Display (HMD) and headphones provide common visual and auditory feedback while PIPES controls and affords additional environmental effects: wind, heat, and scent.

b3.js: A Library for Interactive Web Data Visualizations in Virtual Reality

Huy Le, Ajjen Joshi, and Margrit Betke
Abstract: As virtual reality (VR) devices become more ubiquitous, data scientists increasingly recognize the power of viewing and manipulating complex, multivariate data in immersive virtual worlds. In their quest to extract knowledge from the data, data scientists may benefit from visualizations that are easily controlled by hand motion. We here present b3.js, a library for creating interactive VR data visualizations on a web browser. The 3D visualizations, for example, 3D scatter, bar, and surface plots, may be viewed through the Oculus Rift and manipulated gesturally with the Leap Motion controller. Oculus Rift provides immersive point of view perspective within the VR environment. Leap Motion enables gestural interaction by allowing users to control the parameters of the virtual camera, for example, modify the point of view. Users can also modify points of a rendered plot. We show that combining the Oculus Rift and Leap Motion with b3.js enables users to engage with a complex data set consisting of coherently-organized 3D flight paths of thousands of bats. A novel data exploration experience was created that is difficult to achieve on a flat screen with the traditional mouse-keyboard paradigm.

Belt-Based Haptic Device for Representing Scene Depth Information

Christian Lykawka, Thomas Volpatto de Oliveira, Leonardo Pavanatto Soares, Vicenzo Abichequer Sangalli, Eduardo da Costa Siqueira, Marcia De Borba Campos, and Márcio Sarroglia Pinho
Abstract: This paper aims to demonstrate the usage of haptic device for helping the navigation task in a virtual environment. We developed a belt-shaped interface with a matrix of 35 (7×5) vibrotactile actuators attached to the users’ abdomen. Tests demonstrated that the device can help users perceive the movement of objects, as well as allow them to move in environments containing obstacles without using vision.

bioSync: Wearable Haptic I/O Device for Synchronous Kinesthetic Interaction

Jun Nishida and Kenji Suzuki
Abstract: This paper presents a synchronous kinesthetic interaction among people through haptic input/output based on biosignal measurement and stimulation. Users are able to bi-directionally transmit kines-thetic experiences such as rigidity of joints or exertion of muscles in addition to physical bodily motion. Such interaction would be very important in the fields of rehabilitation and sports training. In this study, we introduce a set of wearable devices that is capable of both electromyogram (EMG) measurement and electrical muscle stimulation (EMS) simultaneously on the same muscle by using common electrodes. To achieve smooth kinesthetic bi-directional interaction, we propose a new method for discharging the residual potential of the stimulation in order to enable fastest simultaneous operation (40Hz). Through a performance evaluation, participants could recognize the teacher’s exertion strength on a 5-point scale without visual information.

Brief Demonstration of Olfactory and Visual Presentation Using Wearable Olfactory Display and Head Mounted Display

Kazuki Hashimoto, Yosuke Maruno, and Takamichi Nakamoto
Abstract: This article introduces our demonstration content employing a wearable olfactory display and a head mounted display(HMD). An olfactory display is a gadget to present scents to one or more user(s). We developed the olfactory display using a surface acoustic wave(SAW)device and micro pumps. The SAW device can atomize liquid droplets forcibly based on SAW streaming phenomenon, even low-volatile odor compound can be presented. In addition, we miniaturized the olfactory display so that palm-sized olfactory display can be available. Then, we combined it with a HMD. Through the HMD, people walk around on the plane in VR world. If a participant approaches a tree bearing oranges, he/she would feel orange scents injected from the wearable olfactory display.

Calclex VR – A Virtual Reality Serious Game for Dyslexic and Dyscalculic Kids

Giancarlo Santana Batista Fleuri, Marcos Wagner de Souza Ribeiro, and Vanessa Avelino Xavier de Camargo
Abstract: The aim of this work is the development of an immersive serious game to assist in the learning process of dyslexic and dyscalculic individuals. Considering that most of the patients under specific treatment are kids, this paper proposes the combination of serious games and Virtual Reality (VR) to increase the motivation of these patients. The choice of VR as the main tool has as goal the improvement in the visual and auditory concentration of these individuals, since the distractions present in the real environment can affect the effectiveness of the treatment while conducting learning activities.

Dental Simulator for Endodontic Access Cavity Preparation

Tales Nereu Bogoni, Leonardo Pavanatto Soares, Vicenzo Abichequer Sangalli, Thomas Volpatto de Oliveira, and Márcio Sarroglia Pinho
Abstract: This paper presents a virtual environment to simulate the opening process of a tooth’s crown. The environment tries to simulate a haptic interaction between a high-speed hand piece dental drill and a tooth during the dental material removal process. A low-cost device was created specifically for this application. The simulator is designed to train dental students,allowing the tasks to be repeated in controlled situations, while the students movements are monitored.

First-Person VR Design for Cardiac Anatomy Education

Catherine Ball and Kyle Johnsen
Abstract: This demonstration showcases our research studying how to design first-person immersive experiences for education. Specifically, we are studying the benefits of immersion in certain applications such as cardiac anatomy education.To control for variance in the display equipment, we simulate a large-screen display within a head-mounted display. We are also studying joystick-based locomotion techniques for complex navigation tasks suchas navigating the inside of a heart andnavigational aids within these environments.

Immersive Decontamination Training for Nursing Students

Eric Hodgson, Sharron L. Farra, and Sherrill Smith
Abstract: To better train undergraduate nursing students in disaster preparedness, a simulation was developed to teach the process of decontaminating a patient exposed to a radiological agent. The efficacy of the virtual training simulation is being assessed and compared to traditional text-or web-based training methods. Early work indicated that a combination of Razer Hydra hand tracking and Oculus Rift display provided the best usability, and have shown measurable benefits of simulation training over traditional techniques.

Leap Motion Hand and Stylus Tracking for Calibration and Interaction within Optical See-Through Augmented Reality

Kenneth R. Moser, Sujan Anreddy, and J. Edward Swan II
Abstract: Highly anticipated consumer level optical see-through head-mounted display offerings, such as the Microsoft Holo Lens and Epson Move-rio Pro BT-2000, include not only the standard IMU and GPS sensors common to modern mobile devices, but also feature additional depth sensing and hand tracking cameras intended to support and promote the development of innovative user interaction experiences. Through this demonstration, we showcase the potential of these technologies in facilitating not only interaction, but also intuitive user-centric calibration, for optical see-through augmented reality. Additionally, our hardware configuration provides a straightforward example for combining consumer level sensors, such as the Leap Motion controller,with existing head-mounted displays and secondary tracking devices to ease the development and deployment of immersive stereoscopic experiences. We believe that the methodologies presented within our demonstration not only illustrate the potential for ubiquitous calibration across next generation consumer devices, but will also inspire and encourage further developmental efforts for optical see-through augmented reality from the community at large.

Quantifying Immersion in Virtual Reality Exergames

Derek LaFever and Durell Bouchard
Abstract: Virtual Reality (VR) has been perceived to be more immersive thenthe traditional screen, but little research has been conducted sincethe release of newer VR peripherals to confirm this claim. Ourresearch compares the attentiveness players have on non-game re-lated stimuli and their perceived fatigue as potential measures ofimmersion. Our preliminary results suggests that players using VRin an exergame exert more energy and report being less fatiguedthan players using traditional screens.

Remote and Low Cost VR Surgery Simulator

Kazuyoshi Tagawa, Hiromi T. Tanaka, Masaru Komori, Shigehiro Morikawa, and Yoshimasa Kurumi

Abstract: This paper introduces a remote and low cost laparoscopic VR surgery simulator which is capable of coaching from a remote location.In recent years, many countries have experienced a shortage of not only physicians, but also surgeons. This problem has led to a significant decrease in providing superior training of surgical techniques to novices (e.g. medical students). Therefore, there is a specific need to realize an efficient VR surgery training system to develop our future expert surgeons. In our VR surgery training system, this system-specific surgical training (e.g. training of collaborative surgical tasks, one-to-one coaching, and training many novices simultaneously from remote location) under general PCs and network environment is possible.

Subtle Dynamic Field-Of-View Modification for Alleviating VR Sickness: Research Demonstration

Ajoy S. Fernandes and Steven K. Feiner

Abstract: Virtual Reality (VR) sickness can cause intense discomfort, shorten the duration of a VR experience, and create an aversion to further use of VR. It has been noted that decreasing field of view (FOV)tends to decrease VR sickness, though at the expense of sense of presence. We demonstrate an approach in which FOV is subtly and automatically manipulated during a VR session. We have shown that this can reduce the degree of VR sickness perceived by study participants, without decreasing their subjective level of presence,while minimizing their awareness of the intervention.

Utilizing Myo Armbands for Various Locomotion Methods

Preston Tunnell Wilson, Ansel MacLaughlin, William Kalescky, and Betsy Williams

Virtual Excavations: Using Immersive Technologies to Visualize and Interact with Itapeva’s Archaeological Site

Eduardo Zilles Borba, Marcio Cabral, Roseli de Deus Lopes, Marcelo Knorich Zuffo, Astolfo Araújo, and Regis Kopper
Abstract: This work demonstrates the methodological approach we applied to develop a fully immersive and interactive virtual environment that simulates Itapeva’s archaeological site,in Brazil. To create a realistic 3D demo, which would be relevant for research through a cyber-archaeology exploration, specific technological equipment to collect data were used, such as: laser scanner and image-based modeling.In consequence, data acquisition from these apparatus generated a huge density point clouds, requiring many gigabytes computer storage and a research work to simplify the information in a user’s friendly virtual model. Also, to provide an immersive feeling when exploring the virtual reality we allow users to navigate through the scene using 3D input devices and head-mounted display to visualize the aesthetical and spatial elements. In resume, through a sophisticated digital simulation environment we created a telepresence sense where archaeologists can exp lore landscapes and its objects through a not destructive way .

Immersive VR Trainer for Landing Signal Officers

Larry Greunke, Amela Sadagic
Abstract: Training regimen of Landing Signal Officers (LSOs), members of a team that helps pilots land their planes on aircraft carriers deployed deep in the oceans, consists of two major components:(1) training on a large two stories-tall simulator – LSO Trainer (LSOT) also known as 2H111 device that is located in Oceana VA (part of LSOs Initial Formal Ground Training (IFGT)), and (2) training on the job. This approach to LSOs training has remained unchanged for several decades. The time that LSOs spend in 2H111 simulator amounts to six one-hour long sessions during which they practice operating in all five different positions and roles that members of LSO crew have during an aircraft recovery. Access to this simulator is generally a prohibitive factor in training of LSOs; in order for an LSO to use it outside of IFGT classes, the simulator needs to be available i.e. it should not be already in use as a part of IFGT rotation for another unit, and not undergoing any repair or upgrade. Additionally, unless LSO is not located near Oceana, that individual needs to travel there. This is typically very hard to organize given extremely each LSO in their respective squadrons. PDF