Nimesha Ranasinghe1, Pravar Jain1, Nguyen Thi Ngoc Tram1, Koon Chuan Raymond Koh2, David Tolley1, Shienny Karwita1, Lin Lien-Ya1, Yan Liangkun1, Kala Shamaiah2, Eason Chow1, Ching Chiuan Yen1, Ellen Yi-Luen Do1,3
1Keio-NUS CUTE Center, Smart Systems Institute, National University of Singapore
2Institute of Technical Education (ITE College Central), Singapore
3ATLAS Institute, University of Colorado Boulder, Colorado, USA
In the same way that we experience the real-world through a range of senses, experiencing a virtual environment through multiple sensory modalities may augment both our presence within a scenario and our reaction to it. Here, we present Season Traveller, a multisensory virtual reality (VR) narration of a journey through four seasons within a mystical realm. By adding olfactory and haptic (thermal and wind) stimuli, we extend traditional audio-visual VR technologies to achieve enhanced sensory engagement within interactive experiences. Using both subjective measures of presence and elicited physiological responses, we evaluated the impact of different modalities on the virtual experience. Our results indicate that 1) the addition of any singular modality improves sense of presence with respect to traditional audio-visual experiences and 2) providing a combination of these modalities produces a further significant enhancement over the aforementioned improvements. Furthermore, insights into participants’ psychophysiology were extrapolated from electrodermal activity (EDA) and heart rate (HR) measurements during each of the VR experiences.
Keywords: Multisensory VR; Virtual Reality; Multimodal Interaction.
Ranasinghe, N., Jain, P., Ngyuyen, T. N. T., Koh, K. C. R., Tolley, D., Karwita, S., Lin, L. Y., Yan, L., Shamaiah, K., Chow, W. T. E., Yen, C. C., & Do, E. Y. L. 2018. Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience. In Proceedings of the 36th SIGCHI Conference on Human Factors in Computing Systems (Montréal, Canada, April 21 – 16, 2018). CHI ’18. ACM, New York, NY.
Ranasinghe, N., Jain, P., Ngyuyen, T. N. T., Tolley, D., Yan, L., Chow, W. T. E., Yen, C. C., Do, E. Y. L., Koh, K. C. R., & Shamaiah, K. 2018. A Demonstration of Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience. In Extended Abstracts of the 36th SIGCHI Conference on Human Factors in Computing Systems (Montréal, Canada, April 21 – 16, 2018). CHI EA ’18. ACM, New York, NY.
Exhibitions / Demonstrations
CHI Expo 2018 / “A Demonstration of Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience” at Palais des Congrès de Montréal, Canada / April 2018.
This research is supported by the National Research Foundation, Prime Minister’s Office, Singapore under its International Research Centres in Singapore Funding Initiative.