For deafblind individuals, the absence of visual and auditory communication channels can prevent meaningful interactions with the people and world around them, leading many to suffer with both mental and social issues. To utilise the available sensory channels (e.g. taste, haptic, and olfactory) of deafblind individuals, tactile stimuli are one type of feedback that can be employed to enable communication with the outside world. We have developed a wearable assistive device that converts speech and text into tactile stimuli, and vice versa, to enable efficient communication between deafblind and non-impaired individuals. In addition to employing tactile stimuli, we believe that olfactory and taste stimuli may also be incorporated into future versions of the system in order to deliver non-time sensitive information, such as local navigational data.
Keywords: Haptic; tactile; sensory substitution; deafblind; finger braille.
Ranasinghe, N., Jain, P., Karwita, S., Tolley, D., Chew, B., Bansal, A., & Do, E. Y. L. 2017. Enriching the Lives of Deafblind Individuals Through Sensory Substitution (Interfaces to Interact, Communicate, and Entertain). In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’17) – Workshop on Amplification and Augmentation of Human Perception (Denver, Colorado, May 7, 2017). [email protected] ’17. ACM, New York, NY.
Ranasinghe, N., Jain, P., Karwita, S., Tolley, D., Chew, B., Bansal, A., & Do, E. Y. L. 2017. Interface For Information Exchange And Communication Between And Among The Sensory Disabled And Non-Disabled Individuals. SG Non-Provisional Application No. 10201703584W.
Exhibitions / Demonstrations
InnovFest unBound 2017 / “Tactile communication tools for the deafblind” at Marina Bay Sands Convention Centre, Singapore / May 2017.
This research is supported by the National Research Foundation, Prime Minister’s Office, Singapore under its International Research Centres in Singapore Funding Initiative.