A groundbreaking innovation that enables individuals to "see" through the medium of sound.
A research team member who is blind uses acoustic touch to locate and reach for an item on the table. Photo: Lil Deverell CC-BY 4.0
Groundbreaking innovation known as "acoustic touch," will enable individuals to "see" through the medium of sound according to Australian researchers.
According to the World Health Organization, approximately 39 million people worldwide are blind, while an additional 246 million grapple with low vision, limiting their participation in everyday activities. In collaboration with Sydney-based start-up ARIA Research, scientists from UTS and the University of Sydney have developed next-generation smart glasses that translate visual information into distinct sound icons.
Smart glasses traditionally employ computer vision and other sensory data to convert the wearer's surroundings into computer-generated speech. However, acoustic touch technology creates unique sound representations of objects as they enter the device's field of view. For instance, the rustling of leaves might signify a plant, while a buzzing sound could represent a mobile phone.
Distinguished Professor Chin-Teng Lin,
Renowned expert in brain-computer interface University of Technology Sydney
A recent study assessing the effectiveness and usability of acoustic touch technology in assisting individuals with visual impairments, led by Dr. Howe Zhu from the University of Technology Sydney, has been published in the journal PLOS ONE.
The findings revealed that the wearable device equipped with acoustic touch technology significantly improved the ability of visually impaired individuals to identify and reach for objects without excessive cognitive effort.
The auditory feedback empowers users to pinpoint and grasp objects with remarkable precision. Our results suggest that acoustic touch holds the potential to offer a wearable and effective sensory augmentation method for the visually impaired community.
Dr. Howe Zhu,
University of Technology Sydney
This research underscores the significance of developing assistive technology to address challenges like locating household items and personal belongings in daily life. Acoustic touch technology opens new possibilities for individuals with visual impairments, enhancing their independence and overall quality of life.
As this technology continues to advance, acoustic touch has the potential to become an integral component of assistive technologies.