Navigation Links
EyeMusic Sensory Substitution Device enables the blind to 'see' colors and shapes
Date:2/4/2014

Amsterdam, NL, February 4, 2014 Using auditory or tactile stimulation, Sensory Substitution Devices (SSDs) provide representations of visual information and can help the blind "see" colors and shapes. SSDs scan images and transform the information into audio or touch signals that users are trained to understand, enabling them to recognize the image without seeing it.

Currently SSDs are not widely used within the blind community because they can be cumbersome and unpleasant to use. However, a team of researchers at the Hebrew University of Jerusalem have developed the EyeMusic, a novel SSD that transmits shape and color information through a composition of pleasant musical tones, or "soundscapes." A new study published in Restorative Neurology and Neuroscience reports that using the EyeMusic SSD, both blind and blindfolded sighted participants were able to correctly identify a variety of basic shapes and colors after as little as 2-3 hours of training.

Most SSDs do not have the ability to provide color information, and some of the tactile and auditory systems used are said to be unpleasant after prolonged use. The EyeMusic, developed by senior investigator Prof. Amir Amedi, PhD, and his team at the Edmond and Lily Safra Center for Brain Sciences (ELSC) and the Institute for Medical Research Israel-Canada at the Hebrew University, scans an image and uses musical pitch to represent the location of pixels. The higher the pixel on a vertical plane, the higher the pitch of the musical note associated with it. Timing is used to indicate horizontal pixel location. Notes played closer to the opening cue represent the left side of the image, while notes played later in the sequence represent the right side. Additionally, color information is conveyed by the use of different musical instruments to create the sounds: white (vocals), blue (trumpet), red (reggae organ), green (synthesized reed), yellow (violin); black is represented by silence.

"This study is a demonstration of abilities showing that it is possible to encode the basic building blocks of shape using the EyeMusic," explains Prof. Amir Amedi. "Furthermore, the success in associating color to musical timbre holds promise for facilitating the representation of more complex shapes."

In addition to successfully identifying shapes and colors, users in the new EyeMusic study indicated they found the SSD's soundscapes to be relatively pleasant and potentially tolerable for prolonged use. "In soundscapes generated from images," notes Prof. Amedi, "there is a tendency for adjacent frequencies to be played together. Using a semitone western scale would then generate sounds that are perceived as highly dissonant. Therefore, to generate more pleasant soundscapes, we used the pentatonic musical scale that generates less dissonance when adjacent notes are played together."

While this new study shows that the EyeMusic can enable the visually impaired to extract visual shape and color information using auditory soundscapes of objects, researchers feel that this device also holds great promise for the field of visual rehabilitation in general. By providing additional color information, the EyeMusic can help facilitate object recognition and scene segmentation, while the pleasant soundscapes offer the potential of prolonged use.

"There is evidence suggesting that the brain is organized as a task-machine and not as a sensory machine. This strengthens the view that SSDs can be useful for visual rehabilitation, and therefore we suggest that the time may be ripe for turning part of the SSD spotlight back on practical visual rehabilitation," Prof. Amedi adds. "In the future, it would be intriguing to test whether the use of naturalistic sounds, like music and human voice, can facilitate learning and brain processing relying on the developed neural networks for music and human voice processing."

Additionally, the researchers hope the EyeMusic can become a tool for future neuroscience research. "It would be intriguing to explore the plastic changes associated with learning to decode color information for auditory timbre in the congenitally blind, who never experience color in their life. The utilization of the EyeMusic and its added color information in the field of neuroscience could facilitate exploring several questions in the blind with the potential to expand our understanding of brain organization in general," concludes Prof. Amedi.


'/>"/>
Contact: Daphne Watrin
d.watrin@iospress.nl
31-206-883-355
IOS Press
Source:Eurekalert  

Related medicine news :

1. Researchers use sensory integration model to understand unconscious priming
2. Sensory Processing Disorder Foundation to Participate in Colorado Gives Day
3. STAR Center and SPD Foundation Present Informal Webinar Sessions on Topics of Interest to Those Impacted by Sensory Processing Disorder
4. Sensory Processing Disorder Foundation Celebrates National Sensory Awareness Month
5. Sensory Processing Disorder Foundation Announces the 16th International SPD Symposium in Charlotte, North Carolina
6. Statement from the Sensory Processing Disorder Foundation Endorsing New Breakthrough Study Revealing Biological Basis for Sensory Processing Disorders in Kids
7. Sensory-Focused Autism Therapy Shows Early Promise
8. STAR Center and SPD Foundation Present a Lecture on Teens and Adults with Sensory Processing Disorder
9. Some Face Transplant Patients May Regain Sensory, Motor Function
10. Doubt Cast on Usefulness of Sensory Therapies for Autism
11. Lower-cost drug substitutions could mean big savings for Medicare patients, government
Post Your Comments:
*Name:
*Comment:
*Email:
Related Image:
EyeMusic Sensory Substitution Device enables the blind to 'see' colors and shapes
(Date:2/20/2017)... , ... February 20, 2017 , ... ... Constellation Brands to purchase a new ultrasound-enhanced thrombolysis machine, a state-of-the-art device that ... gift was facilitated by the Pepin Family Foundation. , “We greatly appreciate this ...
(Date:2/19/2017)... ... February 19, 2017 , ... ... result in better care, and MEDfx and the Delaware Health Information Network (DHIN) ... , As the nation’s first state-wide health information exchange, DHIN stores and shares ...
(Date:2/18/2017)... ... February 17, 2017 , ... Butler Mobility invited Ken Matthews ... and other Butler products. Ken was impressed with the safety and reliability of ... the product on his show. This endorsement by Ken Matthews can be heard ...
(Date:2/18/2017)... ... February 18, 2017 , ... ... the latest information and contact points to easily connect elderly veterans of America's ... living, and elder-care funding. It also conveys material on this year's increase in ...
(Date:2/17/2017)... ... February 17, 2017 , ... Wells ... the electronic prescribing of controlled and non-controlled substances plus the ability to manage ... in the United States now accept electronic prescriptions, according to the Office of ...
Breaking Medicine News(10 mins):
(Date:2/17/2017)... Cryoablation, Electrical, Endometrial Hydrothermal, Laser/Light, Microwave, Radiofrequency, Ultrasound, Cardiovascular, Gynaecology, Musculoskeletal, ... to grow at a CAGR of 9.4% from 2017-2022 and CAGR ... a CAGR of 9.5% from 2017 to 2027. The market is ... ... you Read on to discover how you can exploit the ...
(Date:2/17/2017)... , Feb. 17, 2017 Theravance Biopharma, ... or the "Company") today announced the presentation of ... and orally administered pan-Janus kinase (JAK) inhibitor designed ... Congress of the European Crohn,s and Colitis ... reported further data from its completed Phase 1 ...
(Date:2/17/2017)...   Risperdal lawsuits involving gynecomastia (male breast growth) ... of the atypical antipsychotic medication continue to move forward ... Common Pleas, where the state,s Risperdal docket has been ... notice posted on the Court,s website , the ... 9, 2017 at 11:00 a.m. (In Re: Risperdal Litigation, ...
Breaking Medicine Technology: