Navigation Links
Device converting images into music helps individuals without vision reach for objects in space

Amsterdam, NL, July 5, 2012 Sensory substitution devices (SSDs) use sound or touch to help the visually impaired perceive the visual scene surrounding them. The ideal SSD would assist not only in sensing the environment but also in performing daily activities based on this input. For example, accurately reaching for a coffee cup, or shaking a friend's hand. In a new study, scientists trained blindfolded sighted participants to perform fast and accurate movements using a new SSD, called EyeMusic. Their results are published in the July issue of Restorative Neurology and Neuroscience.

The EyeMusic, developed by a team of researchers at the Hebrew University of Jerusalem, employs pleasant musical tones and scales to help the visually impaired "see" using music. This non-invasive SSD converts images into a combination of musical notes, or "soundscapes."

The device was developed by the senior author Prof. Amir Amedi and his team at the Edmond and Lily Safra Center for Brain Sciences (ELSC) and the Institute for Medical Research Israel-Canada at the Hebrew University. The EyeMusic scans an image and represents pixels at high vertical locations as high-pitched musical notes and low vertical locations as low-pitched notes according to a musical scale that will sound pleasant in many possible combinations. The image is scanned continuously, from left to right, and an auditory cue is used to mark the start of the scan. The horizontal location of a pixel is indicated by the timing of the musical notes relative to the cue (the later it is sounded after the cue, the farther it is to the right), and the brightness is encoded by the loudness of the sound.

The EyeMusic's algorithm uses different musical instruments for each of the five colors: white (vocals), blue (trumpet), red (reggae organ), green (synthesized reed), yellow (violin); Black is represented by silence. Prof. Amedi mentions that "The notes played span five octaves and were carefully chosen by musicians to create a pleasant experience for the users." Sample sound recordings are available at

"We demonstrated in this study that the EyeMusic, which employs pleasant musical scales to convey visual information, can be used after a short training period (in some cases, less than half an hour) to guide movements, similar to movements guided visually," explain lead investigators Drs. Shelly Levy-Tzedek, an ELSC researcher at the Faculty of Medicine, Hebrew University, Jerusalem, and Prof. Amir Amedi. "The level of accuracy reached in our study indicates that performing daily tasks with an SSD is feasible, and indicates a potential for rehabilitative use."

The study tested the ability of 18 blindfolded sighted individuals to perform movements guided by the EyeMusic, and compared those movements to those performed with visual guidance. At first, the blindfolded participants underwent a short familiarization session, where they learned to identify the location of a single object (a white square) or of two adjacent objects (a white and a blue square).

In the test sessions, participants used a stylus on a digitizing tablet to point to a white square located either in the north, the south, the east or the west. In one block of trials they were blindfolded (SSD block), and in the other block (VIS block) the arm was placed under an opaque cover, so they could see the screen but did not have direct visual feedback from the hand. The endpoint location of their hand was marked by a blue square. In the SSD block, they received feedback via the EyeMusic. In the VIS block, the feedback was visual.

"Participants were able to use auditory information to create a relatively precise spatial representation," notes Dr. Levy-Tzedek.

The study lends support to the hypothesis that representation of space in the brain may not be dependent on the modality with which the spatial information is received, and that very little training is required to create a representation of space without vision, using sounds to guide fast and accurate movements. "SSDs may have great potential to provide detailed spatial information for the visually impaired, allowing them to interact with their external environment and successfully make movements based on this information, but further research is now required to evaluate the use of our device in the blind " concludes Dr. Levy-Tzedek. These results demonstrate the potential application of the EyeMusic in performing everyday tasks from accurately reaching for the red (but not the green!) apples in the produce aisle, to, perhaps one day, playing a Kinect / Xbox game.


Contact: Daphne Watrin
IOS Press

Related medicine news :

1. Nano-devices that cross blood-brain barrier open door to treatment of cerebral palsy
2. In Rat Study, Eye Device Shows Promise for Restoring Sight
3. Biochip-based device for cell analysis
4. New device warns workers of high levels of airborne metals in minutes rather than weeks
5. Device implanted in brain has therapeutic potential for Huntingtons disease
6. US Drug Watchdog Now Offers To Help All Recipients Of A DePuy Pinnacle Or Recalled DePuy ASR Hip Implant Get To The Best Attorneys Regardless If Their Device Has Failed
7. Oakworks Medical, a Division of Oakworks Inc.,, Manufacturer of Medical Tables and Positioning Devices Announces ISO 13485 Certification
8. Device is effective in managing incontinence after surgery
9. Adena Delivers Instant Health Information to Mobile Devices
10. The US Drug Watchdog Now Urges Plaintiffs Law Firms Worldwide To Contact Them About A Possible International Effort To Help Victims Of Defective Drugs Or Medical Devices
11. Popularity Causing Several Week Lag In Delivery Of 'Plug In' Device To Start Saving On Electricity Between 8% and 20%
Post Your Comments:
Related Image:
Device converting images into music helps individuals without vision reach for objects in space
(Date:6/26/2016)... ... June 27, 2016 , ... Quality metrics are proliferating in cancer care, and ... in the eye of the beholder, according to experts who offered insights and commentary ... of Managed Care. For the full issue, click here . , For the ...
(Date:6/26/2016)... ... June 26, 2016 , ... Brent Kasmer, a legally blind and certified personal trainer is ... a fitness app. The fitness app plans to fix the two major problems leading the ... one size fits all type program , They don’t eliminate all the reasons ...
(Date:6/25/2016)... ... June 25, 2016 , ... The temporary closing of Bruton Memorial Library on June 21 ... brings up a new, often overlooked aspect of head lice: the parasite’s ability to live ... not a common occurrence, but a necessary one in the event that lice have simply ...
(Date:6/25/2016)... (PRWEB) , ... June 25, 2016 , ... ... athletes and non-athletes recover from injury. Recently, he has implemented orthobiologic procedures as ... City area —Johnson is one of the first doctors to perform the treatment. ...
(Date:6/24/2016)... Michigan (PRWEB) , ... June 24, 2016 , ... Those ... deal with these feelings, many turn to unhealthy avenues, such as drug or alcohol ... of Marne, Michigan, has released tools for healthy coping following a traumatic event. , ...
Breaking Medicine News(10 mins):
(Date:6/23/2016)... June 23, 2016 Research and Markets ... Market - Forecast to 2022" report to their offering. ... method for the patients with kidney failure, it replaces the ... from the patient,s blood and thus the treatment helps to ... chloride in balance. Increasing number of ESRD ...
(Date:6/23/2016)... , June 23, 2016 Research and ... Devices Medical Market Analysis 2016 - Forecast to 2022" ... The report contains up to date financial data derived ... Assessment of major trends with potential impact on the market ... of market segmentation which comprises of sub markets, regional and ...
(Date:6/23/2016)... INDIANAPOLIS , June 23, 2016 ... Tomorrow,s Leaders Scholarship is any indication, the future is ... online at by the Diabetes Scholars ... in the way of academic and community service excellence. ... program since 2012, and continues to advocate for people ...
Breaking Medicine Technology: