Navigation Links
Read my lips: Using multiple senses in speech perception

When someone speaks to you, do you see what they are saying? We tend to think of speech as being something we hear, but recent studies suggest that we use a variety of senses for speech perception - that the brain treats speech as something we hear, see and even feel. In a new report in Current Directions in Psychological Science, a journal of the Association for Psychological Science, psychologist Lawrence Rosenblum describes research examining how our different senses blend together to help us perceive speech.

We receive a lot of our speech information via visual cues, such as lip-reading, and this type of visual speech occurs throughout all cultures. And it is not just information from lips- when someone is speaking to us, we will also note movements of the teeth, tongue and other non-mouth facial features. It's likely that human speech perception has evolved to integrate many senses together. Put in another way, speech is not meant to be just heard, but also to be seen.

The McGurk Effect is a well-characterized example of the integration between what we see and what we hear when someone is speaking to us. This phenomenon occurs when a sound (such as a syllable or word) is dubbed with a video showing a face making a different sound. For example, the audio may be playing "ba," while the face looks as though it is saying "va." When confronted with this, we will usually hear "va" or a combination of the two sounds, such as "da." Interestingly, when study participants are aware of the dubbing or told to concentrate only on the audio, the McGurk Effect still occurs. Rosenblum suggests that this is evidence that once senses are integrated together, it is not possible to separate them.

Recent studies indicate that this integration occurs very early in the speech process, even before phonemes (the basic units of speech) are established. Rosenblum suggests that physical movement of speech (that is, our mouths and lips moving) create acoustic and visual signals which have a similar form. He argues that as far as the speech brain is concerned, the auditory and visual information are never really separate. This could explain why we integrate speech so readily and in such a way that the audio and visual speech signals become indistinguishable from one another.

Rosenblum concludes that visual-speech research has a number of clinical implications, especially in the areas of autism, brain injury and schizophrenia and that "rehabilitation programs in each of these domains have incorporated visual-speech stimuli."


Contact: Barbara Isanski
Association for Psychological Science

Related medicine news :

1. AUDIO from Medialink and Philips: Give the Gift of Healthy Teeth This Holiday Season
2. AUDIO from Medialink and Philips: Giving Plaque the Heave-Ho
3. VIDEO from Medialink and Philips: Microbubbles Developed to Administer Medications That Fight Cancer and Reduce Side Effects
4. VIDEO from Medialink and Philips: Philips Electronics Unveils First Imagination Light Canvas at the New Mercy Medical Center in Rogers AR
5. Dont Pout About Irritated Lips: Dermatologists Can Offer Top Tips to Help Keep Lips in Tip-Top Shape
6. AUDIO from Medialink and Philips: Getting Rid of the Uninvited Holiday Guests on Your Toothbrush
7. Audio from Medialink and Philips: Americas Dirty Mouths
8. Americas Egg Farmers Launch New Incredible Edible Egg(TM) Advertising Campaign Focusing on Body And Mind
9. Total Health Center Using New Hgh Product to Destroy Fat Cells
10. Using C-Section Scars to Predict Future Deliveries
11. New Report Teaches The Art Of Communicating With People Using Social Networks For Health & Wellness
Post Your Comments:
(Date:6/27/2016)... , ... June 27, 2016 , ... ... mental health professionals, announced today its affiliation with Tennessee Counseling Association. ... to the network of the Tennessee Counseling Association, adding exclusive benefits and promotional ...
(Date:6/27/2016)... ... June 27, 2016 , ... recently awarded their highest five-star rating to ... of individuals in the United States and Canada wear eyeglasses. Once considered to be ... vision and make a fashion statement. Even celebrities use glasses as a way of ...
(Date:6/26/2016)... ... June 26, 2016 , ... Pixel Film Studios Released ... , "Film editors can give their videos a whole new perspective by using the ... CEO of Pixel Film Studios. , ProSlice Levels contains over 30 Different presets ...
(Date:6/26/2016)... , ... June 26, 2016 , ... ... once they have been diagnosed with endometriosis. These women need a treatment plan ... require a comprehensive approach that can help for preservation of fertility and ultimately ...
(Date:6/25/2016)... ... 25, 2016 , ... The temporary closing of Bruton Memorial Library on June 21 due to ... a new, often overlooked aspect of head lice: the parasite’s ability to live away from ... common occurrence, but a necessary one in the event that lice have simply gotten out ...
Breaking Medicine News(10 mins):
(Date:6/24/2016)... June 24, 2016 Research and Markets ... for Companion Diagnostic Tests" report to their offering. ... Companion Diagnostics The World Market for Companion ... medicine diagnostics. Market analysis in the report includes the following: ... (In Vitro Diagnostic Kits) by Region (N. America, EU, ROW), ...
(Date:6/24/2016)... Mass. , June 24, 2016   Pulmatrix, ... pharmaceutical company developing innovative inhaled drugs, announced today that ... Russell Investments reconstituted its comprehensive set of ... "This is an important milestone for Pulmatrix," ... will increase shareholder awareness of our progress in developing ...
(Date:6/24/2016)... 2016  Arkis BioSciences, a leading innovator in ... durable cerebrospinal fluid treatments, today announced it has ... is led by Innova Memphis, followed by Angel ... investors.  Arkis, new financing will accelerate the commercialization ... release of its in-licensed Endexo® technology. ...
Breaking Medicine Technology: