Navigation Links
Researchers use human cues to improve computer user-friendliness
Date:3/4/2011

BINGHAMTON, NY Lijun Yin wants computers to understand inputs from humans that go beyond the traditional keyboard and mouse.

"Our research in computer graphics and computer vision tries to make using computers easier," says the Binghamton University computer scientist. "Can we find a more comfortable, intuitive and intelligent way to use the computer? It should feel like you're talking to a friend. This could also help disabled people use computers the way everyone else does."

Yin's team has developed ways to provide information to the computer based on where a user is looking as well as through gestures or speech. One of the basic challenges in this area is "computer vision." That is, how can a simple webcam work more like the human eye? Can camera-captured data understand a real-world object? Can this data be used to "see" the user and "understand" what the user wants to do?

To some extent, that's already possible. Witness one of Yin's graduate students giving a PowerPoint presentation and using only his eyes to highlight content on various slides. When Yin demonstrated this technology for Air Force experts last year, the only hardware he brought was a webcam attached to a laptop computer.

Yin says the next step would be enabling the computer to recognize a user's emotional state. He works with a well-established set of six basic emotions anger, disgust, fear, joy, sadness, and surprise and is experimenting with different ways to allow the computer to distinguish among them. Is there enough data in the way the lines around the eyes change? Could focusing on the user's mouth provide sufficient clues? What happens if the user's face is only partially visible, perhaps turned to one side?

"Computers only understand zeroes and ones," Yin says. "Everything is about patterns. We want to find out how to recognize each emotion using only the most important features."

He's partnering with Binghamton University psychologist Peter Gerhardstein to explore ways this work could benefit children with autism. Many people with autism have difficulty interpreting others' emotions; therapists sometimes use photographs of people to teach children how to understand when someone is happy or sad and so forth. Yin could produce not just photographs, but three-dimensional avatars that are able to display a range of emotions. Given the right pictures, Yin could even produce avatars of people from a child's family for use in this type of therapy.

Yin and Gerhardstein's previous collaboration led to the creation of a 3D facial expression database, which includes 100 subjects with 2,500 facial expression models. The database is available at no cost to the nonprofit research community and has become a worldwide test bed for those working on related projects in fields such as biomedicine, law enforcement and computer science.

Once Yin became interested in human-computer interaction, he naturally grew more excited about the possibilities for artificial intelligence.

"We want not only to create a virtual-person model, we want to understand a real person's emotions and feelings," Yin says. "We want the computer to be able to understand how you feel, too. That's hard, even harder than my other work."

Imagine if a computer could understand when people are in pain. Some may ask a doctor for help. But others young children, for instance cannot express themselves or are unable to speak for some reason. Yin wants to develop an algorithm that would enable a computer to determine when someone is in pain based just on a photograph.

Yin describes that health-care application and, almost in the next breath, points out that the same system that could identify pain might also be used to figure out when someone is lying. Perhaps a computer could offer insights like the ones provided by Tim Roth's character, Dr. Cal Lightman, on the television show Lie to Me. The fictional character is a psychologist with an expertise in tracking deception who often partners with law-enforcement agencies.

"This technology," Yin says, "could help us to train the computer to do facial-recognition analysis in place of experts."


'/>"/>

Contact: Gail Glover
gglover@binghamton.edu
607-777-2174
Binghamton University
Source:Eurekalert  

Related medicine news :

1. Researchers map all the fragile sites of the yeast Saccharomyces cerevisiaes genome
2. UH Case Medical Center researchers publish promising findings for advanced cervical cancer
3. Researchers discover new way to kill pediatric brain tumors
4. Researchers Who Discovered First Genes for Stuttering will Present Findings to the National Stuttering Association
5. Researchers create drug to keep tumor growth switched off
6. Urine protein test might help diagnose kidney damage from lupus, UT Southwestern researchers find
7. GUMC researchers say flower power may reduce resistance to breast cancer drug tamoxifen
8. Clemson researchers develop hands-free texting application
9. Researchers find biomarkers in saliva for detection of early-stage pancreatic cancer
10. Researchers chart genomic map spanning over 2 dozen cancers
11. Researchers discover second protective role for tumor-suppressor
Post Your Comments:
*Name:
*Comment:
*Email:
Related Image:
Researchers use human cues to improve computer user-friendliness
(Date:10/13/2017)... ... ... As health professionals work to improve their approach to healthcare, there is ... than filling out a survey; in many cases health professionals and patients are working ... and research on the importance of active engagement with patients and members of the ...
(Date:10/13/2017)... ... October 13, 2017 , ... PurhealthRX , a ... utilizing Purzorb™ technology. Applying the Purzorb™process to full spectrum CBD oil will revolutionize the ... a CBD form that can be easily incorporated into liquid products, while reducing costs ...
(Date:10/13/2017)... SAN LUIS OBISPO, Calif. (PRWEB) , ... October 13, 2017 , ... ... with Alzheimer’s or dementia. However, many long-term care insurance companies have a waiver for ... mean is the 90-day elimination period, when the family pays for care, is often ...
(Date:10/13/2017)... ... October 13, 2017 , ... Yisrayl Hawkins, Pastor and Overseer at The House ... most popular and least understood books in the Holy Scriptures, Revelation. The Book of ... baffled scholars for centuries. Many have tossed it off as mere rubbish, but Yisrayl ...
(Date:10/13/2017)... ... ... “America On The Brink”: the Christian history of the United States and ... of published author, William Nowers. Captain Nowers and his wife, Millie, have six ... years in the Navy. Following his career as a naval aviator and carrier ...
Breaking Medicine News(10 mins):
(Date:9/27/2017)...  Commended for their devotion to personalized service, SMP Pharmacy ... one in the South Florida Business Journal,s 50 Fastest-Growing Companies, ... list, the national specialty pharmacy has found its niche.  To ... soon be honored by SFBJ as the 2017 Power Leader ... to receive his award in October, Bardisa said of the ...
(Date:9/23/2017)... , Sept. 22, 2017 Janssen Biotech, Inc. ... response letter from the U.S. Food and Drug Administration ... of sirukumab for the treatment of moderately to severely ... additional clinical data are needed to further evaluate the ... severely active RA. ...
(Date:9/19/2017)... LOUISVILLE, Ky. , Sept. 19, 2017   ZirMed ... and predictive analytics, today announced that it has been ranked ... the Black Book™ Rankings 2017 User Survey. ZirMed ... software solution for large hospitals and medical centers over 200 ... in Black Book,s healthcare technology user survey history. ...
Breaking Medicine Technology: