Navigation Links
New algorithm helps evaluate, rank scientific literature
Date:4/18/2013

Keeping up with current scientific literature is a daunting task, considering that hundreds to thousands of papers are published each day. Now researchers from North Carolina State University have developed a computer program to help them evaluate and rank scientific articles in their field.

The researchers use a text-mining algorithm to prioritize research papers to read and include in their Comparative Toxicogenomics Database (CTD), a public database that manually curates and codes data from the scientific literature describing how environmental chemicals interact with genes to affect human health.

"Over 33,000 scientific papers have been published on heavy metal toxicity alone, going as far back as 1926," explains Dr. Allan Peter Davis, a biocuration project manager for CTD at NC State who worked on the project and co-lead author of an article on the work. "We simply can't read and code them all. And, with the help of this new algorithm, we don't have to."

To help select the most relevant papers for inclusion in the CTD, Thomas Wiegers, a research bioinformatician at NC State and the other co-lead author of the report, developed a sophisticated algorithm as part of a text-mining process. The application evaluates the text from thousands of papers and assigns a relevancy score to each document. "The score ranks the set of articles to help separate the wheat from the chaff, so to speak," Wiegers says.

But how good is the algorithm at determining the best papers? To test that, the researchers text-mined 15,000 articles and sent a representative sample to their team of biocurators to manually read and evaluate on their own, blind to the computer's score. "The results were impressive," Davis says. The biocurators concurred with the algorithm 85 percent of the time with respect to the highest-scored papers.

Using the algorithm to rank papers allowed biocurators to focus on the most relevant papers, increasing productivity by 27 percent and novel data content by 100 percent. "It's a tremendous time-saving step," Davis explains. "With this we can allocate our resources much more effectively by having the team focus on the most informative papers."

There are always outliers in these types of experiments: occasions where the algorithm assigns a very high score to an article that a human biocurator quickly dismisses as irrelevant. The team that looked at those outliers was often able to see a pattern as to why the algorithm mistakenly identified a paper as important. "Now, we can go back and tweak the algorithm to account for this and fine-tune the system," Wiegers says.

"We're not at the point yet where a computer can read and extract all the relevant data on its own," Davis concludes, "but having this text-mining process to direct us toward the most informative articles is a huge first step."


'/>"/>

Contact: Matt Shipman
matt_shipman@ncsu.edu
919-515-6386
North Carolina State University
Source:Eurekalert

Related medicine news :

1. New breast imaging algorithm brings breast cancer diagnosis and treatment to underserved area of Uganda
2. Google Rolls Out Another Panda Algorithm Update – Small Businesses Plan for the Future of SEO
3. Custom iPad Case Helps Businesses Improve Brand Awareness with UV Flatbed Printing
4. Sleep Apnea is a Worldwide Epidemic: Better Rest Solutions Helps Spread Awareness on Sleep Apnea Awareness Day
5. Rutland VT Dentist, Donald P McLaughlin, DDS, Helps Local Patients Overcome Sleep Apnea Without Surgery, CPAP
6. NATRENH Releases a New Package Which Helps Women Get a More Curvaceous Body and Get a Bigger Butt
7. Safety Services Company Helps Canadian Employees Avoid Death
8. DoD Selects Hensel Phelps / BlueForge for Elite Mentor-Protégé Program
9. How To Grow Taller
10. How “Taller4u” Helps People Increase Height Quickly – V-kool
11. MDCT helps better determine valve implant size for transcatheter aortic valve in patients with aortic stenosis
Post Your Comments:
*Name:
*Comment:
*Email:
(Date:6/25/2016)... ... June 25, 2016 , ... Experts from the American Institutes ... Research Meeting June 26-28, 2016, at the Hynes Convention Center in Boston. , ... advance care planning, healthcare costs and patient and family engagement. , AIR researchers ...
(Date:6/25/2016)... (PRWEB) , ... June 25, 2016 , ... The temporary closing of Bruton Memorial Library ... City Observer , brings up a new, often overlooked aspect of head lice: the parasite’s ... for fumigation is not a common occurrence, but a necessary one in the event that ...
(Date:6/25/2016)... ... 2016 , ... First Choice Emergency Room , the largest network of ... Medical Director of its new Mesquite-Samuell Farm facility. , “We are pleased to ... said Dr. James M. Muzzarelli, Executive Medical Director of First Choice Emergency Room. ...
(Date:6/25/2016)... (PRWEB) , ... June 25, 2016 , ... ... athletes and non-athletes recover from injury. Recently, he has implemented orthobiologic procedures as ... City area —Johnson is one of the first doctors to perform the treatment. ...
(Date:6/25/2016)... ... ... Conventional wisdom preaches the benefits of moderation, whether it’s a matter of ... too high can result in disappointment, perhaps even self-loathing. However, those who set the ... Research from PsychTests.com reveals that behind the tendency to set low expectations ...
Breaking Medicine News(10 mins):
(Date:6/24/2016)... DUBLIN , June 24, 2016 ... addition of the "Structural Electronics 2015-2025: Applications, ... In-Mold Electronics, Smart ... Integrated Photovoltaics Structural electronics involves ... as load-bearing, protective structures, replacing dumb structures such ...
(Date:6/24/2016)... June 24, 2016 Research and Markets ... for Companion Diagnostic Tests" report to their offering. ... Companion Diagnostics The World Market for Companion ... medicine diagnostics. Market analysis in the report includes the following: ... (In Vitro Diagnostic Kits) by Region (N. America, EU, ROW), ...
(Date:6/24/2016)... , June 24, 2016  Arkis BioSciences, a ... invasive and more durable cerebrospinal fluid treatments, today ... The Series-A funding is led by Innova Memphis, ... and other private investors.  Arkis, new financing will ... and the market release of its in-licensed Endexo® ...
Breaking Medicine Technology: