Navigation Links
Overcoming structural uncertainty in computer models
Date:4/1/2014

Philadelphia, PA--A computer model is a representation of the functional relationship between one set of parameters, which forms the model input, and a corresponding set of target parameters, which forms the model output. A true model for a particular problem can rarely be defined with certainty. The most we can do to mitigate error is to quantify the uncertainty in the model.

In a recent paper published in the SIAM/ASA Journal on Uncertainty Quantification, authors Mark Strong and Jeremy Oakley offer a method to incorporate judgments into a model about structural uncertainty that results from building an "incorrect" model.

"Given that 'all models are wrong,' it is important that we develop methods for quantifying our uncertainty in model structure such that we can know when our model is 'good enough'," author Mark Strong says. "Better models mean better decisions."

When making predictions using computer models, we encounter two sources of uncertainty: uncertainty in model inputs and uncertainty in model structure. Input uncertainty arises when we are not certain about input parameters in model simulations. If we are uncertain about true structural relationships within a modelthat is, the relationship between the set of quantities that form the model input and the set that represents the outputthe model is said to display structural uncertainty. Such uncertainty exists even if the model is run using input values as estimated in a perfect study with infinite sample size.

"Perhaps the hardest problem in assessing uncertainty in a computer model prediction is to quantify uncertainty about the model structure, particularly when models are used to predict in the absence of data," says author Jeremy Oakley. "The methodology in this paper can help model users prioritize where improvements are needed in a model to provide more robust support to decision making."

While methods for managing input uncertainty are well described in the literature, methods for quantifying structural uncertainty are not as well developed. This is especially true in the context of health economic decision making, which is the focus of this paper. Here, models are used to predict future costs and health consequences of options to make decisions for resource allocation.

"In health economics decision analysis, the use of "law-based" computer models is common. Such models are used to support national health resource allocation decisions, and the stakes are therefore high," says Strong. "While it is usual in this setting to consider the uncertainty in model inputs, uncertainty in model structure is almost never formally assessed."

There are several approaches to managing model structural uncertainty. A primary approach is 'model averaging' in which predictions of a number of plausible models are averaged with weights based on each model's likelihood or predictive ability. Another approach is 'model calibration', which assesses a model based on its external discrepancies, that is, output quantities and how they relate to real, observed values. In the context of healthcare decisions, however, neither of these approaches is feasible since typically more than one model is not available for averaging, and observations on model outputs are not available for calibration.

Hence, the authors use a novel approach based on discrepancies within the model or "internal discrepancies" (as opposed to external discrepancies which are the focus of model calibration). Internal discrepancies are analyzed by first decomposing the model into a series of subunits or subfunctions, the outputs of which are intermediate model parameters that are potentially observable in the real world. Next, each sub-function is judged for certainty based on whether its output would equal the true value of the parameter from real-world observations. If a potential structural error is anticipated, a discrepancy term is introduced. Subsequently, beliefs about the size and direction of errors are expressed. Since judgments for internal discrepancies are expected to be crude at best, the expression of uncertainty should be generous, that is, allowed to cover a wide distribution of possible values. Finally, the authors determine the sensitivity of the model output to internal discrepancies. This gives an indication of the relative importance of structural uncertainty within each model subunit.

"Traditional statistical approaches to handling uncertainty in computer models have tended to treat the models as 'black boxes'. Our framework is based on 'opening' the black box and investigating the model's internal workings," says Oakley. "Developing and implementing this framework, particularly in more complex models, will need closer collaboration between statisticians and mathematical modelers."


'/>"/>

Contact: Karthika Muthukumaraswamy
karthika@siam.org
267-350-6383
Society for Industrial and Applied Mathematics
Source:Eurekalert  

Related medicine news :

1. “Tips on How to Overcome Fear of Failure,” A New Article on Vkool.com, Share Useful Tips with Readers on Overcoming the Fear of Failure - V-kool
2. Overcoming Emotional Eating
3. How “Reveal The Thin Within” Helps People Get Rid Of Fat – V kool
4. Lynn Gauthier Offers Personal Stories of Overcoming Vanity
5. Diabetes drug points the way to overcoming drug resistance in melanoma
6. Joe Jones, Personal Trainer to Seva Call Founder Shares Tips on Overcoming Gym Intimidation
7. Overcoming resistance to anti-cancer drugs by targeting cell powerhouses
8. New finding gives clues for overcoming tamoxifen-resistant breast cancer
9. Unprecedented structural insights: NMDA receptors can be blocked to limit neurotoxicity
10. Washington University and Barnes-Jewish Heart Specialists Hold CME Event: Top Advancements in the Treatment of Structural Heart Disease
11. Nobles Medical Technologies II's NobleStitch EL Receives Strong Reviews from Physicians at Congenital & Structural Interventions Congress (CSI) in Frankfurt
Post Your Comments:
*Name:
*Comment:
*Email:
Related Image:
Overcoming structural uncertainty in computer models
(Date:6/27/2016)... , ... June 27, 2016 , ... "FCPX editors can ... inside of Final Cut Pro X," said Christina Austin - CEO of Pixel Film ... Final Cut Pro X users can now reveal the media of their ...
(Date:6/27/2016)... ... ... TopConsumerReviews.com recently awarded their highest five-star rating to Best Buy Eyeglasses, an ... United States and Canada wear eyeglasses. Once considered to be a purely functional part ... fashion statement. Even celebrities use glasses as a way of creating an iconic image—like ...
(Date:6/26/2016)... ... , ... PawPaws brand pet supplements owned by Whole Health Supply ... health of felines. The formula is all-natural and is made from Chinese herbs that ... Cat Kidney Support Supplement Soft Chews are Astragalus Root Extract and Rehmannia Root ...
(Date:6/25/2016)... ... 25, 2016 , ... Austin residents seeking Mohs surgery services, can now turn ... to Dr. Russell Peckham for medical and surgical dermatology. , Dr. Dorsey brings specialization ... selective fellowship in Mohs Micrographic Surgery completed by Dr. Dorsey was under the direction ...
(Date:6/25/2016)... ... , ... As a lifelong Southern Californian, Dr. Omkar Marathe earned his Bachelors ... Geffen School of Medicine at UCLA. He trained in Internal Medicine at Scripps Green ... hematology/oncology at the UCLA-Olive View-Cedars Sinai program where he had the opportunity to train ...
Breaking Medicine News(10 mins):
(Date:6/24/2016)... June 24, 2016   Bay Area Lyme ... Dean Center for Tick Borne Illness , ... Rehabilitation, MIT Hacking Medicine, University of California, Berkeley, ... announced the five finalists of Lyme Innovation ... More than 100 scientists, clinicians, researchers, entrepreneurs, and ...
(Date:6/24/2016)... SAN CLEMENTE, Calif. , June 24, 2016 /PRNewswire/ ... pulmonary function testing company, is now able to perform sophisticated lung ... ndd Medical Technologies , Inc. Patients are ... labs.  Thanks to ndd,s EasyOne PRO ® , ARL patients like ... any needed testing done in the comfort of her own home. ...
(Date:6/24/2016)... June 24, 2016  Arkis BioSciences, a leading ... and more durable cerebrospinal fluid treatments, today announced ... Series-A funding is led by Innova Memphis, followed ... other private investors.  Arkis, new financing will accelerate ... the market release of its in-licensed Endexo® technology. ...
Breaking Medicine Technology: