Dynamical systems are frequently used to model biological systems. When these models are fit to data, it is necessary to ascertain the uncertainty in the model fit. Here, we present prediction deviation, a metric of uncertainty that determines the extent to which observed data have constrained the model's predictions. This is accomplished by solving an optimization problem that searches for a pair of models that each provides a good fit for the observed data, yet has maximally different predictions. We develop a method for estimating a priori the impact that additional experiments would have on the prediction deviation, allowing the experimenter to design a set of experiments that would most reduce uncertainty. We use prediction deviation to assess uncertainty in a model of interferon-alpha inhibition of viral infection, and to select a sequence of experiments that reduces this uncertainty. Finally, we prove a theoretical result which shows that prediction deviation provides bounds on the trajectories of the underlying true model. These results show that prediction deviation is a meaningful metric of uncertainty that can be used for optimal experimental design.
Details
- Prediction Uncertainty and Optimal Experimental Design for Learning Dynamical Systems
- Letham, Benjamin (Author)
- Letham, Portia (Author)
- Rudin, Cynthia (Author)
- Browne, Edward P. (Author)
- Ira A. Fulton Schools of Engineering (Contributor)
- Digital object identifier: 10.1063/1.4953795
- Identifier TypeInternational standard serial numberIdentifier Value0950-0618
- This article may be downloaded for personal use only. Any other use requires prior permission of the author and AIP Publishing. The following article appeared in Chaos: An Interdisciplinary Journal of Nonlinear Science and may be found at http://aip.scitation.org/doi/10.1063/1.4953795, opens in a new window.
Citation and reuse
Cite this item
This is a suggested citation. Consult the appropriate style guide for specific citation guidelines.
Letham, B., Letham, P. A., Rudin, C., & Browne, E. P. (2016). Prediction uncertainty and optimal experimental design for learning dynamical systems. Chaos: An Interdisciplinary Journal of Nonlinear Science, 26(6), 063110. doi:10.1063/1.4953795