Matching Items (4)
Filtering by
- All Subjects: Optimal Control
- Creators: Castillo-Chavez, Carlos
- Creators: Berman, Spring Melody
Description
Infectious diseases are a leading cause of death worldwide. With the development of drugs, vaccines and antibiotics, it was believed that for the first time in human history diseases would no longer be a major cause of mortality. Newly emerging diseases, re-emerging diseases and the emergence of microorganisms resistant to existing treatment have forced us to re-evaluate our optimistic perspective. In this study, a simple mathematical framework for super-infection is considered in order to explore the transmission dynamics of drug-resistance. Through its theoretical analysis, we identify the conditions necessary for the coexistence between sensitive strains and drug-resistant strains. Farther, in order to investigate the effectiveness of control measures, the model is extended so as to include vaccination and treatment. The impact that these preventive and control measures may have on its disease dynamics is evaluated. Theoretical results being confirmed via numerical simulations. Our theoretical results on two-strain drug-resistance models are applied in the context of Malaria, antimalarial drugs, and the administration of a possible partially effective vaccine. The objective is to develop a monitoring epidemiological framework that help evaluate the impact of antimalarial drugs and partially-effective vaccine in reducing the disease burden at the population level. Optimal control theory is applied in the context of this framework in order to assess the impact of time dependent cost-effective treatment efforts. It is shown that cost-effective combinations of treatment efforts depend on the population size, cost of implementing treatment controls, and the parameters of the model. We use these results to identify optimal control strategies for several scenarios.
ContributorsUrdapilleta, Alicia (Author) / Castillo-Chavez, Carlos (Thesis advisor) / Wang, Xiaohong (Thesis advisor) / Wirkus, Stephen (Committee member) / Camacho, Erika (Committee member) / Arizona State University (Publisher)
Created2011
Description
This dissertation discusses continuous-time reinforcement learning (CT-RL) for control of affine nonlinear systems. Continuous-time nonlinear optimal control problems hold great promise in real-world applications. After decades of development, reinforcement learning (RL) has achieved some of the greatest successes as a general nonlinear control design method. Yet as RL control has developed, CT-RL results have greatly lagged their discrete-time RL (DT-RL) counterparts, especially in regards to real-world applications. Current CT-RL algorithms generally fall into two classes: adaptive dynamic programming (ADP), and actor-critic deep RL (DRL). The first school of ADP methods features elegant theoretical results stemming from adaptive and optimal control. Yet, they have not been shown effectively synthesizing meaningful controllers. The second school of DRL has shown impressive learning solutions, yet theoretical guarantees are still to be developed. A substantive analysis uncovering the quantitative causes of the fundamental gap between CT and DT remains to be conducted. Thus, this work develops a first-of-its kind quantitative evaluation framework to diagnose the performance limitations of the leading CT-RL methods. This dissertation also introduces a suite of new CT-RL algorithms which offers both theoretical and synthesis guarantees. The proposed design approach relies on three important factors. First, for physical systems that feature physically-motivated dynamical partitions into distinct loops, the proposed decentralization method breaks the optimal control problem into smaller subproblems. Second, the work introduces a new excitation framework to improve persistence of excitation (PE) and numerical conditioning via classical input/output insights. Third, the method scales the learning problem via design-motivated invertible transformations of the system state variables in order to modulate the algorithm learning regression for further increases in numerical stability. This dissertation introduces a suite of (decentralized) excitable integral reinforcement learning (EIRL) algorithms implementing these paradigms. It rigorously proves convergence, optimality, and closed-loop stability guarantees of the proposed methods, which are demonstrated in comprehensive comparative studies with the leading methods in ADP on a significant application problem of controlling an unstable, nonminimum phase hypersonic vehicle (HSV). It also conducts comprehensive comparative studies with the leading DRL methods on three state-of-the-art (SOTA) environments, revealing new performance/design insights.
ContributorsWallace, Brent Abraham (Author) / Si, Jennie (Thesis advisor) / Berman, Spring M (Committee member) / Bertsekas, Dimitri P (Committee member) / Tsakalis, Konstantinos S (Committee member) / Arizona State University (Publisher)
Created2024
Description
The 2009-10 influenza and the 2014-15 Ebola pandemics brought once again urgency to an old question: What are the limits on prediction and what can be proposed that is useful in the face of an epidemic outbreak?
This thesis looks first at the impact that limited access to vaccine stockpiles may have on a single influenza outbreak. The purpose is to highlight the challenges faced by populations embedded in inadequate health systems and to identify and assess ways of ameliorating the impact of resource limitations on public health policy.
Age-specific per capita constraint rates play an important role on the dynamics of communicable diseases and, influenza is, of course, no exception. Yet the challenges associated with estimating age-specific contact rates have not been decisively met. And so, this thesis attempts to connect contact theory with age-specific contact data in the context of influenza outbreaks in practical ways. In mathematical epidemiology, proportionate mixing is used as the preferred theoretical mixing structure and so, the frame of discussion of this dissertation follows this specific theoretical framework. The questions that drive this dissertation, in the context of influenza dynamics, proportionate mixing, and control, are:
I. What is the role of age-aggregation on the dynamics of a single outbreak? Or simply speaking, does the number and length of the age-classes used to model a population make a significant difference on quantitative predictions?
II. What would the age-specific optimal influenza vaccination policies be? Or, what are the age-specific vaccination policies needed to control an outbreak in the presence of limited or unlimited vaccine stockpiles?
Intertwined with the above questions are issues of resilience and uncertainty including, whether or not data collected on mixing (by social scientists) can be used effectively to address both questions in the context of influenza and proportionate mixing. The objective is to provide answers to these questions by assessing the role of aggregation (number and length of age classes) and model robustness (does the aggregation scheme selected makes a difference on influenza dynamics and control) via comparisons between purely data-driven model and proportionate mixing models.
This thesis looks first at the impact that limited access to vaccine stockpiles may have on a single influenza outbreak. The purpose is to highlight the challenges faced by populations embedded in inadequate health systems and to identify and assess ways of ameliorating the impact of resource limitations on public health policy.
Age-specific per capita constraint rates play an important role on the dynamics of communicable diseases and, influenza is, of course, no exception. Yet the challenges associated with estimating age-specific contact rates have not been decisively met. And so, this thesis attempts to connect contact theory with age-specific contact data in the context of influenza outbreaks in practical ways. In mathematical epidemiology, proportionate mixing is used as the preferred theoretical mixing structure and so, the frame of discussion of this dissertation follows this specific theoretical framework. The questions that drive this dissertation, in the context of influenza dynamics, proportionate mixing, and control, are:
I. What is the role of age-aggregation on the dynamics of a single outbreak? Or simply speaking, does the number and length of the age-classes used to model a population make a significant difference on quantitative predictions?
II. What would the age-specific optimal influenza vaccination policies be? Or, what are the age-specific vaccination policies needed to control an outbreak in the presence of limited or unlimited vaccine stockpiles?
Intertwined with the above questions are issues of resilience and uncertainty including, whether or not data collected on mixing (by social scientists) can be used effectively to address both questions in the context of influenza and proportionate mixing. The objective is to provide answers to these questions by assessing the role of aggregation (number and length of age classes) and model robustness (does the aggregation scheme selected makes a difference on influenza dynamics and control) via comparisons between purely data-driven model and proportionate mixing models.
ContributorsMorales, Romarie (Author) / Castillo-Chavez, Carlos (Thesis advisor) / Mubayi, Anuj (Thesis advisor) / Towers, Sherry (Committee member) / Arizona State University (Publisher)
Created2016
Description
This thesis considers two problems in the control of robotic swarms. Firstly, it addresses a trajectory planning and task allocation problem for a swarm of resource-constrained robots that cannot localize or communicate with each other and that exhibit stochasticity in their motion and task switching policies. We model the population dynamics of the robotic swarm as a set of advection-diffusion- reaction (ADR) partial differential equations (PDEs).
Specifically, we consider a linear parabolic PDE model that is bilinear in the robots' velocity and task-switching rates. These parameters constitute a set of time-dependent control variables that can be optimized and transmitted to the robots prior to their deployment or broadcasted in real time. The planning and allocation problem can then be formulated as a PDE-constrained optimization problem, which we solve using techniques from optimal control. Simulations of a commercial pollination scenario validate the ability of our control approach to drive a robotic swarm to achieve predefined spatial distributions of activity over a closed domain, which may contain obstacles. Secondly, we consider a mapping problem wherein a robotic swarm is deployed over a closed domain and it is necessary to reconstruct the unknown spatial distribution of a feature of interest. The ADR-based primitives result in a coefficient identification problem for the corresponding system of PDEs. To deal with the inherent ill-posedness of the problem, we frame it as an optimization problem. We validate our approach through simulations and show that reconstruction of the spatially-dependent coefficient can be achieved with considerable accuracy using temporal information alone.
Specifically, we consider a linear parabolic PDE model that is bilinear in the robots' velocity and task-switching rates. These parameters constitute a set of time-dependent control variables that can be optimized and transmitted to the robots prior to their deployment or broadcasted in real time. The planning and allocation problem can then be formulated as a PDE-constrained optimization problem, which we solve using techniques from optimal control. Simulations of a commercial pollination scenario validate the ability of our control approach to drive a robotic swarm to achieve predefined spatial distributions of activity over a closed domain, which may contain obstacles. Secondly, we consider a mapping problem wherein a robotic swarm is deployed over a closed domain and it is necessary to reconstruct the unknown spatial distribution of a feature of interest. The ADR-based primitives result in a coefficient identification problem for the corresponding system of PDEs. To deal with the inherent ill-posedness of the problem, we frame it as an optimization problem. We validate our approach through simulations and show that reconstruction of the spatially-dependent coefficient can be achieved with considerable accuracy using temporal information alone.
ContributorsElamvazhuthi, Karthik (Author) / Berman, Spring Melody (Thesis advisor) / Peet, Matthew Monnig (Committee member) / Mittelmann, Hans (Committee member) / Arizona State University (Publisher)
Created2014