Matching Items (71)
Description
Traditional Reinforcement Learning (RL) assumes to learn policies with respect to reward available from the environment but sometimes learning in a complex domain requires wisdom which comes from a wide range of experience. In behavior based robotics, it is observed that a complex behavior can be described by a combination of simpler behaviors. It is tempting to apply similar idea such that simpler behaviors can be combined in a meaningful way to tailor the complex combination. Such an approach would enable faster learning and modular design of behaviors. Complex behaviors can be combined with other behaviors to create even more advanced behaviors resulting in a rich set of possibilities. Similar to RL, combined behavior can keep evolving by interacting with the environment. The requirement of this method is to specify a reasonable set of simple behaviors. In this research, I present an algorithm that aims at combining behavior such that the resulting behavior has characteristics of each individual behavior. This approach has been inspired by behavior based robotics, such as the subsumption architecture and motor schema-based design. The combination algorithm outputs n weights to combine behaviors linearly. The weights are state dependent and change dynamically at every step in an episode. This idea is tested on discrete and continuous environments like OpenAI’s “Lunar Lander” and “Biped Walker”. Results are compared with related domains like Multi-objective RL, Hierarchical RL, Transfer learning, and basic RL. It is observed that the combination of behaviors is a novel way of learning which helps the agent achieve required characteristics. A combination is learned for a given state and so the agent is able to learn faster in an efficient manner compared to other similar approaches. Agent beautifully demonstrates characteristics of multiple behaviors which helps the agent to learn and adapt to the environment. Future directions are also suggested as possible extensions to this research.
ContributorsVora, Kevin Jatin (Author) / Zhang, Yu (Thesis advisor) / Yang, Yezhou (Committee member) / Praharaj, Sarbeswar (Committee member) / Arizona State University (Publisher)
Created2021
Description
Computational models have long been used to describe and predict the outcome of complex immunological processes. The dissertation work described here centers on the construction of multiscale computational immunology models that derives biological insights at the population, systems, and atomistic levels. First, SARS-CoV-2 mortality is investigated through the lens of the predicted robustness of CD8+ T cell responses in 23 different populations. The robustness of CD8+ T cell responses in a given population was modeled by predicting the efficiency of endemic MHC-I protein variants to present peptides derived from SARS-CoV-2 proteins to circulating T cells. To accomplish this task, an algorithm, called EnsembleMHC, was developed to predict viral peptides with a high probability of being recognized by CD T cells. It was discovered that there was significant variation in the efficiency of different MHC-I protein variants to present SARS-CoV-2 derived peptides, and countries enriched with variants with high presentation efficiency had significantly lower mortality rates. Second, a biophysics-based MHC-I peptide prediction algorithm was developed. The MHC-I protein is the most polymorphic protein in the human genome with polymorphisms in the peptide binding causing striking changes in the amino acid compositions, or binding motifs, of peptide species capable of stable binding. A deep learning model, coined HLA-Inception, was trained to predict peptide binding using only biophysical properties, namely electrostatic potential. HLA-Inception was shown to be extremely accurate and efficient at predicting peptide binding motifs and was used to determine the peptide binding motifs of 5,821 MHC-I protein variants. Finally, the impact of stalk glycosylations on NL63 protein dynamics was investigated. Previous data has shown that coronavirus crown glycans play an important role in immune evasion and receptor binding, however, little is known about the role of the stalk glycans. Through the integration of computational biology, experimental data, and physics-based simulations, the stalk glycans were shown to heavily influence the bending angle of spike protein, with a particular emphasis on the glycan at position 1242. Further investigation revealed that removal of the N1242 glycan significantly reduced infectivity, highlighting a new potential therapeutic target. Overall, these investigations and associated innovations in integrative modeling.
ContributorsWilson, Eric Andrew (Author) / Anderson, Karen (Thesis advisor) / Singharoy, Abhishek (Thesis advisor) / Woodbury, Neal (Committee member) / Sulc, Petr (Committee member) / Arizona State University (Publisher)
Created2022
Description
This work presents a thorough analysis of reconstruction of global wave fields (governed by the inhomogeneous wave equation and the Maxwell vector wave equation) from sensor time series data of the wave field. Three major problems are considered. First, an analysis of circumstances under which wave fields can be fully reconstructed from a network of fixed-location sensors is presented. It is proven that, in many cases, wave fields can be fully reconstructed from a single sensor, but that such reconstructions can be sensitive to small perturbations in sensor placement. Generally, multiple sensors are necessary. The next problem considered is how to obtain a global approximation of an electromagnetic wave field in the presence of an amplifying noisy current density from sensor time series data. This type of noise, described in terms of a cylindrical Wiener process, creates a nonequilibrium system, derived from Maxwell’s equations, where variance increases with time. In this noisy system, longer observation times do not generally provide more accurate estimates of the field coefficients. The mean squared error of the estimates can be decomposed into a sum of the squared bias and the variance. As the observation time $\tau$ increases, the bias decreases as $\mathcal{O}(1/\tau)$ but the variance increases as $\mathcal{O}(\tau)$. The contrasting time scales imply the existence of an ``optimal'' observing time (the bias-variance tradeoff). An iterative algorithm is developed to construct global approximations of the electric field using the optimal observing times. Lastly, the effect of sensor acceleration is considered. When the sensor location is fixed, measurements of wave fields composed of plane waves are almost periodic and so can be written in terms of a standard Fourier basis. When the sensor is accelerating, the resulting time series is no longer almost periodic. This phenomenon is related to the Doppler effect, where a time transformation must be performed to obtain the frequency and amplitude information from the time series data. To obtain frequency and amplitude information from accelerating sensor time series data in a general inhomogeneous medium, a randomized algorithm is presented. The algorithm is analyzed and example wave fields are reconstructed.
ContributorsBarclay, Bryce Matthew (Author) / Mahalov, Alex (Thesis advisor) / Kostelich, Eric J (Thesis advisor) / Moustaoui, Mohamed (Committee member) / Motsch, Sebastien (Committee member) / Platte, Rodrigo (Committee member) / Arizona State University (Publisher)
Created2023
Description
Climate is a critical determinant of agricultural productivity, and the ability to accurately predict this productivity is necessary to provide guidance regarding food security and agricultural management. Previous predictions vary in approach due to the myriad of factors influencing agricultural productivity but generally suggest long-term declines in productivity and agricultural land suitability under climate change. In this paper, I relate predicted climate changes to yield for three major United States crops, namely corn, soybeans, and wheat, using a moderate emissions scenario. By adopting data-driven machine learning approaches, I used the following machine learning methods: random forest (RF), extreme gradient boosting (XGB), and artificial neural networks (ANN) to perform comparative analysis and ensemble methodology. I omitted the western US due to the region's susceptibility to water stress and the prevalence of artificial irrigation as a means to compensate for dry conditions. By considering only climate, the model's results suggest an ensemble mean decline in crop yield of 23.4\% for corn, 19.1\% for soybeans, and 7.8\% for wheat between the years of 2017 and 2100. These results emphasize potential negative impacts of climate change on the current agricultural industry as a result of shifting bio-climactic conditions.
ContributorsSwarup, Shray (Author) / Eikenberry, Steffen (Thesis director) / Mahalov, Alex (Committee member) / Barrett, The Honors College (Contributor) / Computer Science and Engineering Program (Contributor)
Created2023-05
Description
Cities in the Global South face rapid urbanization challenges and often suffer an acute lack of infrastructure and governance capacities. Smart Cities Mission, in India, launched in 2015, aims to offer a novel approach for urban renewal of 100 cities following an area‐based development approach, where the use of ICT and digital technologies is particularly emphasized. This article presents a critical review of the design and implementation framework of this new urban renewal program across selected case‐study cities. The article examines the claims of the so‐called “smart cities” against actual urban transformation on‐ground and evaluates how “inclusive” and “sustainable” these developments are. We quantify the scale and coverage of the smart city urban renewal projects in the cities to highlight who the program includes and excludes. The article also presents a statistical analysis of the sectoral focus and budgetary allocations of the projects under the Smart Cities Mission to find an inherent bias in these smart city initiatives in terms of which types of development they promote and the ones it ignores. The findings indicate that a predominant emphasis on digital urban renewal of selected precincts and enclaves, branded as “smart cities,” leads to deepening social polarization and gentrification. The article offers crucial urban planning lessons for designing ICT‐driven urban renewal projects, while addressing critical questions around inclusion and sustainability in smart city ventures.`
ContributorsPraharaj, Sarbeswar (Author)
Created2021-05-07
Description
Attitudes and habits are extremely resistant to change, but a disruption of the magnitude of the COVID-19 pandemic has the potential to bring long-term, massive societal changes. During the pandemic, people are being compelled to experience new ways of interacting, working, learning, shopping, traveling, and eating meals. Going forward, a critical question is whether these experiences will result in changed behaviors and preferences in the long term. This paper presents initial findings on the likelihood of long-term changes in telework, daily travel, restaurant patronage, and air travel based on survey data collected from adults in the United States in Spring 2020. These data suggest that a sizable fraction of the increase in telework and decreases in both business air travel and restaurant patronage are likely here to stay. As for daily travel modes, public transit may not fully recover its pre-pandemic ridership levels, but many of our respondents are planning to bike and walk more than they used to. These data reflect the responses of a sample that is higher income and more highly educated than the US population. The response of these particular groups to the COVID-19 pandemic is perhaps especially important to understand, however, because their consumption patterns give them a large influence on many sectors of the economy.
ContributorsConway, Matthew Wigginton (Author) / Salon, Deborah (Author) / da Silva, Denise Capasso (Author) / Mirtich, Laura Christine (Author)
Created2020-09-03
Description
This work focuses on a novel approach to combine electrical current with cyanobacterial technology, called microbial electrophotosynthesis (MEPS). It involves using genetically modified PSII-less Synechocystis PCC 6803 cells to avoid photoinhibition, a problem that hinders green energy. In the work, a cathodic electron delivery system is employed for growth and synthesis. Photoinhibition leads to the dissipation energy and lower yield, and is a major obstacle to preventing green energy from competing with fossil fuels. However, the urgent need for alternative energy sources is driven by soaring energy consumption and rising atmospheric carbon dioxide levels. When developed, MEPS can contribute to a carbon capture technology while helping with energy demands. It is thought that if PSII electron flux can be replaced with an alternative source photosynthesis could be enhanced for more effective production. MEPS has the potential to address these challenges by serving as a carbon capture technology while meeting energy demands. The idea is to replace PSII electron flux with an alternative source, which can be enhanced for higher yields in light intensities not tolerated with PSII. This research specifically focuses on creating the initiation of electron flux between the cathode and the MEPS cells while controlling and measuring the system in real time.
The successful proof-of-concept work shows that MEPS can indeed generate high-light-dependent current at intensities up to 2050 µmol photons m^‒2 s^‒1, delivering 113 µmol electrons h^‒1 mg-chl^‒1. The results were further developed to characterize redox tuning for electron delivery of flux to the photosynthetic electron transport chain and redox-based kinetic analysis to model the limitations of the MEPS system.
ContributorsLewis, Christine Michelle (Author) / Torres, César I (Thesis advisor) / Fromme, Petra (Thesis advisor) / Woodbury, Neal (Committee member) / Hayes, Mark (Committee member) / Arizona State University (Publisher)
Created2023
Description
Earth-system models describe the interacting components of the climate system and
technological systems that affect society, such as communication infrastructures. Data
assimilation addresses the challenge of state specification by incorporating system
observations into the model estimates. In this research, a particular data
assimilation technique called the Local Ensemble Transform Kalman Filter (LETKF) is
applied to the ionosphere, which is a domain of practical interest due to its effects
on infrastructures that depend on satellite communication and remote sensing. This
dissertation consists of three main studies that propose strategies to improve space-
weather specification during ionospheric extreme events, but are generally applicable
to Earth-system models:
Topic I applies the LETKF to estimate ion density with an idealized model of
the ionosphere, given noisy synthetic observations of varying sparsity. Results show
that the LETKF yields accurate estimates of the ion density field and unobserved
components of neutral winds even when the observation density is spatially sparse
(2% of grid points) and there is large levels (40%) of Gaussian observation noise.
Topic II proposes a targeted observing strategy for data assimilation, which uses
the influence matrix diagnostic to target errors in chosen state variables. This
strategy is applied in observing system experiments, in which synthetic electron density
observations are assimilated with the LETKF into the Thermosphere-Ionosphere-
Electrodynamics Global Circulation Model (TIEGCM) during a geomagnetic storm.
Results show that assimilating targeted electron density observations yields on
average about 60%–80% reduction in electron density error within a 600 km radius of
the observed location, compared to 15% reduction obtained with randomly placed
vertical profiles.
Topic III proposes a methodology to account for systematic model bias arising
ifrom errors in parametrized solar and magnetospheric inputs. This strategy is ap-
plied with the TIEGCM during a geomagnetic storm, and is used to estimate the
spatiotemporal variations of bias in electron density predictions during the
transitionary phases of the geomagnetic storm. Results show that this strategy reduces
error in 1-hour predictions of electron density by about 35% and 30% in polar regions
during the main and relaxation phases of the geomagnetic storm, respectively.
technological systems that affect society, such as communication infrastructures. Data
assimilation addresses the challenge of state specification by incorporating system
observations into the model estimates. In this research, a particular data
assimilation technique called the Local Ensemble Transform Kalman Filter (LETKF) is
applied to the ionosphere, which is a domain of practical interest due to its effects
on infrastructures that depend on satellite communication and remote sensing. This
dissertation consists of three main studies that propose strategies to improve space-
weather specification during ionospheric extreme events, but are generally applicable
to Earth-system models:
Topic I applies the LETKF to estimate ion density with an idealized model of
the ionosphere, given noisy synthetic observations of varying sparsity. Results show
that the LETKF yields accurate estimates of the ion density field and unobserved
components of neutral winds even when the observation density is spatially sparse
(2% of grid points) and there is large levels (40%) of Gaussian observation noise.
Topic II proposes a targeted observing strategy for data assimilation, which uses
the influence matrix diagnostic to target errors in chosen state variables. This
strategy is applied in observing system experiments, in which synthetic electron density
observations are assimilated with the LETKF into the Thermosphere-Ionosphere-
Electrodynamics Global Circulation Model (TIEGCM) during a geomagnetic storm.
Results show that assimilating targeted electron density observations yields on
average about 60%–80% reduction in electron density error within a 600 km radius of
the observed location, compared to 15% reduction obtained with randomly placed
vertical profiles.
Topic III proposes a methodology to account for systematic model bias arising
ifrom errors in parametrized solar and magnetospheric inputs. This strategy is ap-
plied with the TIEGCM during a geomagnetic storm, and is used to estimate the
spatiotemporal variations of bias in electron density predictions during the
transitionary phases of the geomagnetic storm. Results show that this strategy reduces
error in 1-hour predictions of electron density by about 35% and 30% in polar regions
during the main and relaxation phases of the geomagnetic storm, respectively.
ContributorsDurazo, Juan, Ph.D (Author) / Kostelich, Eric J. (Thesis advisor) / Mahalov, Alex (Thesis advisor) / Tang, Wenbo (Committee member) / Moustaoui, Mohamed (Committee member) / Platte, Rodrigo (Committee member) / Arizona State University (Publisher)
Created2018
Description
The fundamental photophysics of fluorescent probes must be understood when the probes are used in biological applications. The photophysics of BODIPY dyes inside polymeric micelles and rhodamine dyes covalently linked to proteins were studied. Hydrophobic boron-dipyrromethene (BODIPY) dyes were noncovalently encapsulated inside polymeric micelles. Absorbance and fluorescence measurements were employed to study the photophysics of these BODIPY dyes in the micellar environments. Amphiphilic polymers with a hydrophobic character and low Critical Micelle Concentration (CMC) protected BODIPYS from the aqueous environment. Moderate dye loading conditions did not result in ground-state dimerization, and only fluorescence lifetimes and brightnesses were affected. However, amphiphilic polymers with a hydrophilic character and high CMC did not protect the BODIPYS from the aqueous environment with concomitant ground-state dimerization and quenching of the fluorescence intensity, lifetime, and brightnesses even at low dye loading conditions. At the doubly-labeled interfaces of Escherichia coli (E. coli) DNA processivity β clamps, the interchromophric interactions of four rhodamine dyes were studied: tetramethylrhodamine (TMR), TMR C6, Alexa Fluor 488, and Alexa Fluor 546. Absorbance and fluorescence measurements were performed on doubly-labeled β clamps with singly-labeled β clamps and free dyes as controls. The absorbance measurements revealed that both TMR and TMR C6 readily formed H-dimers (static quenching) at the doubly-labeled interfaces of the β clamps. However, the TMR with a longer linker (TMR C6) also displayed a degree of dynamic quenching. For Alexa Fluor 546 and Alexa Fluor 488, there were no clear signs of dimerization in the absorbance scans. However, the fluorescence properties (fluorescence intensity, lifetime, and anisotropy) of the Alexa Fluor dyes significantly changed when three methodologies were employed to disrupt the doubly-labeled interfaces: 1) the addition of sodium dodecyl sulfate (SDS) detergent to denature the proteins, 2) the addition of clamp loader (γ complex) to open one of the two interfaces, and 3) the use of subunit exchange to decrease the number of dyes per interface. These fluorescence measurements indicated that for the Alexa Fluor dyes, other interchromophoric interactions were present such as dynamic quenching and homo-Förster Resonance Energy Transfer (homo-FRET).
ContributorsDonaphon, Bryan Matthew (Author) / Levitus, Marcia (Thesis advisor) / Van Horn, Wade (Committee member) / Woodbury, Neal (Committee member) / Arizona State University (Publisher)
Created2018
Description
The highly predictable structural and thermodynamic behavior of deoxynucleic acid (DNA) and ribonucleic acid (RNA) have made them versatile tools for creating artificial nanostructures over broad range. Moreover, DNA and RNA are able to interact with biological ligand as either synthetic aptamers or natural components, conferring direct biological functions to the nucleic acid devices. The applications of nucleic acids greatly relies on the bio-reactivity and specificity when applied to highly complexed biological systems.
This dissertation aims to 1) develop new strategy to identify high affinity nucleic acid aptamers against biological ligand; and 2) explore highly orthogonal RNA riboregulators in vivo for constructing multi-input gene circuits with NOT logic. With the aid of a DNA nanoscaffold, pairs of hetero-bivalent aptamers for human alpha thrombin were identified with ultra-high binding affinity in femtomolar range with displaying potent biological modulations for the enzyme activity. The newly identified bivalent aptamers enriched the aptamer tool box for future therapeutic applications in hemostasis, and also the strategy can be potentially developed for other target molecules. Secondly, by employing a three-way junction structure in the riboregulator structure through de-novo design, we identified a family of high-performance RNA-sensing translational repressors that down-regulates gene translation in response to cognate RNAs with remarkable dynamic range and orthogonality. Harnessing the 3WJ repressors as modular parts, we integrate them into biological circuits that execute universal NAND and NOR logic with up to four independent RNA inputs in Escherichia coli.
This dissertation aims to 1) develop new strategy to identify high affinity nucleic acid aptamers against biological ligand; and 2) explore highly orthogonal RNA riboregulators in vivo for constructing multi-input gene circuits with NOT logic. With the aid of a DNA nanoscaffold, pairs of hetero-bivalent aptamers for human alpha thrombin were identified with ultra-high binding affinity in femtomolar range with displaying potent biological modulations for the enzyme activity. The newly identified bivalent aptamers enriched the aptamer tool box for future therapeutic applications in hemostasis, and also the strategy can be potentially developed for other target molecules. Secondly, by employing a three-way junction structure in the riboregulator structure through de-novo design, we identified a family of high-performance RNA-sensing translational repressors that down-regulates gene translation in response to cognate RNAs with remarkable dynamic range and orthogonality. Harnessing the 3WJ repressors as modular parts, we integrate them into biological circuits that execute universal NAND and NOR logic with up to four independent RNA inputs in Escherichia coli.
ContributorsZhou, Yu (Ph.D.) (Author) / Yan, Hao (Thesis advisor) / Green, Alexander (Thesis advisor) / Woodbury, Neal (Committee member) / Ros, Alexandra (Committee member) / Arizona State University (Publisher)
Created2019