Matching Items (166)
Description
Traditional Reinforcement Learning (RL) assumes to learn policies with respect to reward available from the environment but sometimes learning in a complex domain requires wisdom which comes from a wide range of experience. In behavior based robotics, it is observed that a complex behavior can be described by a combination of simpler behaviors. It is tempting to apply similar idea such that simpler behaviors can be combined in a meaningful way to tailor the complex combination. Such an approach would enable faster learning and modular design of behaviors. Complex behaviors can be combined with other behaviors to create even more advanced behaviors resulting in a rich set of possibilities. Similar to RL, combined behavior can keep evolving by interacting with the environment. The requirement of this method is to specify a reasonable set of simple behaviors. In this research, I present an algorithm that aims at combining behavior such that the resulting behavior has characteristics of each individual behavior. This approach has been inspired by behavior based robotics, such as the subsumption architecture and motor schema-based design. The combination algorithm outputs n weights to combine behaviors linearly. The weights are state dependent and change dynamically at every step in an episode. This idea is tested on discrete and continuous environments like OpenAI’s “Lunar Lander” and “Biped Walker”. Results are compared with related domains like Multi-objective RL, Hierarchical RL, Transfer learning, and basic RL. It is observed that the combination of behaviors is a novel way of learning which helps the agent achieve required characteristics. A combination is learned for a given state and so the agent is able to learn faster in an efficient manner compared to other similar approaches. Agent beautifully demonstrates characteristics of multiple behaviors which helps the agent to learn and adapt to the environment. Future directions are also suggested as possible extensions to this research.
ContributorsVora, Kevin Jatin (Author) / Zhang, Yu (Thesis advisor) / Yang, Yezhou (Committee member) / Praharaj, Sarbeswar (Committee member) / Arizona State University (Publisher)
Created2021
Description
Mycobacterial infections, as represented by leprosy and tuberculosis, have persisted as human pathogens for millennia. Their environmental counterparts, nontuberculous mycobacteria (NTM), are commodious infectious agents endowed with extensive innate and acquired antimicrobial resistance. The current drug development process selects for antibiotics with high specificity for definitive targets within bacterial metabolic and replication pathways. Because these compounds demonstrate limited efficacy against mycobacteria, novel antimycobacterial agents with unconventional mechanisms of action were identified. Two highly resistant NTMs, Mycobacterium abscessus (Mabs) a rapid-growing respiratory, skin, and soft tissue pathogen, and Mycobacterium ulcerans (MU), the causative agent of Buruli ulcer, were selected as targets. Compounds that indicated antimicrobial activity against other highly resistant pathogens were selected for initial screening. Antimicrobial peptides (AMPs) have demonstrated activity against a variety of bacterial pathogens, including mycobacterial species. Designed antimicrobial peptides (dAMPs), rationally-designed and synthetic contingents, combine iterative features of natural AMPs to achieve superior antimicrobial activity in resistant pathogens. Initial screening identified two dAMPs, RP554 and RP557, with bactericidal activity against Mabs. Clay-associated ions have previously demonstrated bactericidal activity against MU. Synthetic and customizable aluminosilicates have also demonstrated adsorption of bacterial cells and toxins. On this basis, two aluminosilicate materials, geopolymers (GP) and ion-exchange nanozeolites (IE-nZeos), were screened for antimicrobial activity against MU and its fast-growing relative, Mycobacterium marinum (Mmar). GPs demonstrated adsorption of MU cells and mycolactone, a secreted, lipophilic toxin, whereas Cu-nZeos and Ag-nZeos demonstrated antibacterial activity against MU and Mmar. Cumulatively, these results indicate that an integrative drug selection process may yield a new generation of antimycobacterial agents.
ContributorsDermody, Roslyn June (Author) / Haydel, Shelley E (Thesis advisor) / Bean, Heather (Committee member) / Nickerson, Cheryl (Committee member) / Stephanopoulos, Nicholas (Committee member) / Arizona State University (Publisher)
Created2022
Description
Molecular structures and dynamics in amorphous materials present unique experimental challenges compared with the characterization of crystalline solids. Liquids and glassy solids have many applications in industry such as ionic liquids for fuel cells or biomolecule stabilizing agents, enhancing pharmaceuticals dissolution rates, and modified high performance biopolymers like silk for textile, biomedical, drug delivery, among many others. Amorphous materials are metastable, with kinetic profiles of phase transitions depending on relaxation dynamics, thermal history, plus factors such as temperature, pressure, and humidity. Understanding molecular structure and phase transitions of amorphous states of small molecules and biopolymers is broadly important for realizing their applications. The structure of liquid and glassy states of the drugs carbamazepine (CBZ) and indomethacin (IMC) were studied with solid-state nuclear magnetic resonance (ssNMR) spectroscopy, high energy X-ray diffraction, Fourier Infrared Transform Spectroscopy (FTIR), differential scanning calorimetry (DSC), and Empirical Potential Structure Refinement (EPSR). Both drugs have multiple crystalline polymorphs with slow dissolution kinetics, necessitating stable glassy or polymer dispersed formulations. More hydrogen bonds per CBZ molecule and a larger distribution of oligomeric states in the glass versus the liquid than expected. The chlorobenzyl ring of crystalline and glassy IMC measured with ssNMR were surprisingly found to have similar mobility. Crucially, humidity strongly affects glass structure, highlighting the importance of combining modeling techniques like EPSR with careful sample preparation for proper interpretation. Highly basic protic ionic liquids with low ∆pKa were synthesized with metathesis rather than proton transfer and characterized using NMR and dielectric spectroscopy. Finally, the protein secondary structure of spider egg sac silk was studied using ssNMR, FTIR, and scanning electron microscopy. Tubuliform silk found in spider egg sacs has extensive β-sheet domains which form nanocrystallites within an amorphous matrix. Structural predictions and spectroscopic measurements of tubuliform silk solution are mostly α-helical, with the mechanism of structural rearrangement to the β-sheet rich fiber unknown. The movement of spiders during egg silk spinning make in situ experiments difficult practically. This work is the first observation that tubuliform silk of Argiope aurantia after liquid crystalline spinning exits the spinneret as a predominantly (~70%) β-sheet fiber.
ContributorsEdwards, Angela Diane (Author) / Yarger, Jeffery L (Thesis advisor) / Liu, Yan (Committee member) / Mujica, Vladimiro (Committee member) / Arizona State University (Publisher)
Created2022
Description
Computational models have long been used to describe and predict the outcome of complex immunological processes. The dissertation work described here centers on the construction of multiscale computational immunology models that derives biological insights at the population, systems, and atomistic levels. First, SARS-CoV-2 mortality is investigated through the lens of the predicted robustness of CD8+ T cell responses in 23 different populations. The robustness of CD8+ T cell responses in a given population was modeled by predicting the efficiency of endemic MHC-I protein variants to present peptides derived from SARS-CoV-2 proteins to circulating T cells. To accomplish this task, an algorithm, called EnsembleMHC, was developed to predict viral peptides with a high probability of being recognized by CD T cells. It was discovered that there was significant variation in the efficiency of different MHC-I protein variants to present SARS-CoV-2 derived peptides, and countries enriched with variants with high presentation efficiency had significantly lower mortality rates. Second, a biophysics-based MHC-I peptide prediction algorithm was developed. The MHC-I protein is the most polymorphic protein in the human genome with polymorphisms in the peptide binding causing striking changes in the amino acid compositions, or binding motifs, of peptide species capable of stable binding. A deep learning model, coined HLA-Inception, was trained to predict peptide binding using only biophysical properties, namely electrostatic potential. HLA-Inception was shown to be extremely accurate and efficient at predicting peptide binding motifs and was used to determine the peptide binding motifs of 5,821 MHC-I protein variants. Finally, the impact of stalk glycosylations on NL63 protein dynamics was investigated. Previous data has shown that coronavirus crown glycans play an important role in immune evasion and receptor binding, however, little is known about the role of the stalk glycans. Through the integration of computational biology, experimental data, and physics-based simulations, the stalk glycans were shown to heavily influence the bending angle of spike protein, with a particular emphasis on the glycan at position 1242. Further investigation revealed that removal of the N1242 glycan significantly reduced infectivity, highlighting a new potential therapeutic target. Overall, these investigations and associated innovations in integrative modeling.
ContributorsWilson, Eric Andrew (Author) / Anderson, Karen (Thesis advisor) / Singharoy, Abhishek (Thesis advisor) / Woodbury, Neal (Committee member) / Sulc, Petr (Committee member) / Arizona State University (Publisher)
Created2022
Description
Mycobacterium tuberculosis (Mtb), the etiological agent of the tuberculosis disease, is estimated to infect one-fourth of the human population and is responsible for 1.5 million deaths annually. The increased emergence of bacterial resistance to clinical interventions highlights the lack in development of novel antimicrobial therapeutics. Prototypical bacterial two-component systems (TCS) allow for sensing of extracellular stimuli and relay thereof to create a transcriptional response. The prrAB TCS is essential for viability in Mtb, presenting itself as an attractive novel drug target. In Mtb, PrrAB is involved in the adaptation to the intra-macrophage environment and recent work implicates PrrAB in the dosR-dependent hypoxia adaptation. This work defines a direct molecular and regulatory connection between Mtb PrrAB and the dosR-dependent hypoxia response. Using electrophoretic mobility shift assays combined with surface plasmon resonance, the Mtb dosR gene is established as a specific target of PrrA, corroborated by fluorescence reporter assays demonstrating a regulatory relationship. Considering the scarce understanding of prrAB essentiality in nontuberculous mycobacteria and the presence of multiple prrAB orthologs in Mycobacterium smegmatis and Mycobacterium abscessus, CRISPR interference was utilized to evaluate the essentiality of PrrAB beyond Mtb. prrAB was found to be inessential for viability in M. smegmatis yet required for in vitro growth. Conversely, M. abscessus prrAB repression led to enhanced in vitro growth. Diarylthiazole-48 (DAT-48) displayed decreased selectivity against M. abscessus but demonstrated enhanced intrinsic activity upon prrAB repression in M. abscessus. Lastly, to aid in the rapid determination of mycobacterial drug susceptibility and the detection of mycobacterial heteroresistance, the large volume scattering imaging (LVSim) platform was adapted for mycobacteria. Using LVSim, Mtb drug susceptibility was detected phenotypically within 6 hours, and clinically relevant mycobacterial heteroresistance was detected phenotypically within 10 generations. The data generated in these studies provide insight into the essential role of PrrAB in Mtb and its involvement in the dosR-dependent hypoxia adaptation, advance the understanding of mycobacterial PrrAB essentiality and PrrAB-associated mycobacterial growth dependency. These studies further establish molecular and mechanistic connection between PrrAB and DAT-48 in Mtb and M. abscessus and develop a rapid phenotypic drug susceptibility testing platform for mycobacteria.
ContributorsHaller, Yannik Alex (Author) / Haydel, Shelley E (Thesis advisor) / Bean, Heather (Committee member) / Nickerson, Cheryl (Committee member) / Plaisier, Christopher (Committee member) / Acharya, Abhinav (Committee member) / Arizona State University (Publisher)
Created2023
Description
A remarkable phenomenon in contemporary physics is quantum scarring in classically chaoticsystems, where the wave functions tend to concentrate on classical periodic orbits. Quantum
scarring has been studied for more than four decades, but the problem of efficiently detecting
quantum scars has remained to be challenging, relying mostly on human visualization of
wave function patterns. This paper develops a machine learning approach to detecting
quantum scars in an automated and highly efficient manner. In particular, this paper exploits Meta
learning. The first step is to construct a few-shot classification algorithm, under the
requirement that the one-shot classification accuracy be larger than 90%. Then propose a
scheme based on a combination of neural networks to improve the accuracy. This paper shows that
the machine learning scheme can find the correct quantum scars from thousands images of
wave functions, without any human intervention, regardless of the symmetry of the underlying
classical system. This will be the first application of Meta learning to quantum systems. Interacting spin networks are fundamental to quantum computing. Data-based tomography oftime-independent spin networks has been achieved, but an open challenge is to ascertain the
structures of time-dependent spin networks using time series measurements taken locally
from a small subset of the spins. Physically, the dynamical evolution of a spin network under
time-dependent driving or perturbation is described by the Heisenberg equation of motion.
Motivated by this basic fact, this paper articulates a physics-enhanced machine learning framework
whose core is Heisenberg neural networks. This paper demonstrates that, from local measurements, not only the local Hamiltonian can be recovered but the Hamiltonian reflecting the interacting structure of the whole system can
also be faithfully reconstructed. Using Heisenberg neural machine on spin networks of a
variety of structures. In the extreme case where measurements are taken from only one spin,
the achieved tomography fidelity values can reach about 90%. The developed machine
learning framework is applicable to any time-dependent systems whose quantum dynamical
evolution is governed by the Heisenberg equation of motion.
ContributorsHan, Chendi (Author) / Lai, Ying-Cheng (Thesis advisor) / Yu, Hongbin (Committee member) / Dasarathy, Gautam (Committee member) / Seo, Jae-Sun (Committee member) / Arizona State University (Publisher)
Created2022
Description
DNA nanotechnology, the self-assembly of DNA into 2D and 3D nanoscale structures facilitated via Watson and Crick base pairing, provides alternative solutions for biomedical challenges, especially for therapeutic cargo delivery, because it is easily fabricated, exhibits low cytotoxicity, and high biocompatibility. However, the stability of these DNA nanostructures (DN) under cellular environment presents an issue due to their requirements for high salt conditions and susceptibility to nuclease degradation. Furthermore, DNs are typically trapped in endolysosomal compartments rather than the cytosol, where most of their cargo must be delivered. Many attempts to mitigate the stability issue have been made in recent years. Previously, our lab designed an endosomal escape peptide, Aurein 1.2 (denoted “EE, for endosomal escape)”, combined with a decalysine sequence (K10) proven to electrostatically adhere to and protect DNs under cell culture conditions. Unfortunately, this molecule, termed K10-EE, only resulted in endosomal escape in absence of serum due to formation of a protein corona on the surface of the coated DN.6 Therefore, we now propose to electrostatically coat the DN with a polymer composed of decalysine (K10), polyethylene glycol (PEG, which demonstrates antibiofouling properties), and peptide EE: K10- PEG1k-EE. Described herein are the attempted synthetic schemes of K10-PEG1k-EE, the successful synthesis of alternative products, K10-(EK)5 and K10-(PEG12)2-EE, and their resulting impacts on DN stability under biological conditions. Coating of the K10-(EK)5 with a DNA barrel origami demonstrated inefficient stabilizing capability in serum. Future studies include testing K10- (PEG12)2-EE protection for a variety of nucleic acid-based structures.
ContributorsChen, Eva (Author) / Stephanopoulos, Nicholas (Thesis director) / Liu, Yan (Committee member) / Ghirlanda, Giovanna (Committee member) / Barrett, The Honors College (Contributor) / School of Molecular Sciences (Contributor)
Created2023-05
Description
One of the identified health risk areas for human spaceflight is infectious disease, particularly involving environmental microorganisms already found on the International Space Station (ISS). In particular, bacteria belonging to the Burkholderia cepacia complex (Bcc) which can cause human disease in those who are immunocompromised, have been identified in the ISS water supply. This present study characterized the effect of spaceflight analog culture conditions on Bcc to certain physiological stresses (acid and thermal as well as intracellular survival in U927 human macrophage cells). The NASA-designed Rotating Wall Vessel (RWV) bioreactor was used as the spaceflight analogue culture system in these studies to grow Bcc bacterial cells under Low Shear Modeled Microgravity (LSMMG) conditions. Results show that LSMMG culture increased the resistance of Bcc to both acid and thermal stressors, but did not alter phagocytic uptake in 2-D monolayers of human monocytes.
ContributorsVu, Christian-Alexander (Author) / Nickerson, Cheryl (Thesis director) / Barrila, Jennifer (Committee member) / Ott, Mark (Committee member) / Barrett, The Honors College (Contributor) / Harrington Bioengineering Program (Contributor)
Created2023-05
Description
Few-layer black phosphorous (FLBP) is one of the most important two-dimensional (2D) materials due to its strongly layer-dependent quantized bandstructure, which leads to wavelength-tunable optical and electrical properties. This thesis focuses on the preparation of stable, high-quality FLBP, the characterization of its optical properties, and device applications.Part I presents an approach to preparing high-quality, stable FLBP samples by combining O2 plasma etching, boron nitride (BN) sandwiching, and subsequent rapid thermal annealing (RTA). Such a strategy has successfully produced FLBP samples with a record-long lifetime, with 80% of photoluminescence (PL) intensity remaining after 7 months. The improved material quality of FLBP allows the establishment of a more definitive relationship between the layer number and PL energies.
Part II presents the study of oxygen incorporation in FLBP. The natural oxidation formed in the air environment is dominated by the formation of interstitial oxygen and dangling oxygen. By the real-time PL and Raman spectroscopy, it is found that continuous laser excitation breaks the bonds of interstitial oxygen, and free oxygen atoms can diffuse around or form dangling oxygen under low heat. RTA at 450 °C can turn the interstitial oxygen into dangling oxygen more thoroughly. Such oxygen-containing samples show similar optical properties to the pristine BP samples. The bandgap of such FLBP samples increases with the concentration of the incorporated oxygen.
Part III deals with the investigation of emission natures of the prepared samples. The power- and temperature-dependent measurements demonstrate that PL emissions are dominated by excitons and trions, with a combined percentage larger than 80% at room temperature. Such measurements allow the determination of trion and exciton binding energies of 2-, 3-, and 4-layer BP, with values around 33, 23, 15 meV for trions and 297, 276, 179 meV for excitons at 77K, respectively.
Part IV presents the initial exploration of device applications of such FLBP samples. The coupling between photonic crystal cavity (PCC) modes and FLBP's emission is realized by integrating the prepared sandwich structure onto 2D PCC. Electroluminescence has also been achieved by integrating such materials onto interdigital electrodes driven by alternating electric fields.
ContributorsLi, Dongying (Author) / Ning, Cun-Zheng (Thesis advisor) / Vasileska, Dragica (Committee member) / Lai, Ying-Cheng (Committee member) / Yu, Hongbin (Committee member) / Arizona State University (Publisher)
Created2022
Description
Cities in the Global South face rapid urbanization challenges and often suffer an acute lack of infrastructure and governance capacities. Smart Cities Mission, in India, launched in 2015, aims to offer a novel approach for urban renewal of 100 cities following an area‐based development approach, where the use of ICT and digital technologies is particularly emphasized. This article presents a critical review of the design and implementation framework of this new urban renewal program across selected case‐study cities. The article examines the claims of the so‐called “smart cities” against actual urban transformation on‐ground and evaluates how “inclusive” and “sustainable” these developments are. We quantify the scale and coverage of the smart city urban renewal projects in the cities to highlight who the program includes and excludes. The article also presents a statistical analysis of the sectoral focus and budgetary allocations of the projects under the Smart Cities Mission to find an inherent bias in these smart city initiatives in terms of which types of development they promote and the ones it ignores. The findings indicate that a predominant emphasis on digital urban renewal of selected precincts and enclaves, branded as “smart cities,” leads to deepening social polarization and gentrification. The article offers crucial urban planning lessons for designing ICT‐driven urban renewal projects, while addressing critical questions around inclusion and sustainability in smart city ventures.`
ContributorsPraharaj, Sarbeswar (Author)
Created2021-05-07