Matching Items (6)
Filtering by
- Genre: Masters Thesis
- Status: Published
Description
Traditional Reinforcement Learning (RL) assumes to learn policies with respect to reward available from the environment but sometimes learning in a complex domain requires wisdom which comes from a wide range of experience. In behavior based robotics, it is observed that a complex behavior can be described by a combination of simpler behaviors. It is tempting to apply similar idea such that simpler behaviors can be combined in a meaningful way to tailor the complex combination. Such an approach would enable faster learning and modular design of behaviors. Complex behaviors can be combined with other behaviors to create even more advanced behaviors resulting in a rich set of possibilities. Similar to RL, combined behavior can keep evolving by interacting with the environment. The requirement of this method is to specify a reasonable set of simple behaviors. In this research, I present an algorithm that aims at combining behavior such that the resulting behavior has characteristics of each individual behavior. This approach has been inspired by behavior based robotics, such as the subsumption architecture and motor schema-based design. The combination algorithm outputs n weights to combine behaviors linearly. The weights are state dependent and change dynamically at every step in an episode. This idea is tested on discrete and continuous environments like OpenAI’s “Lunar Lander” and “Biped Walker”. Results are compared with related domains like Multi-objective RL, Hierarchical RL, Transfer learning, and basic RL. It is observed that the combination of behaviors is a novel way of learning which helps the agent achieve required characteristics. A combination is learned for a given state and so the agent is able to learn faster in an efficient manner compared to other similar approaches. Agent beautifully demonstrates characteristics of multiple behaviors which helps the agent to learn and adapt to the environment. Future directions are also suggested as possible extensions to this research.
ContributorsVora, Kevin Jatin (Author) / Zhang, Yu (Thesis advisor) / Yang, Yezhou (Committee member) / Praharaj, Sarbeswar (Committee member) / Arizona State University (Publisher)
Created2021
Description
Olfactory perception is a complex and multifaceted process that involves the detection of volatile organic compounds by olfactory receptor neurons in the nasal neuroepithelium. Different odorants can elicit different perceived intensities at the same concentration, while direct intensity ratings are vulnerable to framing effects and inconsistent scale usage. Odor perception is genetically determined, with each individual having a unique olfaction "footprint" and sensitivity levels. Genetic factors, age, gender, race, and environmental factors influence olfactory acuity. The olfactory system's complexity makes it challenging to create a standardized comparison system for olfactory perception tests. The COVID-19 pandemic has underscored the importance of olfactory dysfunction, particularly the loss of smell and taste as common symptoms. Research has demonstrated the widespread occurrence of olfactory impairment in various populations, often stemming from post-viral origins, which is the leading cause of permanent smell loss. Utilizing quantitative ranking on a qualitative scale enhances the precision and accuracy when evaluating and drawing conclusions about odor perception and how to mitigate problems caused by external factors. Pairwise comparisons enhance the accuracy and consistency of results and provide a more intuitive way of comparing items. Such ranking techniques can lead to early detection of olfactory disorders and improved diagnostic tools. The COVID-19 pandemic has shed light on the significance of olfactory dysfunction, emphasizing the need for further research and standardized testing methods in olfactory perception.
ContributorsDarden, Jaelyn (Author) / Smith, Brian (Thesis advisor) / Gerkin, Richard (Thesis advisor) / Spackman, Christy (Committee member) / Arizona State University (Publisher)
Created2023
Description
Traumatic brain injury (TBI) most frequently occurs in pediatric patients and remains a leading cause of childhood death and disability. Mild TBI (mTBI) accounts for 70-90% of all TBI cases, yet its neuropathophysiology is still poorly understood. While a single mTBI injury can lead to persistent deficits, repeat injuries increase the severity and duration of both acute symptoms and long term deficits. In this study, to model pediatric repetitive mTBI (rmTBI) we subjected unrestrained juvenile animals (post-natal day 20) to repeat weight drop impact. Animals were anesthetized and subjected to sham or rmTBI once per day for 5 days. At 14 days post injury (PID), magnetic resonance imaging (MRI) revealed that rmTBI animals displayed marked cortical atrophy and ventriculomegaly. Specifically, the thickness of the cortex was reduced up to 46% beneath and the ventricles increased up to 970% beneath the impact zone. Immunostaining with the neuron specific marker NeuN revealed an overall loss of neurons within the motor cortex but no change in neuronal density. Examination of intrinsic and synaptic properties of layer II/III pyramidal neurons revealed no significant difference between sham and rmTBI animals at rest or under convulsant challenge with the potassium channel blocker, 4-Aminophyridine. Overall, our findings indicate that the neuropathological changes reported after pediatric rmTBI can be effectively modeled by repeat weight drop in juvenile animals. Developing a better understanding of how rmTBI alters the pediatric brain may help improve patient care and direct "return to game" decision making in adolescents.
ContributorsGoddeyne, Corey (Author) / Anderson, Trent (Thesis advisor) / Smith, Brian (Committee member) / Kleim, Jeffrey (Committee member) / Arizona State University (Publisher)
Created2014
Description
The goal of the present study was to investigate whether a rest period following the end of chronic stress would impact fear extinction. Past research has indicated that chronic stress leads to impairments in the learning and recall of fear conditioning extinction. Moreover, the effects of chronic stress can return to levels similar to controls when a post-stress “rest” period (i.e., undisturbed except for normal husbandry) is given prior to testing. Male rats underwent chronic restraint stress for 6hr/day/21days (STR-IMM). Some rats, underwent a post-stress rest period for 6- or 3-weeks after the end of stress (STR-R6, STR-R3). Control (CON) rats were unrestrained for the duration of the experiment. In Experiment 1, following the stress or rest manipulation, all rats were acclimated to conditioning and extinction contexts, fear conditioned with 3 tone-foot shock pairings, and then had two days of extinction training. All groups froze similarly to the tone across all training sessions. However, STR-R6/R3 froze less in the non-shock context than did STR-IMM or CON. During extinction training, STR-IMM showed high levels of freezing to the non-shock context, leading to a concern they may be generalizing across contexts. Consequently, a follow-up experiment tested for context generalization. In Experiment 2, STR-IMM rats underwent a generalization test in an environment that was either different or the same as the conditioning environment, using STR-R6 as a comparison. STR-IMM and STR-R6 showed similar relative levels of freezing to tone and context, regardless of their conditioning environment to reveal that STR-IMM did not generalize and instead, maybe expressing hypervigilance. Thus, the present study demonstrated the novel finding that a rest period from chronic stress can lead to reduced fear responsiveness in a non-shock environment.
ContributorsJudd, Jessica M (Author) / Conrad, Cheryl D. (Thesis advisor) / Sanabria, Federico (Committee member) / Smith, Brian (Committee member) / Arizona State University (Publisher)
Created2018
Description
Desert ecosystems of the southwest United States are characterized by hot and arid climates, but hibernating bats can be found at high altitudes. The emerging fungal infection, white-nose syndrome, causes mortality in hibernating bat populations across eastern North America and the pathogen is increasingly observed in western regions. However, little is known about the ecology of hibernating bats in the southwest, which can help predict how these populations may respond to the fungus. My study investigated hibernating bats during two winters (2018-2019/2019-2020) at three caves in northern Arizona to: (1) describe diversity and abundance of hibernating bats using visual internal surveys and photographic documentation, (2) determine the duration of hibernation by recording bat echolocation call sequences outside caves and recording bat activity in caves using visual inspection, and (3) describe environmental conditions where hibernating bats are roosting. Adjacent to bats, I collected temperature and relative humidity, which I converted into absolute humidity. I documented hibernation status (i.e. active vs. not active) and roosting body position (i.e. open, partially hidden, and hidden). Between September 2018 and April 2019, 246 bat observations were recorded across the three caves. The majority of bats were identified as Myotis spp. (45.9\%, n=113), followed by Corynorhinus townsendii (45.5\%, n=112), Parastrellus hesperus (4.8\%, n=12), Eptesicus fuscus (3.6\%, n=9). Between September 2019 and April 2020, I documented a total of 361 bat observations across the three caves. C. townsendii was most prevalent (52.9\%, n=191), followed by the category P. hesperus/Myotis spp. (25.7\%, n=93), Myotis spp. (12.4\%, n=45), P. Hesperus (4.4\%, n=16), E. fuscus (3.6\%, n=13) and Unknown (0.8\%, n=3). Average conditions adjacent to bats were, temperature=12.5ºC, relative humidity=53\%, and absolute humidity=4.9 g/kg. Hibernating bats were never observed in large clusters and the maximum hibernating population size was 24, suggesting low risk for pathogen transmission among bats. Hibernation lasted approximately 120 days, with minimal activity documented inside and outside caves. Hibernating bats in northern Arizona may be at low risk for white-nose syndrome based on population size, hibernation length, roosting behavior, and absolute humidity, but other variables (e.g. temperature) indicate the potential for white-nose syndrome impacts on these populations.
ContributorsMaldonado Perez, Nubia Erandi (Author) / Moore, Marianne S (Thesis advisor) / DeNardo, Dale (Committee member) / Deviche, Pierre (Committee member) / Smith, Brian (Committee member) / Arizona State University (Publisher)
Created2020
Description
Obesity impairs skeletal muscle maintenance and regeneration, a condition that can progressively lead to muscle loss, but the mechanisms behind it are unknown. Muscle is primarily composed of multinucleated cells called myotubes which are derived by the fusion of mononucleated myocytes. A key mediator in this process is the cellular fusion protein syncytin-1. This led to the hypothesis that syncytin-1 could be decreased in the muscle of obese/insulin resistant individuals. In contrast, it was found that obese/insulin resistant subjects had higher syncytin-1 expression in the muscle compared to that of the lean subjects. Across the subjects, syncytin-1 correlated significantly with body mass index, percent body fat, blood glucose and HbA1c levels, insulin sensitivity and muscle protein fractional synthesis rate. The concentrations of specific plasma fatty acids, such as the saturated fatty acid (palmitate) and monounsaturated fatty acid (oleate) are known to be altered in obese/insulin resistant humans, and also to influence the protein synthesis in muscle. Therefore, it was evaluated that the effects of palmitate and oleate on syncytin-1 expression, as well as 4E-BP1 phosphorylation, a key mechanism regulating muscle protein synthesis in insulin stimulated C2C12 myotubes. The results showed that treatment with 20 nM insulin, 300 µM oleate, 300 µM oleate +20 nM insulin and 300 µM palmitate + 300 µM oleate elevated 4E-BP1 phosphorylation. At the same time, 20 nM insulin, 300 µM palmitate, 300 µM oleate + 20 nM insulin and 300 µM palmitate + 300 µM oleate elevated syncytin-1 expression. Insulin stimulated muscle syncytin-1 expression and 4E-BP1 phosphorylation, and this effect was comparable to that observed in the presence of oleate alone. However, the presence of palmitate + oleate diminished the stimulatory effect of insulin on muscle syncytin-1 expression and 4E-BP1 phosphorylation. These findings indicate oleate but not palmitate increased total 4E-BP1 phosphorylation regardless of insulin and the presence of palmitate in insulin mediated C2C12 cells. The presence of palmitate inhibited the upregulation of total 4EB-P1 phosphorylation. Palmitate but not oleate increased syncytin-1 expression in insulin mediated C2C12 myotubes. It is possible that chronic hyperinsulinemia in obesity and/or elevated levels of fatty acids such as palmitate in plasma could have contributed to syncytin-1 overexpression and decreased muscle protein fractional synthesis rate in obese/insulin resistant human muscle.
ContributorsRavichandran, Jayachandran (Author) / Katsanos, Christos (Thesis advisor) / Coletta, Dawn (Committee member) / Dickinson, Jared (Committee member) / Arizona State University (Publisher)
Created2017