Matching Items (5)
Filtering by
- Genre: Academic theses
- Resource Type: Text
- Status: Published
Description
Traditional Reinforcement Learning (RL) assumes to learn policies with respect to reward available from the environment but sometimes learning in a complex domain requires wisdom which comes from a wide range of experience. In behavior based robotics, it is observed that a complex behavior can be described by a combination of simpler behaviors. It is tempting to apply similar idea such that simpler behaviors can be combined in a meaningful way to tailor the complex combination. Such an approach would enable faster learning and modular design of behaviors. Complex behaviors can be combined with other behaviors to create even more advanced behaviors resulting in a rich set of possibilities. Similar to RL, combined behavior can keep evolving by interacting with the environment. The requirement of this method is to specify a reasonable set of simple behaviors. In this research, I present an algorithm that aims at combining behavior such that the resulting behavior has characteristics of each individual behavior. This approach has been inspired by behavior based robotics, such as the subsumption architecture and motor schema-based design. The combination algorithm outputs n weights to combine behaviors linearly. The weights are state dependent and change dynamically at every step in an episode. This idea is tested on discrete and continuous environments like OpenAI’s “Lunar Lander” and “Biped Walker”. Results are compared with related domains like Multi-objective RL, Hierarchical RL, Transfer learning, and basic RL. It is observed that the combination of behaviors is a novel way of learning which helps the agent achieve required characteristics. A combination is learned for a given state and so the agent is able to learn faster in an efficient manner compared to other similar approaches. Agent beautifully demonstrates characteristics of multiple behaviors which helps the agent to learn and adapt to the environment. Future directions are also suggested as possible extensions to this research.
ContributorsVora, Kevin Jatin (Author) / Zhang, Yu (Thesis advisor) / Yang, Yezhou (Committee member) / Praharaj, Sarbeswar (Committee member) / Arizona State University (Publisher)
Created2021
Description
Understanding why animals form social groups is a fundamental aim of sociobiology. To date, the field has been dominated by studies of kin groups, which have emphasized indirect fitness benefits as key drivers of grouping among relatives. Nevertheless, many animal groups are comprised of unrelated individuals. These cases provide unique opportunities to illuminate drivers of social evolution beyond indirect fitness, especially ecological factors. This dissertation combines behavioral, physiological, and ecological approaches to explore the conditions that favor group formation among non-kin, using as a model the facultatively social carpenter bee, Xylocopa sonorina. Using behavioral and genetic techniques, I found that nestmates in this species are often unrelated, and that non-kin groups form following extensive inter-nest migration.Group living may arise as a strategy to mitigate constraints on available breeding space. To test the hypothesis that nest construction is prohibitively costly for carpenter bees, I measured metabolic rates of excavating bees and used imaging techniques to quantify nest volumes. From these measurements, I found that nest construction is highly energetically costly, and that bees who inherit nests through social queuing experience substantial energetic savings. These costs are exacerbated by limitations on the reuse of existing nests. Using repeated CT scans of nesting logs, I examined changes in nest architecture over time and found that repeatedly inherited tunnels become indefensible to intruders, and are subsequently abandoned. Together, these factors underlie intense competition over available breeding space. The imaging analysis of nesting logs additionally revealed strong seasonal effects on social strategy, with social nesting dominating during winter. To test the hypothesis that winter social nesting arises from intrinsic physiological advantages of grouping, I experimentally manipulated social strategy in overwintering bees. I found that social bees conserve heat and body mass better than solitary bees, suggesting fitness benefits to grouping in cold, resource-scarce conditions. Together, these results suggest that grouping in X. sonorina arises from dynamic strategies to maximize direct fitness in response to harsh and/or competitive conditions. These studies provide empirical insights into the ecological conditions that favor non-kin grouping, and emphasize the importance of ecology in shaping sociality at its evolutionary origins.
ContributorsOstwald, Madeleine (Author) / Fewell, Jennifer H (Thesis advisor) / Amdam, Gro (Committee member) / Harrison, Jon (Committee member) / Pratt, Stephen (Committee member) / Kapheim, Karen (Committee member) / Arizona State University (Publisher)
Created2022
Description
Speciation, or the process by which one population diverges into multiple populations that can no longer interbreed with each other, has brought about the incredible diversity of life. Mechanisms underlying this process can be more visible in the early stages of the speciation process. The mechanisms that restrict gene flow in highly mobile species with no absolute barriers to dispersal, especially marine species, are understudied. Similarly, human impacts are reshaping ecosystems globally, and we are only just beginning to understand the implications of these rapid changes on evolutionary processes. In this dissertation, I investigate patterns of speciation and evolution in two avian clades: a genus of widespread tropical seabirds (boobies, genus Sula), and two congeneric passerine species in an urban environment (cardinals, genus Cardinalis). First, I explore the prevalence of gene flow across land barriers within species and between sympatric species in boobies. I found widespread evidence of gene flow over all land barriers and between 3 species pairs. Next, I compared the effects of urbanization on the spatial distributions of two cardinal species, pyrrhuloxia (Cardinalis sinuatus) and northern cardinals (Cardinalis cardinalis), in Tucson, Arizona. I found that urbanization has different effects on the spatial distributions of two closely related species that share a similar environmental niche, and I identified environmental variables that might be driving this difference. Then I tested for effects of urbanization on color and size traits of these two cardinal species. In both of these species, urbanization has altered traits involved in signaling, heat tolerance, foraging, and maneuverability. Finally, I tested for evidence of selection on the urban populations of both cardinal species and found evidence of both parallel selection and introgression between the species, as well as selection on different genes in each species. The functions of the genes that experienced positive selection suggest that light at night, energetics, and air pollution may have acted as strong selective pressures on these species in the past. Overall, my dissertation emphasizes the role of introgression in the speciation process, identifies environmental stressors faced by wildlife in urban environments, and characterizes their evolutionary responses to those stressors.
ContributorsJackson, Daniel Nelson (Author) / McGraw, Kevin J (Thesis advisor) / Amdam, Gro (Committee member) / Sweazea, Karen (Committee member) / Taylor, Scott (Committee member) / Arizona State University (Publisher)
Created2023
Description
Neurotoxicology has historically focused on substances that directly damage nervous tissue. Behavioral assays that test sensory, cognitive, or motor function are used to identify neurotoxins. But, the outcomes of behavioral assays may also be influenced by the physiological status of non-neural organs. Therefore, toxin induced damage to non- neural organs may contribute to behavioral modifications. Heavy metals and metalloids are persistent environmental pollutants and induce neurological deficits in multiple organisms. However, in the honey bee, an important insect pollinator, little is known about the sublethal effects of heavy metal and metalloid toxicity though they are exposed to these toxins chronically in some environments. In this thesis I investigate the sublethal effects of copper, cadmium, lead, and selenium on honey bee behavior and identify potential mechanisms mediating the behavioral modifications. I explore the honey bees’ ability to detect these toxins, their sensory perception of sucrose following toxin exposure, and the effects of toxin ingestion on performance during learning and memory tasks. The effects depend on the specific metal. Honey bees detect and reject copper containing solutions, but readily consume those contaminated with cadmium and lead. And, exposure to lead may alter the sensory perception of sucrose. I also demonstrate that acute selenium exposure impairs learning and long-term memory formation or recall. Localizing selenium accumulation following chronic exposure reveals that damage to non-neural organs and peripheral sensory structures is more likely than direct neurotoxicity. Probable mechanisms include gut microbiome alterations, gut lining
damage, immune system activation, impaired protein function, or aberrant DNA methylation. In the case of DNA methylation, I demonstrate that inhibiting DNA methylation dynamics can impair long-term memory formation, while the nurse-to- forager transition is not altered. These experiments could serve as the bases for and reference groups of studies testing the effects of metal or metalloid toxicity on DNA methylation. Each potential mechanism provides an avenue for investigating how neural function is influenced by the physiological status of non-neural organs. And from an ecological perspective, my results highlight the need for environmental policy to consider sublethal effects in determining safe environmental toxin loads for honey bees and other insect pollinators.
damage, immune system activation, impaired protein function, or aberrant DNA methylation. In the case of DNA methylation, I demonstrate that inhibiting DNA methylation dynamics can impair long-term memory formation, while the nurse-to- forager transition is not altered. These experiments could serve as the bases for and reference groups of studies testing the effects of metal or metalloid toxicity on DNA methylation. Each potential mechanism provides an avenue for investigating how neural function is influenced by the physiological status of non-neural organs. And from an ecological perspective, my results highlight the need for environmental policy to consider sublethal effects in determining safe environmental toxin loads for honey bees and other insect pollinators.
ContributorsBurden, Christina Marie (Author) / Amdam, Gro (Thesis advisor) / Smith, Brian H. (Thesis advisor) / Gallitano-Mendel, Amelia (Committee member) / Harrison, Jon (Committee member) / Vu, Eric (Committee member) / Arizona State University (Publisher)
Created2016
Description
Urban areas across the Unites States are facing a housing affordability crisis. One approach some cities and states have taken is to reduce or eliminate single-family zoning. Single-family zoning prevents the construction of more-affordable apartments in vast swaths of the American urban landscape. This policy shift has already occurred in Minneapolis, Sacramento, and Oregon, and is under discussion in California, Massachusetts, and North Carolina, among others. Independent of any effects on housing affordability, changes to land use will have effects on transport. I evaluate these effects using a microsimulation framework. In order for land use policies to have an effect on transport, they need to first have an effect on land use, so I first build an economic model to simulate where development will occur given a loosening of single-family zoning. Transport outcomes will vary depending on which households live in which parts of the region, so I use an equilibrium sorting model to forecast how residents will re-sort across the region in response to the land use changes induced by new land-use policies. This model also jointly forecasts how many vehicles each household will choose to own. Finally, I apply an activity-based travel demand microsimulation model to forecast the changes in transport associated with the forecast changes from the previous models. I find that while there is opportunity for economically-feasible redevelopment of single-family homes into multifamily structures, the amount of redevelopment that will occur varies greatly depending on the exact expectations of developers about future market conditions. Redevelopment is focused in higher-income neighborhoods. The transport effects of the redevelopment are minimal. Average car ownership across the region does not change hardly at all, although residents of new housing units do have somewhat lower car ownership. Vehicles kilometers traveled, mode choice, and congestion change very little as well. This does not mean that upzoning does not affect transport in general, but that more nuanced proposals may be necessary to promote desirable transport outcomes. Alternatively, the results suggest that upzoning will not worsen transport outcomes, promising for those who support upzoning on affordability grounds.
ContributorsConway, Matthew Wigginton (Author) / Salon, Deborah (Thesis advisor) / Pfeiffer, Deirdre (Committee member) / Fotheringham, A Stewart (Committee member) / van Eggermond, Michael AB (Committee member) / Arizona State University (Publisher)
Created2021