Matching Items (127)
Filtering by
Description
Traditional Reinforcement Learning (RL) assumes to learn policies with respect to reward available from the environment but sometimes learning in a complex domain requires wisdom which comes from a wide range of experience. In behavior based robotics, it is observed that a complex behavior can be described by a combination of simpler behaviors. It is tempting to apply similar idea such that simpler behaviors can be combined in a meaningful way to tailor the complex combination. Such an approach would enable faster learning and modular design of behaviors. Complex behaviors can be combined with other behaviors to create even more advanced behaviors resulting in a rich set of possibilities. Similar to RL, combined behavior can keep evolving by interacting with the environment. The requirement of this method is to specify a reasonable set of simple behaviors. In this research, I present an algorithm that aims at combining behavior such that the resulting behavior has characteristics of each individual behavior. This approach has been inspired by behavior based robotics, such as the subsumption architecture and motor schema-based design. The combination algorithm outputs n weights to combine behaviors linearly. The weights are state dependent and change dynamically at every step in an episode. This idea is tested on discrete and continuous environments like OpenAI’s “Lunar Lander” and “Biped Walker”. Results are compared with related domains like Multi-objective RL, Hierarchical RL, Transfer learning, and basic RL. It is observed that the combination of behaviors is a novel way of learning which helps the agent achieve required characteristics. A combination is learned for a given state and so the agent is able to learn faster in an efficient manner compared to other similar approaches. Agent beautifully demonstrates characteristics of multiple behaviors which helps the agent to learn and adapt to the environment. Future directions are also suggested as possible extensions to this research.
ContributorsVora, Kevin Jatin (Author) / Zhang, Yu (Thesis advisor) / Yang, Yezhou (Committee member) / Praharaj, Sarbeswar (Committee member) / Arizona State University (Publisher)
Created2021
Description
The Hong Kong-born Canadian photographer and performance artist Tseng Kwong Chi mostly worked in the United States until the year he died in 1990. Upon arriving in New York in 1979, he started his career with a new name. By dropping his anglicized name Joseph and replacing it with his Chinese given name Kwong Chi, Tseng made a clear statement: this is my staged persona who refuses to assimilate to Western culture. This thesis deconstructs Tseng’s key works, including his party-crashing Met series, the decade-long East Meets West series, and the extended Expeditionary series. With his persona disguised by wearing a Mao suit and a pair of sunglasses, I argue that Tseng was a pioneer in the genre of Asian American performance photography and that his work foreshadowed the cultural jamming movement in his innovative use of détournement while it also critically comments on orientalism, cultural fetish, and Asian identity politics. Additionally, Tseng’s work served as a bridge, connecting art history with issues of Asian American identity. As a gay artist who worked mostly in the United States, his work was an early example of what Jachinson Chan has suggested as an alternative model of masculinity for Asian American men: that Asian American men can be free, independent, expressive, and willing to embrace femininity with their masculinity. As David Eng has argued, Tseng also bridged the fields of Asian American queer studies and diaspora studies. Moreover, Tseng carried the legacy of the first-generation Chinese American artists in the medium of photography and inspired the next generation of diasporic artists to explore Asian identity, and to contest the image of Mao and the power dynamics between East and West.
ContributorsWei, Xin (Author) / Mesch, Claudia (Thesis advisor) / Hoy, Meredith (Committee member) / Kuo, Karen (Committee member) / Arizona State University (Publisher)
Created2022
Description
Although previous studies have elucidated the role of position feedback in the regulation of movement, the specific contribution of Golgi tendon organs (GTO) in force feedback, especially in stabilizing voluntary limb movements, has remained theoretical due to limitations in experimental techniques. This study aims to establish force feedback regulation mediated by GTO afferent signals in two phases. The first phase of this study consisted of simulations using a neuromusculoskeletal model of the monoarticular elbow flexor (MEF) muscle group, assess the impact of force feedback in maintaining steady state interaction forces against variable environmental stiffness. Three models were trained to accurately reach an interaction force of 40N, 50N and 60N respectively, using a fixed stiffness level. Next, the environment stiffness was switched between untrained levels for open loop (OL) and closed loop (CL) variants of the same model. Results showed that compared to OL, CL showed decreased force deviations by 10.43%, 12.11% and 13.02% for each of the models. Most importantly, it is also observed that in the absence of force feedback, environment stiffness is found to have an effect on the interaction force. In the second phase, human subjects were engaged in experiments utilizing an instrumented elbow exoskeleton that applied loads to the MEF muscle group, closely mimicking the simulation conditions. The experiments consisted of reference, blind and catch trial types, and 3 stiffness levels. Subjects were first trained to reach for a predetermined target force. During catch trials, stiffness levels were randomized between reaches. Responses obtained from these experiments showed that subjects were able to regulate forces with no significant effects of trial type or stiffness level. Since experimental results align closely with that of closed loop model simulations, the presence of force feedback mechanisms mediated by GTO within the human neuromuscular system is established. This study not only unveils the critical involvement of GTO in force feedback but also emphasizes the importance of understanding these mechanisms for developing advanced neuroprosthetics and rehabilitation strategies, shedding light on the intricate interplay between sensory inputs and motor responses in human proprioception.
ContributorsAbishek, Kevin (Author) / Lee, Hyunglae (Thesis advisor) / Buneo, Christopher (Committee member) / Santello, Marco (Committee member) / Arizona State University (Publisher)
Created2023
Description
A current thrust in neurorehabilitation research involves exogenous neuromodulation of peripheral nerves to enhance neuroplasticity and maximize recovery of function. This dissertation presents the results of four experiments aimed at assessing the effects of trigeminal nerve stimulation (TNS) and occipital nerve stimulation (ONS) on motor learning, which was behaviorally characterized using an upper extremity visuomotor adaptation paradigm. In Aim 1a, the effects of offline TNS using clinically tested frequencies (120 and 60 Hz) were characterized. Sixty-three participants (22.75±4.6 y/o), performed a visuomotor rotation task and received TNS before encountering rotation of hand visual feedback. In Aim 1b, TNS at 3 kHz, which has been shown to be more tolerable at higher current intensities, was evaluated in 42 additional subjects (23.4±4.6 y/o). Results indicated that 3 kHz stimulation accelerated learning while 60 Hz stimulation slowed learning, suggesting a frequency-dependent effect on learning. In Aim 2, the effect of online TNS using 120 and 60 Hz were characterized to determine if this protocol would deliver better outcomes. Sixty-three participants (23.2±3.9 y/o) received either TNS or sham concurrently with perturbed visual feedback. Results showed no significant differences among groups. However, a cross-study comparison of results obtained with 60 Hz offline TNS showed a statistically significant improvement in learning rates with online stimulation relative to offline, suggesting a timing-dependent effect on learning. In Aim 3, TNS and ONS were compared using the best protocol from previous aims (offline 3 kHz). Additionally, concurrent stimulation of both nerves was explored to look for potential synergistic effects. Eighty-four participants (22.9±3.2 y/o) were assigned to one of four groups: TNS, ONS, TNS+ONS, and sham. Visual inspection of learning curves revealed that the ONS group demonstrated the fastest learning among groups. However, statistical analyses did not confirm this observation. In addition, the TNS+ONS group appeared to learn faster than the sham and TNS groups but slower than the ONS only group, suggesting no synergistic effects using this protocol, as initially hypothesized.
The results provide new information on the potential use of TNS and ONS in neurorehabilitation and performance enhancement in the motor domain.
ContributorsArias, Diego (Author) / Buneo, Christopher (Thesis advisor) / Schaefer, Sydney (Committee member) / Helms-Tillery, Stephen (Committee member) / Santello, Marco (Committee member) / Kleim, Jeffrey (Committee member) / Arizona State University (Publisher)
Created2023
Description
Multisensory integration is the process by which information from different sensory modalities is integrated by the nervous system. This process is important not only from a basic science perspective but also for translational reasons, e.g., for the development of closed-loop neural prosthetic systems. A mixed virtual reality platform was developed to study the neural mechanisms of multisensory integration for the upper limb during motor planning. The platform allows for selection of different arms and manipulation of the locations of physical and virtual target cues in the environment. The system was tested with two non-human primates (NHP) trained to reach to multiple virtual targets. Arm kinematic data as well as neural spiking data from primary motor (M1) and dorsal premotor cortex (PMd) were collected. The task involved manipulating visual information about initial arm position by rendering the virtual avatar arm in either its actual position (veridical (V) condition) or in a different shifted (e.g., small vs large shifts) position (perturbed (P) condition) prior to movement. Tactile feedback was modulated in blocks by placing or removing the physical start cue on the table (tactile (T), and no-tactile (NT) conditions, respectively). Behaviorally, errors in initial movement direction were larger when the physical start cue was absent. Slightly larger directional errors were found in the P condition compared to the V condition for some movement directions. Both effects were consistent with the idea that erroneous or reduced information about initial hand location led to movement direction-dependent reach planning errors. Neural correlates of these behavioral effects were probed using population decoding techniques. For small shifts in the visual position of the arm, no differences in decoding accuracy between the T and NT conditions were observed in either M1 or PMd. However, for larger visual shifts, decoding accuracy decreased in the NT condition, but only in PMd. Thus, activity in PMd, but not M1, may reflect the uncertainty in reach planning that results when sensory cues regarding initial hand position are erroneous or absent.
ContributorsPhataraphruk, Preyaporn Kris (Author) / Buneo, Christopher A (Thesis advisor) / Zhou, Yi (Committee member) / Helms Tillery, Steve (Committee member) / Greger, Bradley (Committee member) / Santello, Marco (Committee member) / Arizona State University (Publisher)
Created2023
Description
With an aging population, the number of later in life health related incidents like stroke stand to become more prevalent. Unfortunately, the majority those who are most at risk for debilitating heath episodes are either uninsured or under insured when it comes to long term physical/occupational therapy. As insurance companies lower coverage and/or raise prices of plans with sufficient coverage, it can be expected that the proportion of uninsured/under insured to fully insured people will rise. To address this, lower cost alternative methods of treatment must be developed so people can obtain the treated required for a sufficient recovery. The presented robotic glove employs low cost fabric soft pneumatic actuators which use a closed loop feedback controller based on readings from embedded soft sensors. This provides the device with proprioceptive abilities for the dynamic control of each independent actuator. Force and fatigue tests were performed to determine the viability of the actuator design. A Box and Block test along with a motion capture study was completed to study the performance of the device. This paper presents the design and classification of a soft robotic glove with a feedback controller as a at-home stroke rehabilitation device.
ContributorsAxman, Reed C (Author) / Zhang, Wenlong (Thesis advisor) / Santello, Marco (Committee member) / McDaniel, Troy (Committee member) / Arizona State University (Publisher)
Created2022
Description
Information processing in the brain is mediated by network interactions between anatomically distant (centimeters apart) regions of cortex and network action is fundamental to human behavior. Disruptive activity of these networks may allow a variety of diseases to develop. Degradation or loss of network function in the brain can affect many aspects of the human experience; motor disorder, language difficulties, memory loss, mood swings, and more. The cortico-basal ganglia loop is a system of networks in the brain between the cortex, basal ganglia, the thalamus, and back to the cortex. It is not one singular circuit, but rather a series of parallel circuits that are relevant towards motor output, motor planning, and motivation and reward. Studying the relationship between basal ganglia neurons and cortical local field potentials may lead to insights about neurodegenerative diseases and how these diseases change the cortico-basal ganglia circuit. Speech and language are uniquely human and require the coactivation of several brain regions. The various aspects of language are spread over the temporal lobe and parts of the occipital, parietal, and frontal lobe. However, the core network for speech production involves collaboration between phonologic retrieval (encoding ideas into syllabic representations) from Wernicke’s area, and phonemic encoding (translating syllables into motor articulations) from Broca’s area. Studying the coactivation of these brain regions during a repetitive speech production task may lead to a greater understanding of their electrophysiological functional connectivity. The primary purpose of the work presented in this document is to validate the use of subdural microelectrodes in electrophysiological functional connectivity research as these devices best match the spatial and temporal scales of brain activity. Neuron populations in the cortex are organized into functional units called cortical columns. These cortical columns operate on the sub-millisecond temporal and millimeter spatial scale. The study of brain networks, both in healthy and unwell individuals, may reveal new methodologies of treatment or management for disease and injury, as well as contribute to our scientific understanding of how the brain works.
ContributorsO'Neill, Kevin John (Author) / Greger, Bradley (Thesis advisor) / Santello, Marco (Committee member) / Helms Tillery, Stephen (Committee member) / Papandreou-Suppapola, Antonia (Committee member) / Kleim, Jeffery (Committee member) / Arizona State University (Publisher)
Created2021
Description
In recent years, brain signals have gained attention as a potential trait for biometric-based security systems and laboratory systems have been designed. A real-world brain-based security system requires to be usable, accurate, and robust. While there have been developments in these aspects, there are still challenges to be met. With regard to usability, users need to provide lengthy amount of data compared to other traits such as fingerprint and face to get authenticated. Furthermore, in the majority of works, medical sensors are used which are more accurate compared to commercial ones but have a tedious setup process and are not mobile. Performance wise, the current state-of-art can provide acceptable accuracy on a small pool of users data collected in few sessions close to each other but still falls behind on a large pool of subjects over a longer time period. Finally, a brain security system should be robust against presentation attacks to prevent adversaries from gaining access to the system.
This dissertation proposes E-BIAS (EEG-based Identification and Authentication System), a brain-mobile security system that makes contributions in three directions. First, it provides high performance on signals with shorter lengths collected by commercial sensors and processed with lightweight models to meet the computation/energy capacity of mobile devices. Second, to evaluate the system's robustness a novel presentation attack was designed which challenged the literature's presumption of intrinsic liveness property for brain signals. Third, to bridge the gap, I formulated and studied the brain liveness problem and proposed two solution approaches (model-aware & model agnostic) to ensure liveness and enhance robustness against presentation attacks. Under each of the two solution approaches, several methods were suggested and evaluated against both synthetic and manipulative classes of attacks (a total of 43 different attack vectors). Methods in both model-aware and model-agnostic approaches were successful in achieving an error rate of zero (0%). More importantly, such error rates were reached in face of unseen attacks which provides evidence of the generalization potentials of the proposed solution approaches and methods. I suggested an adversarial workflow to facilitate attack and defense cycles to allow for enhanced generalization capacity for domains in which the decision-making process is non-deterministic such as cyber-physical systems (e.g. biometric/medical monitoring, autonomous machines, etc.). I utilized this workflow for the brain liveness problem and was able to iteratively improve the performance of both the designed attacks and the proposed liveness detection methods.
ContributorsSohankar Esfahani, Mohammad Javad (Author) / Gupta, Sandeep K.S. (Thesis advisor) / Santello, Marco (Committee member) / Dasgupta, Partha (Committee member) / Banerjee, Ayan (Committee member) / Arizona State University (Publisher)
Created2021
Description
Cities in the Global South face rapid urbanization challenges and often suffer an acute lack of infrastructure and governance capacities. Smart Cities Mission, in India, launched in 2015, aims to offer a novel approach for urban renewal of 100 cities following an area‐based development approach, where the use of ICT and digital technologies is particularly emphasized. This article presents a critical review of the design and implementation framework of this new urban renewal program across selected case‐study cities. The article examines the claims of the so‐called “smart cities” against actual urban transformation on‐ground and evaluates how “inclusive” and “sustainable” these developments are. We quantify the scale and coverage of the smart city urban renewal projects in the cities to highlight who the program includes and excludes. The article also presents a statistical analysis of the sectoral focus and budgetary allocations of the projects under the Smart Cities Mission to find an inherent bias in these smart city initiatives in terms of which types of development they promote and the ones it ignores. The findings indicate that a predominant emphasis on digital urban renewal of selected precincts and enclaves, branded as “smart cities,” leads to deepening social polarization and gentrification. The article offers crucial urban planning lessons for designing ICT‐driven urban renewal projects, while addressing critical questions around inclusion and sustainability in smart city ventures.`
ContributorsPraharaj, Sarbeswar (Author)
Created2021-05-07
Description
Repetitive practice of functional movement patterns during motor rehabilitation are known to drive learning (or relearning) of novel motor skills, but the learning process is highly variable between individuals such that responsiveness to task-specific training is often patient-specific. A number of neuroimaging and neurophysiological methods have been proposed to better predict a patient’s responsiveness to a given type or dose of motor therapy. However, these methods are often time- and resource-intensive, and yield results that are not readily interpretable by clinicians. In contrast, standardized visuospatial tests may offer a more feasible solution. The work presented in this dissertation demonstrate that a clinical paper-and-pencil test of visuospatial function may improve predictive models of motor skill learning in older adults and individuals with stroke pathology. To further our understanding of the neuroanatomical correlates underlying this behavioral relationship, I collected diffusion-weighted magnetic resonance images from 19 nondemented older adults to determine if diffusion characteristics of white matter tracts explain shared variance in delayed visuospatial memory test scores and motor skill learning. Consistent with previous work, results indicated that the structural integrity of regions with the bilateral anterior thalamic radiations, corticospinal tracts, and superior longitudinal fasciculi are related to delayed visuospatial memory performance and one-week skill retention. Overall, results of this dissertation suggest that incorporating a clinical paper-and-pencil test of delayed visuospatial memory may prognose motor rehabilitation outcomes and support that personalized variables should be considered in standards of care. Moreover, regions within specific white matter tracts may underlie this behavioral relationship and future work should investigate these regions as potential targets for therapeutic intervention.
ContributorsLingo VanGilder, Jennapher (Author) / Schaefer, Sydney Y (Thesis advisor) / Santello, Marco (Committee member) / Buneo, Christopher (Committee member) / Rogalsky, Corianne (Committee member) / Duff, Kevin (Committee member) / Arizona State University (Publisher)
Created2021