Matching Items (7)
Filtering by
- All Subjects: robotics
- Genre: Doctoral Dissertation
- Creators: Santello, Marco
- Status: Published
Description
The development of advanced, anthropomorphic artificial hands aims to provide upper extremity amputees with improved functionality for activities of daily living. However, many state-of-the-art hands have a large number of degrees of freedom that can be challenging to control in an intuitive manner. Automated grip responses could be built into artificial hands in order to enhance grasp stability and reduce the cognitive burden on the user. To this end, three studies were conducted to understand how human hands respond, passively and actively, to unexpected perturbations of a grasped object along and about different axes relative to the hand. The first study investigated the effect of magnitude, direction, and axis of rotation on precision grip responses to unexpected rotational perturbations of a grasped object. A robust "catch-up response" (a rapid, pulse-like increase in grip force rate previously reported only for translational perturbations) was observed whose strength scaled with the axis of rotation. Using two haptic robots, we then investigated the effects of grip surface friction, axis, and direction of perturbation on precision grip responses for unexpected translational and rotational perturbations for three different hand-centric axes. A robust catch-up response was observed for all axes and directions for both translational and rotational perturbations. Grip surface friction had no effect on the stereotypical catch-up response. Finally, we characterized the passive properties of the precision grip-object system via robot-imposed impulse perturbations. The hand-centric axis associated with the greatest translational stiffness was different than that for rotational stiffness. This work expands our understanding of the passive and active features of precision grip, a hallmark of human dexterous manipulation. Biological insights such as these could be used to enhance the functionality of artificial hands and the quality of life for upper extremity amputees.
ContributorsDe Gregorio, Michael (Author) / Santos, Veronica J. (Thesis advisor) / Artemiadis, Panagiotis K. (Committee member) / Santello, Marco (Committee member) / Sugar, Thomas (Committee member) / Helms Tillery, Stephen I. (Committee member) / Arizona State University (Publisher)
Created2013
Description
Myoelectric control is lled with potential to signicantly change human-robot interaction.
Humans desire compliant robots to safely interact in dynamic environments
associated with daily activities. As surface electromyography non-invasively measures
limb motion intent and correlates with joint stiness during co-contractions,
it has been identied as a candidate for naturally controlling such robots. However,
state-of-the-art myoelectric interfaces have struggled to achieve both enhanced
functionality and long-term reliability. As demands in myoelectric interfaces trend
toward simultaneous and proportional control of compliant robots, robust processing
of multi-muscle coordinations, or synergies, plays a larger role in the success of the
control scheme. This dissertation presents a framework enhancing the utility of myoelectric
interfaces by exploiting motor skill learning and
exible muscle synergies for
reliable long-term simultaneous and proportional control of multifunctional compliant
robots. The interface is learned as a new motor skill specic to the controller,
providing long-term performance enhancements without requiring any retraining or
recalibration of the system. Moreover, the framework oers control of both motion
and stiness simultaneously for intuitive and compliant human-robot interaction. The
framework is validated through a series of experiments characterizing motor learning
properties and demonstrating control capabilities not seen previously in the literature.
The results validate the approach as a viable option to remove the trade-o
between functionality and reliability that have hindered state-of-the-art myoelectric
interfaces. Thus, this research contributes to the expansion and enhancement of myoelectric
controlled applications beyond commonly perceived anthropomorphic and
\intuitive control" constraints and into more advanced robotic systems designed for
everyday tasks.
Humans desire compliant robots to safely interact in dynamic environments
associated with daily activities. As surface electromyography non-invasively measures
limb motion intent and correlates with joint stiness during co-contractions,
it has been identied as a candidate for naturally controlling such robots. However,
state-of-the-art myoelectric interfaces have struggled to achieve both enhanced
functionality and long-term reliability. As demands in myoelectric interfaces trend
toward simultaneous and proportional control of compliant robots, robust processing
of multi-muscle coordinations, or synergies, plays a larger role in the success of the
control scheme. This dissertation presents a framework enhancing the utility of myoelectric
interfaces by exploiting motor skill learning and
exible muscle synergies for
reliable long-term simultaneous and proportional control of multifunctional compliant
robots. The interface is learned as a new motor skill specic to the controller,
providing long-term performance enhancements without requiring any retraining or
recalibration of the system. Moreover, the framework oers control of both motion
and stiness simultaneously for intuitive and compliant human-robot interaction. The
framework is validated through a series of experiments characterizing motor learning
properties and demonstrating control capabilities not seen previously in the literature.
The results validate the approach as a viable option to remove the trade-o
between functionality and reliability that have hindered state-of-the-art myoelectric
interfaces. Thus, this research contributes to the expansion and enhancement of myoelectric
controlled applications beyond commonly perceived anthropomorphic and
\intuitive control" constraints and into more advanced robotic systems designed for
everyday tasks.
ContributorsIson, Mark (Author) / Artemiadis, Panagiotis (Thesis advisor) / Santello, Marco (Committee member) / Greger, Bradley (Committee member) / Berman, Spring (Committee member) / Sugar, Thomas (Committee member) / Fainekos, Georgios (Committee member) / Arizona State University (Publisher)
Created2015
Description
Proprioception is the sense of body position, movement, force, and effort. Loss of proprioception can affect planning and control of limb and body movements, negatively impacting activities of daily living and quality of life. Assessments employing planar robots have shown that proprioceptive sensitivity is directionally dependent within the horizontal plane however, few studies have looked at proprioceptive sensitivity in 3d space. In addition, the extent to which proprioceptive sensitivity is modifiable by factors such as exogenous neuromodulation is unclear. To investigate proprioceptive sensitivity in 3d we developed a novel experimental paradigm employing a 7-DoF robot arm, which enables reliable testing of arm proprioception along arbitrary paths in 3d space, including vertical motion which has previously been neglected. A participant’s right arm was coupled to a trough held by the robot that stabilized the wrist and forearm, allowing for changes in configuration only at the elbow and shoulder. Sensitivity to imposed displacements of the endpoint of the arm were evaluated using a “same/different” task, where participant’s hands were moved 1-4 cm from a previously visited reference position. A measure of sensitivity (d’) was compared across 6 movement directions and between 2 postures. For all directions, sensitivity increased monotonically as the distance from the reference location increased. Sensitivity was also shown to be anisotropic (directionally dependent) which has implications for our understanding of the planning and control of reaching movements in 3d space.
The effect of neuromodulation on proprioceptive sensitivity was assessed using transcutaneous electrical nerve stimulation (TENS), which has been shown to have beneficial effects on human cognitive and sensorimotor performance in other contexts. In this pilot study the effects of two frequencies (30hz and 300hz) and three electrode configurations were examined. No effect of electrode configuration was found, however sensitivity with 30hz stimulation was significantly lower than with 300hz stimulation (which was similar to sensitivity without stimulation). Although TENS was shown to modulate proprioceptive sensitivity, additional experiments are required to determine if TENS can produce enhancement rather than depression of sensitivity which would have positive implications for rehabilitation of proprioceptive deficits arising from stroke and other disorders.
The effect of neuromodulation on proprioceptive sensitivity was assessed using transcutaneous electrical nerve stimulation (TENS), which has been shown to have beneficial effects on human cognitive and sensorimotor performance in other contexts. In this pilot study the effects of two frequencies (30hz and 300hz) and three electrode configurations were examined. No effect of electrode configuration was found, however sensitivity with 30hz stimulation was significantly lower than with 300hz stimulation (which was similar to sensitivity without stimulation). Although TENS was shown to modulate proprioceptive sensitivity, additional experiments are required to determine if TENS can produce enhancement rather than depression of sensitivity which would have positive implications for rehabilitation of proprioceptive deficits arising from stroke and other disorders.
ContributorsKlein, Joshua (Author) / Buneo, Christopher (Thesis advisor) / Helms-Tillery, Stephen (Committee member) / Kleim, Jeffrey (Committee member) / Santello, Marco (Committee member) / Arizona State University (Publisher)
Created2018
Description
This dissertation focuses on reinforcement learning (RL) controller design aiming for real-life applications in continuous state and control problems. It involves three major research investigations in the aspect of design, analysis, implementation, and evaluation. The application case addresses automatically configuring robotic prosthesis impedance parameters. Major contributions of the dissertation include the following. 1) An “echo control” using the intact knee profile as target is designed to overcome the limitation of a designer prescribed robotic knee profile. 2) Collaborative multiagent reinforcement learning (cMARL) is proposed to directly take into account human influence in the robot control design. 3) A phased actor in actor-critic (PAAC) reinforcement learning method is developed to reduce learning variance in RL. The design of an “echo control” is based on a new formulation of direct heuristic dynamic programming (dHDP) for tracking control of a robotic knee prosthesis to mimic the intact knee profile. A systematic simulation of the proposed control is provided using a human-robot system simulation in OpenSim. The tracking controller is then tested on able-bodied and amputee subjects. This is the first real-time human testing of RL tracking control of a robotic knee to mirror the profile of an intact knee. The cMARL is a new solution framework for the human-prosthesis collaboration (HPC) problem. This is the first attempt at considering human influence on human-robot walking with the presence of a reinforcement learning controlled lower limb prosthesis. Results show that treating the human and robot as coupled and collaborating agents and using an estimated human adaptation in robot control design help improve human walking performance. The above studies have demonstrated great potential of RL control in solving continuous problems. To solve more complex real-life tasks with multiple control inputs and high dimensional state space, high variance, low data efficiency, slow learning or even instability are major roadblocks to be addressed. A novel PAAC method is proposed to improve learning performance in policy gradient RL by accounting for both Q value and TD error in actor updates. Systematical and comprehensive demonstrations show its effectiveness by qualitative analysis and quantitative evaluation in DeepMind Control Suite.
ContributorsWu, Ruofan (Author) / Si, Jennie (Thesis advisor) / Huang, He (Committee member) / Santello, Marco (Committee member) / Papandreou- Suppappola, Antonia (Committee member) / Arizona State University (Publisher)
Created2023
Description
Robotic lower limb prostheses provide new opportunities to help transfemoral amputees regain mobility. However, their application is impeded by that the impedance control parameters need to be tuned and optimized manually by prosthetists for each individual user in different task environments. Reinforcement learning (RL) is capable of automatically learning from interacting with the environment. It becomes a natural candidate to replace human prosthetists to customize the control parameters. However, neither traditional RL approaches nor the popular deep RL approaches are readily suitable for learning with limited number of samples and samples with large variations. This dissertation aims to explore new RL based adaptive solutions that are data-efficient for controlling robotic prostheses.
This dissertation begins by proposing a new flexible policy iteration (FPI) framework. To improve sample efficiency, FPI can utilize either on-policy or off-policy learning strategy, can learn from either online or offline data, and can even adopt exiting knowledge of an external critic. Approximate convergence to Bellman optimal solutions are guaranteed under mild conditions. Simulation studies validated that FPI was data efficient compared to several established RL methods. Furthermore, a simplified version of FPI was implemented to learn from offline data, and then the learned policy was successfully tested for tuning the control parameters online on a human subject.
Next, the dissertation discusses RL control with information transfer (RL-IT), or knowledge-guided RL (KG-RL), which is motivated to benefit from transferring knowledge acquired from one subject to another. To explore its feasibility, knowledge was extracted from data measurements of able-bodied (AB) subjects, and transferred to guide Q-learning control for an amputee in OpenSim simulations. This result again demonstrated that data and time efficiency were improved using previous knowledge.
While the present study is new and promising, there are still many open questions to be addressed in future research. To account for human adaption, the learning control objective function may be designed to incorporate human-prosthesis performance feedback such as symmetry, user comfort level and satisfaction, and user energy consumption. To make the RL based control parameter tuning practical in real life, it should be further developed and tested in different use environments, such as from level ground walking to stair ascending or descending, and from walking to running.
This dissertation begins by proposing a new flexible policy iteration (FPI) framework. To improve sample efficiency, FPI can utilize either on-policy or off-policy learning strategy, can learn from either online or offline data, and can even adopt exiting knowledge of an external critic. Approximate convergence to Bellman optimal solutions are guaranteed under mild conditions. Simulation studies validated that FPI was data efficient compared to several established RL methods. Furthermore, a simplified version of FPI was implemented to learn from offline data, and then the learned policy was successfully tested for tuning the control parameters online on a human subject.
Next, the dissertation discusses RL control with information transfer (RL-IT), or knowledge-guided RL (KG-RL), which is motivated to benefit from transferring knowledge acquired from one subject to another. To explore its feasibility, knowledge was extracted from data measurements of able-bodied (AB) subjects, and transferred to guide Q-learning control for an amputee in OpenSim simulations. This result again demonstrated that data and time efficiency were improved using previous knowledge.
While the present study is new and promising, there are still many open questions to be addressed in future research. To account for human adaption, the learning control objective function may be designed to incorporate human-prosthesis performance feedback such as symmetry, user comfort level and satisfaction, and user energy consumption. To make the RL based control parameter tuning practical in real life, it should be further developed and tested in different use environments, such as from level ground walking to stair ascending or descending, and from walking to running.
ContributorsGao, Xiang (Author) / Si, Jennie (Thesis advisor) / Huang, He Helen (Committee member) / Santello, Marco (Committee member) / Papandreou-Suppappola, Antonia (Committee member) / Arizona State University (Publisher)
Created2020
Description
The human ankle is a vital joint in the lower limb of the human body. As the point of interaction between the human neuromuscular system and the physical world, the ankle plays important role in lower extremity functions including postural balance and locomotion . Accurate characterization of ankle mechanics in lower extremity function is essential not just to advance the design and control of robots physically interacting with the human lower extremities but also in rehabilitation of humans suffering from neurodegenerative disorders.
In order to characterize the ankle mechanics and understand the underlying mechanisms that influence the neuromuscular properties of the ankle, a novel multi-axial robotic platform was developed. The robotic platform is capable of simulating various haptic environments and transiently perturbing the ankle to analyze the neuromechanics of the ankle, specifically the ankle impedance. Humans modulate ankle impedance to perform various tasks of the lower limb. The robotic platform is used to analyze the modulation of ankle impedance during postural balance and locomotion on various haptic environments. Further, various factors that influence modulation of ankle impedance were identified. Using the factors identified during environment dependent impedance modulation studies, the quantitative relationship between these factors, namely the muscle activation of major ankle muscles, the weight loading on ankle and the torque generation at the ankle was analyzed during postural balance and locomotion. A universal neuromuscular model of the ankle that quantitatively relates ankle stiffness, the major component of ankle impedance, to these factors was developed.
This neuromuscular model is then used as a basis to study the alterations caused in ankle behavior due to neurodegenerative disorders such as Multiple Sclerosis and Stroke. Pilot studies to validate the analysis of altered ankle behavior and demonstrate the effectiveness of robotic rehabilitation protocols in addressing the altered ankle behavior were performed. The pilot studies demonstrate that the altered ankle mechanics can be quantified in the affected populations and correlate with the observed adverse effects of the disability. Further, robotic rehabilitation protocols improve ankle control in affected populations as seen through functional improvements in postural balance and locomotion, validating the neuromuscular approach for rehabilitation.
In order to characterize the ankle mechanics and understand the underlying mechanisms that influence the neuromuscular properties of the ankle, a novel multi-axial robotic platform was developed. The robotic platform is capable of simulating various haptic environments and transiently perturbing the ankle to analyze the neuromechanics of the ankle, specifically the ankle impedance. Humans modulate ankle impedance to perform various tasks of the lower limb. The robotic platform is used to analyze the modulation of ankle impedance during postural balance and locomotion on various haptic environments. Further, various factors that influence modulation of ankle impedance were identified. Using the factors identified during environment dependent impedance modulation studies, the quantitative relationship between these factors, namely the muscle activation of major ankle muscles, the weight loading on ankle and the torque generation at the ankle was analyzed during postural balance and locomotion. A universal neuromuscular model of the ankle that quantitatively relates ankle stiffness, the major component of ankle impedance, to these factors was developed.
This neuromuscular model is then used as a basis to study the alterations caused in ankle behavior due to neurodegenerative disorders such as Multiple Sclerosis and Stroke. Pilot studies to validate the analysis of altered ankle behavior and demonstrate the effectiveness of robotic rehabilitation protocols in addressing the altered ankle behavior were performed. The pilot studies demonstrate that the altered ankle mechanics can be quantified in the affected populations and correlate with the observed adverse effects of the disability. Further, robotic rehabilitation protocols improve ankle control in affected populations as seen through functional improvements in postural balance and locomotion, validating the neuromuscular approach for rehabilitation.
ContributorsNalam, Varun (Author) / Lee, Hyunglae (Thesis advisor) / Artemiadis, Panagiotis (Committee member) / Santello, Marco (Committee member) / Sugar, Thomas (Committee member) / Lockhart, Thurmon (Committee member) / Arizona State University (Publisher)
Created2020
Description
The term Poly-Limb stems from the rare birth defect syndrome, called Polymelia. Although Poly-Limbs in nature have often been nonfunctional, humans have had the fascination of functional Poly-Limbs. Science fiction has led us to believe that having Poly-Limbs leads to augmented manipulation abilities and higher work efficiency. To bring this to life however, requires a synergistic combination between robot manipulation and wearable robotics. Where traditional robots feature precision and speed in constrained environments, the emerging field of soft robotics feature robots that are inherently compliant, lightweight, and cost effective. These features highlight the applicability of soft robotic systems to design personal, collaborative, and wearable systems such as the Soft Poly-Limb.
This dissertation presents the design and development of three actuator classes, made from various soft materials, such as elastomers and fabrics. These materials are initially studied and characterized, leading to actuators capable of various motion capabilities, like bending, twisting, extending, and contracting. These actuators are modeled and optimized, using computational models, in order to achieve the desired articulation and payload capabilities. Using these soft actuators, modular integrated designs are created for functional tasks that require larger degrees of freedom. This work focuses on the development, modeling, and evaluation of these soft robot prototypes.
In the first steps to understand whether humans have the capability of collaborating with a wearable Soft Poly-Limb, multiple versions of the Soft Poly-Limb are developed for assisting daily living tasks. The system is evaluated not only for performance, but also for safety, customizability, and modularity. Efforts were also made to monitor the position and orientation of the Soft Poly-Limbs components through embedded soft sensors and first steps were taken in developing self-powered compo-nents to bring the system out into the world. This work has pushed the boundaries of developing high powered-to-weight soft manipulators that can interact side-by-side with a human user and builds the foundation upon which researchers can investigate whether the brain can support additional limbs and whether these systems can truly allow users to augment their manipulation capabilities to improve their daily lives.
This dissertation presents the design and development of three actuator classes, made from various soft materials, such as elastomers and fabrics. These materials are initially studied and characterized, leading to actuators capable of various motion capabilities, like bending, twisting, extending, and contracting. These actuators are modeled and optimized, using computational models, in order to achieve the desired articulation and payload capabilities. Using these soft actuators, modular integrated designs are created for functional tasks that require larger degrees of freedom. This work focuses on the development, modeling, and evaluation of these soft robot prototypes.
In the first steps to understand whether humans have the capability of collaborating with a wearable Soft Poly-Limb, multiple versions of the Soft Poly-Limb are developed for assisting daily living tasks. The system is evaluated not only for performance, but also for safety, customizability, and modularity. Efforts were also made to monitor the position and orientation of the Soft Poly-Limbs components through embedded soft sensors and first steps were taken in developing self-powered compo-nents to bring the system out into the world. This work has pushed the boundaries of developing high powered-to-weight soft manipulators that can interact side-by-side with a human user and builds the foundation upon which researchers can investigate whether the brain can support additional limbs and whether these systems can truly allow users to augment their manipulation capabilities to improve their daily lives.
ContributorsNguyen, Pham Huy (Author) / Zhang, Wenlong (Thesis advisor) / Sugar, Thomas G. (Committee member) / Santello, Marco (Committee member) / Arizona State University (Publisher)
Created2020