ASU Scholarship Showcase

The concept of postural synergies of the human hand has been shown to potentially reduce complexity in the neuromuscular control of grasping. By merging this concept with soft robotics approaches, a multi degrees of freedom soft-synergy prosthetic hand [SoftHand-Pro (SHP)] was created. The mechanical innovation of the SHP enables adaptive and robust functional grasps with simple and intuitive myoelectric control from only two surface electromyogram (sEMG) channels. However, the current myoelectric controller has very limited capability for fine control of grasp forces. We addressed this challenge by designing a hybrid-gain myoelectric controller that switches control gains based on the sensorimotor state of the SHP. This controller was tested against a conventional single-gain (SG) controller, as well as against native hand in able-bodied subjects. We used the following tasks to evaluate the performance of grasp force control: (1) pick and place objects with different size, weight, and fragility levels using power or precision grasp and (2) squeezing objects with different stiffness. Sensory feedback of the grasp forces was provided to the user through a non-invasive, mechanotactile haptic feedback device mounted on the upper arm. We demonstrated that the novel hybrid controller enabled superior task completion speed and fine force control over SG controller in object pick-and-place tasks. We also found that the performance of the hybrid controller qualitatively agrees with the performance of native human hands.

Human physical interactions can be intrapersonal, e.g., manipulating an object bimanually, or interpersonal, e.g., transporting an object with another person. In both cases, one or two agents are required to coordinate their limbs to attain the task goal. We investigated the physical coordination of two hands during an object-balancing task performed either bimanually by one agent or jointly by two agents. The task consisted of a series of static (holding) and dynamic (moving) phases, initiated by auditory cues. We found that task performance of dyads was not affected by different pairings of dominant and non-dominant hands. However, the spatial configuration of the two agents (side-by-side vs. face-to-face) appears to play an important role, such that dyads performed better side-by-side than face-to-face. Furthermore, we demonstrated that only individuals with worse solo performance can benefit from interpersonal coordination through physical couplings, whereas the better individuals do not. The present work extends ongoing investigations on human-human physical interactions by providing new insights about factors that influence dyadic performance. Our findings could potentially impact several areas, including robotic-assisted therapies, sensorimotor learning and human performance augmentation.

Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank and open-minded assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas at the interface of neuromechanics, neuroscience, rehabilitation and robotics.

The human hand comprises complex sensorimotor functions that can be impaired by neurological diseases and traumatic injuries. Effective rehabilitation can bring the impaired hand back to a functional state because of the plasticity of the central nervous system to relearn and remodel the lost synapses in the brain. Current rehabilitation therapies focus on strengthening motor skills, such as grasping, employ multiple objects of varying stiffness so that affected persons can experience a wide range of strength training. These devices have limited range of stiffness due to the rigid mechanisms employed in their variable stiffness actuators. This paper presents a novel soft robotic haptic device for neuromuscular rehabilitation of the hand, which is designed to offer adjustable stiffness and can be utilized in both clinical and home settings. The device eliminates the need for multiple objects by employing a pneumatic soft structure made with highly compliant materials that act as the actuator of the haptic interface. It is made with interchangeable sleeves that can be customized to include materials of varying stiffness to increase the upper limit of the stiffness range. The device is fabricated using existing 3D printing technologies, and polymer molding and casting techniques, thus keeping the cost low and throughput high. The haptic interface is linked to either an open-loop system that allows for an increased pressure during usage or closed-loop system that provides pressure regulation in accordance to the stiffness the user specifies. Preliminary evaluation is performed to characterize the effective controllable region of variance in stiffness. It was found that the region of controllable stiffness was between points 3 and 7, where the stiffness appeared to plateau with each increase in pressure. The two control systems are tested to derive relationships between internal pressure, grasping force exertion on the surface, and displacement using multiple probing points on the haptic device. Additional quantitative evaluation is performed with study participants and juxtaposed to a qualitative analysis to ensure adequate perception in compliance variance. The qualitative evaluation showed that greater than 60% of the trials resulted in the correct perception of stiffness in the haptic device.

Myoelectric artificial limbs can significantly advance the state of the art in prosthetics, since they can be used to control mechatronic devices through muscular activity in a way that mimics how the subjects used to activate their muscles before limb loss. However, surveys indicate that dissatisfaction with the functionality of terminal devices underlies the widespread abandonment of prostheses. We believe that one key factor to improve acceptability of prosthetic devices is to attain human likeness of prosthesis movements, a goal which is being pursued by research on social and human–robot interactions. Therefore, to reduce early abandonment of terminal devices, we propose that controllers should be designed so as to ensure effective task accomplishment in a natural fashion. In this work, we have analyzed and compared the performance of three types of myoelectric controller algorithms based on surface electromyography to control an underactuated and multi-degrees of freedom prosthetic hand, the SoftHand Pro.

The goal of the present study was to identify the myoelectric algorithm that best mimics the native hand movements. As a preliminary step, we first quantified the repeatability of the SoftHand Pro finger movements and identified the electromyographic recording sites for able-bodied individuals with the highest signal-to-noise ratio from two pairs of muscles, i.e., flexor digitorum superficialis/extensor digitorum communis, and flexor carpi radialis/extensor carpi ulnaris. Able-bodied volunteers were then asked to execute reach-to-grasp movements, while electromyography signals were recorded from flexor digitorum superficialis/extensor digitorum communis as this was identified as the muscle pair characterized by high signal-to-noise ratio and intuitive control. Subsequently, we tested three myoelectric controllers that mapped electromyography signals to position of the SoftHand Pro. We found that a differential electromyography-to-position mapping ensured the highest coherence with hand movements. Our results represent a first step toward a more effective and intuitive control of myoelectric hand prostheses.

Introduction: Options currently available to individuals with upper limb loss range from prosthetic hands that can perform many movements, but require more cognitive effort to control, to simpler terminal devices with limited functional abilities. We attempted to address this issue by designing a myoelectric control system to modulate prosthetic hand posture and digit force distribution.

Methods: We recorded surface electromyographic (EMG) signals from five forearm muscles in eight able-bodied subjects while they modulated hand posture and the flexion force distribution of individual fingers. We used a support vector machine (SVM) and a random forest regression (RFR) to map EMG signal features to hand posture and individual digit forces, respectively. After training, subjects performed grasping tasks and hand gestures while a computer program computed and displayed online feedback of all digit forces, in which digits were flexed, and the magnitude of contact forces. We also used a commercially available prosthetic hand, the i-Limb (Touch Bionics), to provide a practical demonstration of the proposed approach’s ability to control hand posture and finger forces.

Results: Subjects could control hand pose and force distribution across the fingers during online testing. Decoding success rates ranged from 60% (index finger pointing) to 83–99% for 2-digit grasp and resting state, respectively. Subjects could also modulate finger force distribution.

Discussion: This work provides a proof of concept for the application of SVM and RFR for online control of hand posture and finger force distribution, respectively. Our approach has potential applications for enabling in-hand manipulation with a prosthetic hand.

Asteroids provide fundamental clues to the formation and evolution of planetesimals. Collisional models based on the depletion of the primordial main belt of asteroids predict 10–15 craters >400 km should have formed on Ceres, the largest object between Mars and Jupiter, over the last 4.55 Gyr. Likewise, an extrapolation from the asteroid Vesta would require at least 6–7 such basins. However, Ceres’ surface appears devoid of impact craters >∼280 km. Here, we show a significant depletion of cerean craters down to 100–150 km in diameter. The overall scarcity of recognizable large craters is incompatible with collisional models, even in the case of a late implantation of Ceres in the main belt, a possibility raised by the presence of ammoniated phyllosilicates. Our results indicate that a significant population of large craters has been obliterated, implying that long-wavelength topography viscously relaxed or that Ceres experienced protracted widespread resurfacing.

How the human brain controls hand movements to carry out different tasks is still debated. The concept of synergy has been proposed to indicate functional modules that may simplify the control of hand postures by simultaneously recruiting sets of muscles and joints. However, whether and to what extent synergic hand postures are encoded as such at a cortical level remains unknown. Here, we combined kinematic, electromyography, and brain activity measures obtained by functional magnetic resonance imaging while subjects performed a variety of movements towards virtual objects. Hand postural information, encoded through kinematic synergies, were represented in cortical areas devoted to hand motor control and successfully discriminated individual grasping movements, significantly outperforming alternative somatotopic or muscle-based models. Importantly, hand postural synergies were predicted by neural activation patterns within primary motor cortex. These findings support a novel cortical organization for hand movement control and open potential applications for brain-computer interfaces and neuroprostheses.

Studies on anticipatory planning of object manipulation showed initial task failure (i.e., object roll) when visual object shape cues are incongruent with other visual cues, such as weight distribution/density (e.g., symmetrically shaped object with an asymmetrical density). This suggests that shape cues override density cues. However, these studies typically only measured forces, with digit placement constrained. Recent evidence suggests that when digit placement is unconstrained, subjects modulate digit forces and placement. Thus, unconstrained digit placement might be modulated on initial trials (since it is an explicit process), but not forces (since it is an implicit process). We tested whether shape and density cues would differentially influence anticipatory planning of digit placement and forces during initial trials of a two-digit object manipulation task. Furthermore, we tested whether shape cues would override density cues when cues are incongruent. Subjects grasped and lifted an object with the aim of preventing roll. In Experiment 1, the object was symmetrically shaped, but with asymmetrical density (incongruent cues). In Experiment 2, the object was asymmetrical in shape and density (congruent cues). In Experiment 3, the object was asymmetrically shaped, but with symmetrical density (incongruent cues). Results showed differential modulation of digit placement and forces (modulation of load force but not placement), but only when shape and density cues were congruent. When shape and density cues were incongruent, we found collinear digit placement and symmetrical force sharing. This suggests that congruent and incongruent shape and density cues differentially influence anticipatory planning of digit forces and placement. Furthermore, shape cues do not always override density cues. A continuum of visual cues, such as those alluding to shape and density, need to be integrated.

The human hand has so many degrees of freedom that it may seem impossible to control. A potential solution to this problem is “synergy control” which combines dimensionality reduction with great flexibility. With applicability to a wide range of tasks, this has become a very popular concept. In this review, we describe the evolution of the modern concept using studies of kinematic and force synergies in human hand control, neurophysiology of cortical and spinal neurons, and electromyographic (EMG) activity of hand muscles. We go beyond the often purely descriptive usage of synergy by reviewing the organization of the underlying neuronal circuitry in order to propose mechanistic explanations for various observed synergy phenomena. Finally, we propose a theoretical framework to reconcile important and still debated concepts such as the definitions of “fixed” vs. “flexible” synergies and mechanisms underlying the combination of synergies for hand control.