ASU Scholarship Showcase

Myoelectric artificial limbs can significantly advance the state of the art in prosthetics, since they can be used to control mechatronic devices through muscular activity in a way that mimics how the subjects used to activate their muscles before limb loss. However, surveys indicate that dissatisfaction with the functionality of terminal devices underlies the widespread abandonment of prostheses. We believe that one key factor to improve acceptability of prosthetic devices is to attain human likeness of prosthesis movements, a goal which is being pursued by research on social and human–robot interactions. Therefore, to reduce early abandonment of terminal devices, we propose that controllers should be designed so as to ensure effective task accomplishment in a natural fashion. In this work, we have analyzed and compared the performance of three types of myoelectric controller algorithms based on surface electromyography to control an underactuated and multi-degrees of freedom prosthetic hand, the SoftHand Pro.

The goal of the present study was to identify the myoelectric algorithm that best mimics the native hand movements. As a preliminary step, we first quantified the repeatability of the SoftHand Pro finger movements and identified the electromyographic recording sites for able-bodied individuals with the highest signal-to-noise ratio from two pairs of muscles, i.e., flexor digitorum superficialis/extensor digitorum communis, and flexor carpi radialis/extensor carpi ulnaris. Able-bodied volunteers were then asked to execute reach-to-grasp movements, while electromyography signals were recorded from flexor digitorum superficialis/extensor digitorum communis as this was identified as the muscle pair characterized by high signal-to-noise ratio and intuitive control. Subsequently, we tested three myoelectric controllers that mapped electromyography signals to position of the SoftHand Pro. We found that a differential electromyography-to-position mapping ensured the highest coherence with hand movements. Our results represent a first step toward a more effective and intuitive control of myoelectric hand prostheses.

Introduction: Options currently available to individuals with upper limb loss range from prosthetic hands that can perform many movements, but require more cognitive effort to control, to simpler terminal devices with limited functional abilities. We attempted to address this issue by designing a myoelectric control system to modulate prosthetic hand posture and digit force distribution.

Methods: We recorded surface electromyographic (EMG) signals from five forearm muscles in eight able-bodied subjects while they modulated hand posture and the flexion force distribution of individual fingers. We used a support vector machine (SVM) and a random forest regression (RFR) to map EMG signal features to hand posture and individual digit forces, respectively. After training, subjects performed grasping tasks and hand gestures while a computer program computed and displayed online feedback of all digit forces, in which digits were flexed, and the magnitude of contact forces. We also used a commercially available prosthetic hand, the i-Limb (Touch Bionics), to provide a practical demonstration of the proposed approach’s ability to control hand posture and finger forces.

Results: Subjects could control hand pose and force distribution across the fingers during online testing. Decoding success rates ranged from 60% (index finger pointing) to 83–99% for 2-digit grasp and resting state, respectively. Subjects could also modulate finger force distribution.

Discussion: This work provides a proof of concept for the application of SVM and RFR for online control of hand posture and finger force distribution, respectively. Our approach has potential applications for enabling in-hand manipulation with a prosthetic hand.

The concept of postural synergies of the human hand has been shown to potentially reduce complexity in the neuromuscular control of grasping. By merging this concept with soft robotics approaches, a multi degrees of freedom soft-synergy prosthetic hand [SoftHand-Pro (SHP)] was created. The mechanical innovation of the SHP enables adaptive and robust functional grasps with simple and intuitive myoelectric control from only two surface electromyogram (sEMG) channels. However, the current myoelectric controller has very limited capability for fine control of grasp forces. We addressed this challenge by designing a hybrid-gain myoelectric controller that switches control gains based on the sensorimotor state of the SHP. This controller was tested against a conventional single-gain (SG) controller, as well as against native hand in able-bodied subjects. We used the following tasks to evaluate the performance of grasp force control: (1) pick and place objects with different size, weight, and fragility levels using power or precision grasp and (2) squeezing objects with different stiffness. Sensory feedback of the grasp forces was provided to the user through a non-invasive, mechanotactile haptic feedback device mounted on the upper arm. We demonstrated that the novel hybrid controller enabled superior task completion speed and fine force control over SG controller in object pick-and-place tasks. We also found that the performance of the hybrid controller qualitatively agrees with the performance of native human hands.

Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank and open-minded assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas at the interface of neuromechanics, neuroscience, rehabilitation and robotics.

Human physical interactions can be intrapersonal, e.g., manipulating an object bimanually, or interpersonal, e.g., transporting an object with another person. In both cases, one or two agents are required to coordinate their limbs to attain the task goal. We investigated the physical coordination of two hands during an object-balancing task performed either bimanually by one agent or jointly by two agents. The task consisted of a series of static (holding) and dynamic (moving) phases, initiated by auditory cues. We found that task performance of dyads was not affected by different pairings of dominant and non-dominant hands. However, the spatial configuration of the two agents (side-by-side vs. face-to-face) appears to play an important role, such that dyads performed better side-by-side than face-to-face. Furthermore, we demonstrated that only individuals with worse solo performance can benefit from interpersonal coordination through physical couplings, whereas the better individuals do not. The present work extends ongoing investigations on human-human physical interactions by providing new insights about factors that influence dyadic performance. Our findings could potentially impact several areas, including robotic-assisted therapies, sensorimotor learning and human performance augmentation.

The human hand comprises complex sensorimotor functions that can be impaired by neurological diseases and traumatic injuries. Effective rehabilitation can bring the impaired hand back to a functional state because of the plasticity of the central nervous system to relearn and remodel the lost synapses in the brain. Current rehabilitation therapies focus on strengthening motor skills, such as grasping, employ multiple objects of varying stiffness so that affected persons can experience a wide range of strength training. These devices have limited range of stiffness due to the rigid mechanisms employed in their variable stiffness actuators. This paper presents a novel soft robotic haptic device for neuromuscular rehabilitation of the hand, which is designed to offer adjustable stiffness and can be utilized in both clinical and home settings. The device eliminates the need for multiple objects by employing a pneumatic soft structure made with highly compliant materials that act as the actuator of the haptic interface. It is made with interchangeable sleeves that can be customized to include materials of varying stiffness to increase the upper limit of the stiffness range. The device is fabricated using existing 3D printing technologies, and polymer molding and casting techniques, thus keeping the cost low and throughput high. The haptic interface is linked to either an open-loop system that allows for an increased pressure during usage or closed-loop system that provides pressure regulation in accordance to the stiffness the user specifies. Preliminary evaluation is performed to characterize the effective controllable region of variance in stiffness. It was found that the region of controllable stiffness was between points 3 and 7, where the stiffness appeared to plateau with each increase in pressure. The two control systems are tested to derive relationships between internal pressure, grasping force exertion on the surface, and displacement using multiple probing points on the haptic device. Additional quantitative evaluation is performed with study participants and juxtaposed to a qualitative analysis to ensure adequate perception in compliance variance. The qualitative evaluation showed that greater than 60% of the trials resulted in the correct perception of stiffness in the haptic device.

Studies have shown that internal representations of manipulations of objects with asymmetric mass distributions that are generated within a specific orientation are not generalizable to novel orientations, i.e., subjects fail to prevent object roll on their first grasp-lift attempt of the object following 180° object rotation. This suggests that representations of these manipulations are specific to the reference frame in which they are formed. However, it is unknown whether that reference frame is specific to the hand, the body, or both, because rotating the object 180° modifies the relation between object and body as well as object and hand. An alternative, untested explanation for the above failure to generalize learned manipulations is that any rotation will disrupt grasp performance, regardless if the reference frame in which the manipulation was learned is maintained or modified. We examined the effect of rotations that (1) maintain and (2) modify relations between object and body, and object and hand, on the generalizability of learned two-digit manipulation of an object with an asymmetric mass distribution. Following rotations that maintained the relation between object and body and object and hand (e.g., rotating the object and subject 180°), subjects continued to use appropriate digit placement and load force distributions, thus generating sufficient compensatory moments to minimize object roll. In contrast, following rotations that modified the relation between (1) object and hand (e.g. rotating the hand around to the opposite object side), (2) object and body (e.g. rotating subject and hand 180°), or (3) both (e.g. rotating the subject 180°), subjects used the same, yet inappropriate digit placement and load force distribution, as those used prior to the rotation. Consequently, the compensatory moments were insufficient to prevent large object rolls. These findings suggest that representations of learned manipulation of objects with asymmetric mass distributions are specific to the body- and hand-reference frames in which they were learned.

Dexterous manipulation relies on modulation of digit forces as a function of digit placement. However, little is known about the sense of position of the vertical distance between finger pads relative to each other. We quantified subjects' ability to match perceived vertical distance between the thumb and index finger pads (d_y) of the right hand (“reference” hand) using the same or opposite hand (“test” hand) after a 10-second delay without vision of the hands. The reference hand digits were passively placed non-collinearly so that the thumb was higher or lower than the index finger (d_y = 30 or –30 mm, respectively) or collinearly (d_y = 0 mm). Subjects reproduced reference hand d_y by using a congruent or inverse test hand posture while exerting negligible digit forces onto a handle. We hypothesized that matching error (reference hand d_y minus test hand d_y) would be greater (a) for collinear than non-collinear d_ys, (b) when reference and test hand postures were not congruent, and (c) when subjects reproduced dy using the opposite hand. Our results confirmed our hypotheses. Under-estimation errors were produced when the postures of reference and test hand were not congruent, and when test hand was the opposite hand. These findings indicate that perceived finger pad distance is reproduced less accurately (1) with the opposite than the same hand and (2) when higher-level processing of the somatosensory feedback is required for non-congruent hand postures. We propose that erroneous sensing of finger pad distance, if not compensated for during contact and onset of manipulation, might lead to manipulation performance errors as digit forces have to be modulated to perceived digit placement.

We know very little about how soil-borne pollutants such as selenium (Se) can impact pollinators, even though Se has contaminated soils and plants in areas where insect pollination can be critical to the functioning of both agricultural and natural ecosystems. Se can be biotransferred throughout the food web, but few studies have examined its effects on the insects that feed on Se-accumulating plants, particularly pollinators. In laboratory bioassays, we used proboscis extension reflex (PER) and taste perception to determine if the presence of Se affected the gustatory response of honey bee (Apis mellifera L., Hymenoptera: Apidae) foragers. Antennae and proboscises were stimulated with both organic (selenomethionine) and inorganic (selenate) forms of Se that commonly occur in Se-accumulating plants. Methionine was also tested. Each compound was dissolved in 1 M sucrose at 5 concentrations, with sucrose alone as a control. Antennal stimulation with selenomethionine and methionine reduced PER at higher concentrations. Selenate did not reduce gustatory behaviors. Two hours after being fed the treatments, bees were tested for sucrose response threshold. Bees fed selenate responded less to sucrose stimulation. Mortality was higher in bees chronically dosed with selenate compared with a single dose. Selenomethionine did not increase mortality except at the highest concentration. Methionine did not significantly impact survival. Our study has shown that bees fed selenate were less responsive to sucrose, which may lead to a reduction in incoming floral resources needed to support coworkers and larvae in the field. If honey bees forage on nectar containing Se (particularly selenate), reductions in population numbers may occur due to direct toxicity. Given that honey bees are willing to consume food resources containing Se and may not avoid Se compounds in the plant tissues on which they are foraging, they may suffer similar adverse effects as seen in other insect guilds.

Octopamine plays an important role in many behaviors in invertebrates. It acts via binding to G protein coupled receptors located on the plasma membrane of responsive cells. Several distinct subtypes of octopamine receptors have been found in invertebrates, yet little is known about the expression pattern of these different receptor subtypes and how each subtype may contribute to different behaviors. One honey bee (Apis mellifera) octopamine receptor, AmOA1, was recently cloned and characterized. Here we continue to characterize the AmOA1 receptor by investigating its distribution in the honey bee brain. We used two independent antibodies produced against two distinct peptides in the carboxyl-terminus to study the distribution of the AmOA1 receptor in the honey bee brain. We found that both anti-AmOA1 antibodies revealed labeling of cell body clusters throughout the brain and within the following brain neuropils: the antennal lobes; the calyces, pedunculus, vertical (alpha, gamma) and medial (beta) lobes of the mushroom body; the optic lobes; the subesophageal ganglion; and the central complex. Double immunofluorescence staining using anti-GABA and anti-AmOA1 receptor antibodies revealed that a population of inhibitory GABAergic local interneurons in the antennal lobes express the AmOA1 receptor in the cell bodies, axons and their endings in the glomeruli. In the mushroom bodies, AmOA1 receptors are expressed in a subpopulation of inhibitory GABAergic feedback neurons that ends in the visual (outer half of basal ring and collar regions) and olfactory (lip and inner basal ring region) calyx neuropils, as well as in the collar and lip zones of the vertical and medial lobes. The data suggest that one effect of octopamine via AmOA1 in the antennal lobe and mushroom body is to modulate inhibitory neurons.