ASU Scholarship Showcase

How the human brain controls hand movements to carry out different tasks is still debated. The concept of synergy has been proposed to indicate functional modules that may simplify the control of hand postures by simultaneously recruiting sets of muscles and joints. However, whether and to what extent synergic hand postures are encoded as such at a cortical level remains unknown. Here, we combined kinematic, electromyography, and brain activity measures obtained by functional magnetic resonance imaging while subjects performed a variety of movements towards virtual objects. Hand postural information, encoded through kinematic synergies, were represented in cortical areas devoted to hand motor control and successfully discriminated individual grasping movements, significantly outperforming alternative somatotopic or muscle-based models. Importantly, hand postural synergies were predicted by neural activation patterns within primary motor cortex. These findings support a novel cortical organization for hand movement control and open potential applications for brain-computer interfaces and neuroprostheses.

Humans are able to modulate digit forces as a function of position despite changes in digit placement that might occur from trial to trial or when changing grip type for object manipulation. Although this phenomenon is likely to rely on sensing the position of the digits relative to each other and the object, the underlying mechanisms remain unclear. To address this question, we asked subjects (n = 30) to match perceived vertical distance between the center of pressure (CoP) of the thumb and index finger pads (d_y) of the right hand (“reference” hand) using the same hand (“test” hand). The digits of reference hand were passively placed collinearly (d_y = 0 mm). Subjects were then asked to exert different combinations of normal and tangential digit forces (F_n and F_tan, respectively) using the reference hand and then match the memorized d_y using the test hand. The reference hand exerted F_tan of thumb and index finger in either same or opposite direction. We hypothesized that, when the tangential forces of the digits are produced in opposite directions, matching error (1) would be biased toward the directions of the tangential forces; and (2) would be greater when the remembered relative contact points are matched with negligible digit force production. For the test hand, digit forces were either negligible (0.5–1 N, 0 ± 0.25 N; Experiment 1) or the same as those exerted by the reference hand (Experiment 2).Matching error was biased towards the direction of digit tangential forces: thumb CoP was placed higher than the index finger CoP when thumb and index finger F_tan were directed upward and downward, respectively, and vice versa (p < 0.001). However, matching error was not dependent on whether the reference and test hand exerted similar or different forces. We propose that the expected sensory consequence of motor commands for tangential forces in opposite directions overrides estimation of fingertip position through haptic sensory feedback.

Background: Carpal tunnel syndrome (CTS) is a compression neuropathy of the median nerve that results in sensorimotor deficits in the hand. Until recently, the effects of CTS on hand function have been studied using mostly two-digit grip tasks. The purpose of this study was to investigate the coordination of multi-digit forces as a function of object center of mass (CM) during whole-hand grasping.

Methods: Fourteen CTS patients and age- and gender-matched controls were instructed to grasp, lift, hold, and release a grip device with five digits for seven consecutive lifts while maintaining its vertical orientation. The object CM was changed by adding a mass at different locations at the base of the object. We measured forces and torques exerted by each digit and object kinematics and analyzed modulation of these variables to object CM at object lift onset and during object hold. Our task requires a modulation of digit forces at and after object lift onset to generate a compensatory moment to counteract the external moment caused by the added mass and to minimize object tilt.

Results: We found that CTS patients learned to generate a compensatory moment and minimized object roll to the same extent as controls. However, controls fully exploited the available degrees of freedom (DoF) in coordinating their multi-digit forces to generate a compensatory moment, i.e., digit normal forces, tangential forces, and the net center of pressure on the finger side of the device at object lift onset and during object hold. In contrast, patients modulated only one of these DoFs (the net center of pressure) to object CM by modulating individual normal forces at object lift onset. During object hold, however, CTS patients were able to modulate digit tangential force distribution to object CM.

Conclusions: Our findings suggest that, although CTS did not affect patients’ ability to perform our manipulation task, it interfered with the modulation of specific grasp control variables. This phenomenon might be indicative of a lower degree of flexibility of the sensorimotor system in CTS to adapt to grasp task conditions.

Studies on anticipatory planning of object manipulation showed initial task failure (i.e., object roll) when visual object shape cues are incongruent with other visual cues, such as weight distribution/density (e.g., symmetrically shaped object with an asymmetrical density). This suggests that shape cues override density cues. However, these studies typically only measured forces, with digit placement constrained. Recent evidence suggests that when digit placement is unconstrained, subjects modulate digit forces and placement. Thus, unconstrained digit placement might be modulated on initial trials (since it is an explicit process), but not forces (since it is an implicit process). We tested whether shape and density cues would differentially influence anticipatory planning of digit placement and forces during initial trials of a two-digit object manipulation task. Furthermore, we tested whether shape cues would override density cues when cues are incongruent. Subjects grasped and lifted an object with the aim of preventing roll. In Experiment 1, the object was symmetrically shaped, but with asymmetrical density (incongruent cues). In Experiment 2, the object was asymmetrical in shape and density (congruent cues). In Experiment 3, the object was asymmetrically shaped, but with symmetrical density (incongruent cues). Results showed differential modulation of digit placement and forces (modulation of load force but not placement), but only when shape and density cues were congruent. When shape and density cues were incongruent, we found collinear digit placement and symmetrical force sharing. This suggests that congruent and incongruent shape and density cues differentially influence anticipatory planning of digit forces and placement. Furthermore, shape cues do not always override density cues. A continuum of visual cues, such as those alluding to shape and density, need to be integrated.

Humans are able to intuitively exploit the shape of an object and environmental constraints to achieve stable grasps and perform dexterous manipulations. In doing that, a vast range of kinematic strategies can be observed. However, in this work we formulate the hypothesis that such ability can be described in terms of a synergistic behavior in the generation of hand postures, i.e., using a reduced set of commonly used kinematic patterns. This is in analogy with previous studies showing the presence of such behavior in different tasks, such as grasping. We investigated this hypothesis in experiments performed by six subjects, who were asked to grasp objects from a flat surface. We quantitatively characterized hand posture behavior from a kinematic perspective, i.e., the hand joint angles, in both pre-shaping and during the interaction with the environment. To determine the role of tactile feedback, we repeated the same experiments but with subjects wearing a rigid shell on the fingertips to reduce cutaneous afferent inputs. Results show the persistence of at least two postural synergies in all the considered experimental conditions and phases. Tactile impairment does not alter significantly the first two synergies, and contact with the environment generates a change only for higher order Principal Components. A good match also arises between the first synergy found in our analysis and the first synergy of grasping as quantified by previous work. The present study is motivated by the interest of learning from the human example, extracting lessons that can be applied in robot design and control. Thus, we conclude with a discussion on implications for robotics of our findings.

Theoretical perspectives on anticipatory planning of object manipulation have traditionally been informed by studies that have investigated kinematics (hand shaping and digit position) and kinetics (forces) in isolation. This poses limitations on our understanding of the integration of such domains, which have recently been shown to be strongly interdependent. Specifically, recent studies revealed strong covariation of digit position and load force during the loading phase of two-digit grasping. Here, we determined whether such digit force-position covariation is a general feature of grasping. We investigated the coordination of digit position and forces during five-digit whole-hand manipulation of an object with a variable mass distribution. Subjects were instructed to prevent object roll during the lift. As found in precision grasping, there was strong trial-to-trial covariation of digit position and force. This suggests that the natural variation of digit position that is compensated for by trial-to-trial variation in digit forces is a fundamental feature of grasp control, and not only specific to precision grasp. However, a main difference with precision grasping was that modulation of digit position to the object’s mass distribution was driven predominantly by the thumb, with little to no modulation of finger position. Modulation of thumb position rather than fingers is likely due to its greater range of motion and therefore adaptability to object properties. Our results underscore the flexibility of the central nervous system in implementing a range of solutions along the digit force-to-position continuum for dexterous manipulation.

Of particular interest to the neuroscience and robotics communities is the understanding of how two humans could physically collaborate to perform motor tasks such as holding a tool or moving it across locations. When two humans physically interact with each other, sensory consequences and motor outcomes are not entirely predictable as they also depend on the other agent’s actions. The sensory mechanisms involved in physical interactions are not well understood. The present study was designed (1) to quantify human–human physical interactions where one agent (“follower”) has to infer the intended or imagined—but not executed—direction of motion of another agent (“leader”) and (2) to reveal the underlying strategies used by the dyad. This study also aimed at verifying the extent to which visual feedback (VF) is necessary for communicating intended movement direction. We found that the control of leader on the relationship between force and motion was a critical factor in conveying his/her intended movement direction to the follower regardless of VF of the grasped handle or the arms. Interestingly, the dyad’s ability to communicate and infer movement direction with significant accuracy improved (>83%) after a relatively short amount of practice. These results indicate that the relationship between force and motion (interpreting as arm impedance modulation) may represent an important means for communicating intended movement direction between biological agents, as indicated by the modulation of this relationship to intended direction. Ongoing work is investigating the application of the present findings to optimize communication of high-level movement goals during physical interactions between biological and non-biological agents.

The human hand has so many degrees of freedom that it may seem impossible to control. A potential solution to this problem is “synergy control” which combines dimensionality reduction with great flexibility. With applicability to a wide range of tasks, this has become a very popular concept. In this review, we describe the evolution of the modern concept using studies of kinematic and force synergies in human hand control, neurophysiology of cortical and spinal neurons, and electromyographic (EMG) activity of hand muscles. We go beyond the often purely descriptive usage of synergy by reviewing the organization of the underlying neuronal circuitry in order to propose mechanistic explanations for various observed synergy phenomena. Finally, we propose a theoretical framework to reconcile important and still debated concepts such as the definitions of “fixed” vs. “flexible” synergies and mechanisms underlying the combination of synergies for hand control.

Sensorimotor control theories propose that the central nervous system exploits expected sensory consequences generated by motor commands for movement planning, as well as online sensory feedback for comparison with expected sensory feedback for monitoring and correcting, if needed, ongoing motor output. In our study, we tested this theoretical framework by quantifying the functional role of expected vs. actual proprioceptive feedback for planning and regulation of gait in humans. We addressed this question by using a novel methodological approach to deliver fast perturbations of the walking surface stiffness, in conjunction with a virtual reality system that provided visual feedback of upcoming changes of surface stiffness. In the “predictable” experimental condition, we asked subjects to learn associating visual feedback of changes in floor stiffness (sand patch) during locomotion to quantify kinematic and kinetic changes in gait prior to and during the gait cycle. In the “unpredictable” experimental condition, we perturbed floor stiffness at unpredictable instances during the gait to characterize the gait-phase dependent strategies in recovering the locomotor cycle. For the “unpredictable” conditions, visual feedback of changes in floor stiffness was absent or inconsistent with tactile and proprioceptive feedback. The investigation of these perturbation-induced effects on contralateral leg kinematics revealed that visual feedback of upcoming changes in floor stiffness allows for both early (preparatory) and late (post-perturbation) changes in leg kinematics. However, when proprioceptive feedback is not available, the early responses in leg kinematics do not occur while the late responses are preserved although in a, slightly attenuated form. The methods proposed in this study and the preliminary results of the kinematic response of the contralateral leg open new directions for the investigation of the relative role of visual, tactile, and proprioceptive feedback on gait control, with potential implications for designing novel robot-assisted gait rehabilitation approaches.

Recent studies about sensorimotor control of the human hand have focused on how dexterous manipulation is learned and generalized. Here we address this question by testing the extent to which learned manipulation can be transferred when the contralateral hand is used and/or object orientation is reversed. We asked subjects to use a precision grip to lift a grip device with an asymmetrical mass distribution while minimizing object roll during lifting by generating a compensatory torque. Subjects were allowed to grasp anywhere on the object’s vertical surfaces, and were therefore able to modulate both digit positions and forces. After every block of eight trials performed in one manipulation context (i.e., using the right hand and at a given object orientation), subjects had to lift the same object in the second context for one trial (transfer trial).

Context changes were made by asking subjects to switch the hand used to lift the object and/or rotate the object 180° about a vertical axis. Therefore, three transfer conditions, hand switch (HS), object rotation (OR), and both hand switch and object rotation (HS+OR), were tested and compared with hand matched control groups who did not experience context changes. We found that subjects in all transfer conditions adapted digit positions across multiple transfer trials similar to the learning of control groups, regardless of different changes of contexts. Moreover, subjects in both HS and HS+OR group also adapted digit forces similar to the control group, suggesting independent learning of the left hand. In contrast, the OR group showed significant negative transfer of the compensatory torque due to an inability to adapt digit forces. Our results indicate that internal representations of dexterous manipulation tasks may be primarily built through the hand used for learning and cannot be transferred across hands.