Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates
Jose M. Carmena, Mikhail Lebedev, Roy E. Crist et al. · PLoS Biology · 2003
Reaching and grasping in primates depend on the coordination of neural activity in large frontoparietal ensembles. Here we demonstrate that primates can learn to reach and grasp virtual objects by controlling a robot arm through a closed-loop brain-machine interface (BMIc) that uses multiple mathematical models to extract several motor parameters (i.e., hand position, velocity, gripping force, and the EMGs of multiple arm muscles) from the electrical activity of frontoparietal neuronal ensembles. As single neurons typically contribute to the encoding of several motor parameters, we observed that high BMIc accuracy required recording from large neuronal ensembles. Continuous BMIc operation by monkeys led to significant improvements in both model predictions and behavioral performance. Using visual feedback, monkeys succeeded in producing robot reach-and-grasp movements even when their arms did not move. Learning to operate the BMIc was paralleled by functional reorganization in multiple cortical areas, suggesting that the dynamic properties of the BMIc were incorporated into motor and sensory cortical representations.
Cited by 1,758 works. doi:10.1371/journal.pbio.0000042 Open-access PDF
Authors
- Jose M. Carmena
- Mikhail Lebedev
- Roy E. Crist
- Joseph E. O’Doherty
- David M. Santucci
- Dragan F. Dimitrov
- Parag G. Patil
- Craig S. Henriquez
- Miguel A. L. Nicolelis
References
- Guide for the Care and Use of Laboratory Animals
- A spelling device for the paralysed
- The 1996 Guide for the Care and Use of Laboratory Animals
- Real-time prediction of hand trajectory by ensembles of cortical neurons in primates
- Direct isolation of human central nervous system stem cells
- Direct Cortical Control of 3D Neuroprosthetic Devices
- Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex
- Instant neural control of a movement signal
- Mental Rotation of the Neuronal Population Vector
- Temporal structure in neuronal activity during working memory in macaque parietal cortex