setting up camera coupled-emg sensors and vr headset to assess motion and muscle activity

Integrating VR and Biosensors for Quantitative Motion-Muscle Activity Assessment

Movement is how we interact with the world. While everyday activities such as picking up a glass of water or walking to work may seem simple, even these movements rely on complex signaling between the central nervous system, muscles, and limbs1. As such, personal independence and quality of life are highly correlated to the level of an individual&#39;s limb function2,3. Neurological damage, as in spinal cord injury (SCI) or peripheral nerve injury, can result in permanent motor deficits, thereby diminishing one&#39;s ability to execute even simple activities of daily living4,5. According to the National Institute of Neurological Disorders and Stroke, over 100 million people in the United States experience motor deficits, with stroke as one of the leading causes6,7,8. Due to the nature of these injuries, patients often require prolonged care in which quantitative motor assessment and remote treatment may be beneficial.
Current practices for treating movement disorders often require both initial and ongoing clinical assessment of function through observation by trained experts such as physical or occupational therapists. Standard validated clinical tests often require trained professionals to administer them, with specific time constraints and subjective scoring of predefined movements or functional tasks. However, even in healthy individuals, identical movements can be accomplished with varying combinations of joint angles. This concept is termed musculoskeletal redundancy.
Functional clinical tests often do not account for the individual redundancy underlying inter-subject variability. For clinicians and researchers alike, distinguishing between normal variability caused by redundancy and pathological changes in movement remains a challenge. Standardized clinical assessments performed by well-trained raters utilize low-resolution scoring systems to reduce inter-rater variability and improve test validity. However, this introduces ceiling effects, thus lowering the sensitivity and predictive validity for subjects who may have mild movement deficits9,10. Furthermore, these clinical tests cannot differentiate if deficits are caused by passive body mechanics or active muscle coordination, which may be of importance during initial diagnosis and when designing a patient-specific rehabilitation plan. Randomized clinical trials have revealed inconsistent efficacy of treatment plans formulated based on evidence provided by these clinical tests11,12,13. Several studies have emphasized the need for quantitative, user-friendly clinical metrics that may be used to guide the design of future interventions14,15.
In previous studies, we demonstrated the implementation of automated movement assessment using readily available consumer motion capture devices in post-stroke arm impairment, as well as the evaluation of shoulder function after chest surgery in breast cancer patients16,17. Additionally, we have shown that using active joint moments to estimate muscle moments of specific active movements is a more sensitive measure of motor deficits after stroke compared to joint angles18. Motion capture and surface electromyography (EMG) may therefore be of critical importance in the assessment of patients who are diagnosed as asymptomatic by standard clinical tests, but who may still be experiencing movement difficulties, fatigue, or pain. This paper describes a system that may enable detailed and quantitative characterization of movement during standard clinical tests for the future development of methods for at-home evaluation and rehabilitation in movement-impaired patient populations.
Virtual reality (VR) can be used to construct an immersive user experience while modeling everyday tasks. Typically, VR systems track the hand movements of the user to allow for simulated interactions with the virtual environment. The protocol we describe here uses consumer VR products for motion capture to quantify the assessment of motor deficits, similar to other studies demonstrating the use of off-the-shelf video game controllers in quantitative evaluation of impairment after stroke or shoulder surgery16,17. In addition, EMG is a non-invasive measure of the neural activity underlying muscular contraction19. As such, EMG may be used to indirectly evaluate the quality of the neural control of movement and provide a detailed assessment of motor function. Muscle and nerve damage may be detected by EMG, and disorders such as muscular dystrophy and cerebral palsy are commonly monitored using this technique20,21. Furthermore, EMG may be used to track changes in muscle strength or spasticity, which may not be evident in kinematic assessments22,23, as well as fatigue and muscle coactivation. Metrics such as these are critical in considering rehabilitation progress23,24,25.
The experimental paradigm described here seeks to leverage a combination of VR and EMG to address the limitations of traditional clinical assessment tools. Here, participants were asked to perform a modified Box and Block task (BBT)26 using real objects and in VR. The standard BBT is a clinical tool used in the general assessment of gross upper extremity function, in which subjects are asked to move as many 2.5 cm blocks as possible from one compartment, over a partition, to an adjoining compartment within one minute. While often used to reliably assess deficits in patients with stroke or other neuromuscular conditions (e.g., upper extremity paresis, spastic hemiplegia), normative data have also been reported for healthy children and adults, ages 6-8926. A virtual movement assessment is used to simulate functional aspects of the validated clinical test performed in real life. VR is used here to decrease required hardware while allowing for the provision of standardized instructions and programmed, automated scoring. As such, constant supervision by trained professionals would no longer be necessary.
The BBT in this study has been simplified to focus on capturing the reaching and grasping of one block at a time that appears in the same location. This maximized the reproducibility of the movements and minimized the inter-subject variability in recorded data. Lastly, virtual reality headsets can be purchased for as little as $300 and have the potential to house multiple assessments. Once programmed, this would significantly decrease the cost associated with typical professional evaluation and allow for increased accessibility of these standard, validated clinical tests in both clinical and remote/at-home settings.

Author Spotlight: Enhancing Remote Rehabilitation with Virtual Reality and Electromyography

Setup for the Quantitative Assessment of Motion and Muscle Activity During a Virtual Modified Box and Block Test

Here in the Neuroengineering and Rehabilitation Laboratory at West Virginia University, we study functional mechanisms of sensory motor control, and develop objective assessment tools for the assessment of motor skills and movement impairment. Remote or virtual care has become a promising means to address healthcare disparities. However, there's a critical need to quantitatively characterize motor skills for use in these applications.Our protocol seeks to enable clinicians and researchers to obtain high resolution data on complex movements in order to better assess movement deficits remotely. This protocol aims to simplify complex and underused rehabilitation technologies by automating at home movement assessment. Its key advantage lies in integrating virtual reality, motion capture, and electromyography.For example, a VR headset with hand tracking captures movements for first analysis, while an EMG bracelet estimate muscle performance during virtual testing.

Setting Up Camera Coupled-EMG Sensors and VR Headset to Assess Motion and Muscle Activity

setting-up-camera-coupled-emg-sensors-vr-headset-to-assess-motion

Research

JoVE Journal

Engineering

39 vues.  West Virginia University. Pour commencer, procurez-vous tous les composants du système requis pour le test de mouvement et d’activité musculaire. Allumez la station de base d’électromyographie et connectez-la à un ordinateur dédié. Pour configurer le serveur de capture de mouvement, connectez-le d’abord à un routeur réseau de liaison informatique, puis connectez-le à un moniteur et à des caméras pour la visualisation.Allumez le troisième ordinateur dédié connecté au casque de réalité virt...

Vidéo: Configuration de capteurs EMG couplés à une caméra et d’un casque VR pour évaluer les mouvements et l’activité musculaire

setup for the quantitative assessment of motion and muscle activity during a virtual modified box and block test

The protocol described here aims to enhance the quantitative evaluation of upper limb deficits, with the goal of developing additional technology for remote assessment both in the clinic and at home. Virtual reality and biosensor technologies are combined with standard clinical techniques to provide insights into the functioning of the neuromuscular system.

https://cloudfront.jove.com/CDNSource/teasers/65736_b.jpg

modified virtual box and block task to assess motion-associated muscle activity

Modified Virtual Box and Block Task to Assess Motion-Associated Muscle Activity

setting up the ladder beam test to assess motor function in mouse

Setting Up the Ladder Beam Test to Assess Motor Function in Mouse

recording forelimb muscle activity in head&#45;fixed mice with chronically implanted emg electrodes

Author Spotlight: Investigating Mouse Motor Cortex Interactions from Muscle Activity to Neural Dynamics

This protocol describes the hand fabrication and surgical implantation of electromyographic (EMG) electrodes in the forelimb muscles of mice to record muscle activity during head-fixed behavior experiments.

Recording Forelimb Muscle Activity in Head&#45;Fixed Mice with Chronically Implanted EMG Electrodes

using facial electromyography to assess facial muscle reactions to experienced and observed affective touch in humans

Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans

We describe a protocol to assess facial muscle activity in response to experienced and observed tactile stimulation using facial...

using touch-evoked response and locomotion assays to assess muscle performance and function in zebrafish

Using Touch-evoked Response and Locomotion Assays to Assess Muscle Performance and Function in Zebrafish

Zebrafish are an excellent model to study muscle function and disease. During early embryogenesis zebrafish begin regular muscle contractions producing rhythmic swimming behavior, which is altered when the muscle is disrupted. Here we describe a touch-evoked response and locomotion assay to examine swimming performance as a measure of muscle function.

muscle function obtained with motion mode ultrasound and surface electromyography during core endurance exercise

Muscle Function Obtained with Motion Mode Ultrasound and Surface Electromyography during Core Endurance Exercise

This protocol uses motion mode ultrasound and surface electromyography simultaneously to measure muscle function of the core. Muscle thickness and activation of the local stabilizers (e.g., transverse abdominis, internal oblique) and global movers (e.g., external oblique) is achievable during specific time points of the side plank and dead bug exercises.

cervical spinal hemisection and diaphragm muscle electromyographic (emg) monitoring in rats

Cervical Spinal Hemisection and Diaphragm Muscle Electromyographic (EMG) Monitoring in Rats

miniscope recording calcium signals at hippocampus of mice navigating an odor plume

Author Spotlight: Understanding Processing of Olfactory and Spatial Information by Brain with Real-Time Behavioral Analysis

This protocol investigates the brain-behavior relationship in hippocampal CA1 in mice navigating an odor plume. We provide a step-by-step protocol, including surgery to access imaging of the hippocampus, behavioral training, miniscope GCaMP6f recording and processing of the brain, and behavioral data to decode the mouse position from ROI neural...

Recording Neuronal Activity During Odor Plume Navigation with Miniscope Imaging

https://cloudfront.jove.com/CDNSource/teasers/67039_b.jpg

using motion capture technology in the instrumented timed up and go test to detect the risk of falling in aged adults

Author Spotlight: Innovations in iTUG Test for Enhanced Risk Assessment and Cognitive Insights

The instrumented Timed Up and Go (iTUG) test is gaining increasing attention in body sway and gait analysis with the development of new technologies. We present a protocol to analyze the subcomponents of the iTUG with motion...

Using Motion Capture Technology in the Instrumented Timed Up and Go Test to Detect the Risk of Falling in Aged Adults

recording and modulation of epileptiform activity in rodent brain slices coupled to microelectrode arrays

Recording and Modulation of Epileptiform Activity in Rodent Brain Slices Coupled to Microelectrode Arrays

We illustrate how to perform recording and electrical modulation of 4-aminopyridine-induced epileptiform activity in rodent brain slices using microelectrode arrays. A custom recording chamber maintains tissue viability throughout prolonged experimental sessions. Live electrode mapping and selection of stimulating pairs are performed by a custom graphical user...

assessing human spatial navigation in a virtual space and its sensitivity to exercise

Author Spotlight: Investigating the Effects of Mind-Body-Movement Practices on Brain Function

Here, we present a novel, brief, and active spatial navigation task that assesses both spatial navigation and episodic memory ability. Importantly, spatial navigation and episodic memory were associated with one another, and this task demonstrated sensitivity to...

Game-Based Exploration: Unlocking Human Spatial Navigation Abilities

https://cloudfront.jove.com/CDNSource/teasers/65332_b.jpg

minimally invasive murine laryngoscopy for close&#45;up imaging of laryngeal motion during breathing and swallowing

Longitudinal Assessment of Laryngeal Function and Airway Protection in Rodent Models

This protocol describes a serial transoral laryngoscopy approach for mice and rats that permits close-up, unobstructed video imaging of the larynx during breathing and swallowing using an optimized anesthetic regimen and finely tuned endoscopic manipulation...

Minimally Invasive Murine Laryngoscopy for Close&#45;Up Imaging of Laryngeal Motion During Breathing and Swallowing

setting up and estimating the pellicle biofilm development in mycobacterium smegmatis cultures

Setting Up and Estimating the Pellicle Biofilm Development in Mycobacterium smegmatis Cultures

novel 3d/vr interactive environment for md simulations, visualization and analysis

Novel 3D/VR Interactive Environment for MD Simulations, Visualization and Analysis

A new computational system featuring GPU-accelerated molecular dynamics simulation and 3D/VR visualization, analysis and manipulation of nanostructures has been implemented, representing a novel approach to advance materials research and promote innovative investigation and alternative methods to learn about material structures with dimensions invisible to the human...

an assay to assess phagocytosis and oxidative burst activity in granulocytes and monocytes

Then, for each experimental and control tube, use an extended-length pipette tip to transfer 100 microliters of each whole blood sample from the lithium heparin blood collection tube to the bottom of an appropriately labeled 12-by-75 millimeter tube. When all of the blood has been transferred, add 10 microliters of the HE working solution to the tubes labeled with red ink and an H, including the HE control tube, and cap the...

An Assay to Assess Phagocytosis and Oxidative Burst Activity In Granulocytes and Monocytes

This video demonstrates the assay to confirm phagocytic activity by cells in human blood via flow cytometry. The granulocytes and monocytes confirm their phagocytic activity by showing green and red fluorescence confirming the presence of engulfed bacteria and oxidative burst activity...

setting up and structuring eye-tracking experiments using experiment builder software

Setting Up and Structuring Eye-Tracking Experiments Using Experiment Builder Software

The ability to move allows us to interact with the world. When this ability is impaired, it can significantly reduce one's quality of life and independence and may lead to complications. The importance of remote patient evaluation and rehabilitation has recently grown due to limited access to in-person services. For example, the COVID-19 pandemic unexpectedly resulted in strict regulations, reducing access to non-emergent healthcare services. Additionally, remote care offers an opportunity to address healthcare disparities in rural, underserved, and low-income areas where access to services remains limited. 
Improving accessibility through remote care options would limit the number of hospital or specialist visits and render routine care more affordable. Finally, the use of readily available commercial consumer electronics for at-home care can enhance patient outcomes due to improved quantitative observation of symptoms, treatment efficacy, and therapy dosage. While remote care is a promising means to address these issues, there is a crucial need to quantitatively characterize motor impairment for such applications. The following protocol seeks to address this knowledge gap to enable clinicians and researchers to obtain high-resolution data on complex movement and underlying muscle activity. The ultimate goal is to develop a protocol for remote administration of functional clinical tests. 
Here, participants were instructed to perform a medically-inspired Box and Block task (BBT), which is frequently used to assess hand function. This task requires subjects to transport standardized cubes between two compartments separated by a barrier. We implemented a modified BBT in virtual reality to demonstrate the potential of developing remote assessment protocols. Muscle activation was captured for each subject using surface electromyography. This protocol allowed for the acquisition of high-quality data to better characterize movement impairment in a detailed and quantitative manner. Ultimately, these data have the potential to be used to develop protocols for virtual rehabilitation and remote patient monitoring.

The protocol described here aims to enhance the quantitative evaluation of upper limb deficits, with the goal of developing additional technology for remote assessment both in the clinic and at home. Virtual reality and biosensor technologies are combined with standard clinical techniques to provide insights into the functioning of the neuromuscular system.