motor-imagery-performance-through-embodied-digital-twins-virtual

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment

This study introduces an innovative framework for neurological rehabilitation by integrating brain-computer interfaces (BCI) and virtual reality (VR) ...

Collège Ahuntsic

Upper limb dysfunctions (ULD) are common following a stroke. Annually, more than 15 million people suffer a stroke worldwide. We have developed a 7 degrees of freedom (DoF) exoskeleton robot named the smart robotic exoskeleton () to provide upper limb rehabilitation therapy. The robot is designed for adults and has an extended range of motion compared to our previously designed ETS-MARSE robot. While providing rehabilitation therapy, the exoskeleton robot is always subject to random disturbance. Moreover, these types of robots manage various patients and different degrees of impairment, which are quite impossible to model and incorporate into the robot dynamics. We hypothesize that a model-independent controller, such as a PID controller, is most suitable for maneuvering a therapeutic exoskeleton robot to provide rehabilitation therapy. This research implemented a model-free proportional-integral-derivative (PID) controller to maneuver a complex 7 DoF anthropomorphic exoskeleton robot (i.e., ) to provide a wide variety of upper limb exercises to the different subjects. The robustness and trajectory tracking performance of the PID controller was evaluated with experiments. The results show that a PID controller can effectively control a highly nonlinear and complex exoskeleton-type robot.

Robustness and Tracking Performance Evaluation of PID Motion Control of 7 DoF Anthropomorphic Exoskeleton Robot Assisted Upper Limb Rehabilitation.

Throughout the last decade, many assistive robots for people with disabilities have been developed; however, researchers have not fully utilized these robotic technologies to entirely create independent living conditions for people with disabilities, particularly in relation to activities of daily living (ADLs). An assistive system can help satisfy the demands of regular ADLs for people with disabilities. With an increasing shortage of caregivers and a growing number of individuals with impairments and the elderly, assistive robots can help meet future healthcare demands. One of the critical aspects of designing these assistive devices is to improve functional independence while providing an excellent human-machine interface. People with limited upper limb function due to stroke, spinal cord injury, cerebral palsy, amyotrophic lateral sclerosis, and other conditions find the controls of assistive devices such as power wheelchairs difficult to use. Thus, the objective of this research was to design a multimodal control method for robotic self-assistance that could assist individuals with disabilities in performing self-care tasks on a daily basis. In this research, a control framework for two interchangeable operating modes with a finger joystick and a chin joystick is developed where joysticks seamlessly control a wheelchair and a wheelchair-mounted robotic arm. Custom circuitry was developed to complete the control architecture. A user study was conducted to test the robotic system. Ten healthy individuals agreed to perform three tasks using both (chin and finger) joysticks for a total of six tasks with 10 repetitions each. The control method has been tested rigorously, maneuvering the robot at different velocities and under varying payload (1-3.5 lb) conditions. The absolute position accuracy was experimentally found to be approximately 5 mm. The round-trip delay we observed between the commands while controlling the xArm was 4 ms. Tests performed showed that the proposed control system allowed individuals to perform some ADLs such as picking up and placing items with a completion time of less than 1 min for each task and 100% success.

Control of a Wheelchair-Mounted 6DOF Assistive Robot With Chin and Finger Joysticks.

The number of individuals with upper or lower extremities dysfunction (ULED) has considerably increased in the past few decades, resulting in a high economic burden for their families and society. Individuals with ULEDs require assistive robots to fulfill all their activities of daily living (ADLs). However, a theory for the optimal design of assistive robots that reduces energy consumption while increasing the workspace is unavailable. Thus, this research presents an algorithm for the optimal link length selection of an assistive robot mounted on a wheelchair to minimize the torque demands of each joint while increasing the workspace coverage. For this purpose, this research developed a workspace to satisfy a list of 18 ADLs. Then, three torque indices from the literature were considered as performance measures to minimize; the three torque measures are the quadratic average torque (QAT), the weighted root square mean (WRMS), and the absolute sum of torques (AST). The proposed algorithm evaluates any of the three torque measures within the workspace, given the robot dimensions. This proposed algorithm acts as an objective function, which is optimized using a genetic algorithm for each torque measure. The results show that all tree torque measures are suitable criteria for assistance robot optimization. However, each torque measures yield different optimal results; in the case of the QAT optimization, it produces the least workspace with the minimum overall torques of all the joints. Contrarily, the WRMS and AST optimization yield similar results generating the maximum workspace coverage but with a greater overall torque of all joints. Thus, the selection between the three methods depends on the designer's criteria. Based on the results, the presented methodology is a reliable tool for the optimal dimensioning of assistive robots.

Evaluation of Objective Functions for the Optimal Design of an Assistive Robot.

This research shows the development of a teleoperation system with an assistive robot (NAO) through a Kinect V2 sensor, a set of Meta Quest virtual reality glasses, and Nintendo Switch controllers (Joycons), with the use of the Robot Operating System (ROS) framework to implement the communication between devices. In this paper, two interchangeable operating models are proposed. An exclusive controller is used to control the robot's movement to perform assignments that require long-distance travel. Another teleoperation protocol uses the skeleton joints information readings by the Kinect sensor, the orientation of the Meta Quest, and the button press and thumbstick movements of the Joycons to control the arm joints and head of the assistive robot, and its movement in a limited area. They give image feedback to the operator in the VR glasses in a first-person perspective and retrieve the user's voice to be spoken by the assistive robot. Results are promising and can be used for educational and therapeutic purposes.

A Novel Multi-Modal Teleoperation of a Humanoid Assistive Robot with Real-Time Motion Mimic.

Rehabilitation robotics has seen growing popularity in recent years due to its immense potential for improving the lives of people with disabilities. However, the complex, uncertain dynamics of these systems present significant control challenges, requiring advanced techniques. This paper introduces a novel adaptive control framework integrating modified function approximation (MFAT) and double-integral non-singular terminal sliding mode control (DINTSMC). The goal is to achieve precise tracking performance, high robustness, a fast response, a finite convergence time, reduced chattering, and effective handling of unknown system dynamics. A key feature is the incorporation of a higher-order sliding mode observer, eliminating the need for velocity feedback. This provides a new solution for overcoming the inherent variations and uncertainties in robot manipulators, enabling improved accuracy within fixed convergence times. The efficacy of the proposed approach was validated through simulations and experiments on an exoskeleton robot. The results successfully demonstrated the controller's effectiveness. Stability analysis using Lyapunov theory proved the closed-loop system's uniform ultimate boundedness. This contribution is expected to enable enhanced control for rehabilitation robots and improved patient outcomes.

Brahim Brahmi

Electrical Engineering

Collège Ahuntsic

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment