motor-imagery-performance-through-embodied-digital-twins-virtual

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment

This study introduces an innovative framework for neurological rehabilitation by integrating brain-computer interfaces (BCI) and virtual reality (VR) ...

University of Wisconsin-Milwaukee

This paper proposes a novel robust control method for the control of a 7-DOF exoskeleton robot. The external disturbances and unknown dynamics in the form of friction forces, different upper-limb's mass, backlash, and input saturation make robot unstable, which prevents the robot from correctly following the defined path. A new fractional sliding mode controller (NFSMC) is designed, which is robust against unknown dynamic and external disturbances. Fractional PID controller (FPID) has high trajectory tracking, but it is not robust against external disturbances. Therefore, by combining NFSMC and FPID controllers, a new compound fractional PID sliding mode controller (NCFPIDSMC) is proposed, which benefits high trajectory tracking of FPID and robustness of NFSMC. The stability of the proposed control method is verified by Lyapunov theory. A random noise is applied in order to confirm the robustness of the proposed control method.

Novel robust control of a 7-DOF exoskeleton robot.

Design and development of a sensored glove for home-based rehabilitation.

The research presents a novel controller designed for robotic systems subject to nonlinear uncertain dynamics and external disturbances. The control scheme is based on the modified super-twisting method, input/output feedback linearization, and time delay approach. In addition, to minimize the chattering phenomenon and ensure fast convergence to the selected sliding surface, a new reaching law has been integrated with the control law. The control scheme aims to provide high performance and enhanced accuracy via limiting the effects brought by the presence of uncertain dynamics. Stability analysis of the closed-loop system was conducted using a powerful Lyapunov function, showing finite time convergence of the system's errors. Lastly, experiments shaping rehabilitation tasks, as performed by healthy subjects, demonstrated the controller's efficiency given its uncertain nonlinear dynamics and the external disturbances involved.

A Novel Modified Super-Twisting Control Augmented Feedback Linearization for Wearable Robotic Systems Using Time Delay Estimation.

The design of an upper limb rehabilitation robot for post-stroke patients is considered a benchmark problem regarding improving functionality and ensuring better human-robot interaction (HRI). Existing upper limb robots perform either joint-based exercises (exoskeleton-type functionality) or end-point exercises (end-effector-type functionality). Patients may need both kinds of exercises, depending on the type, level, and degree of impairments. This work focused on designing and developing a seven-degrees-of-freedom (DoFs) upper-limb rehabilitation exoskeleton called 'u-Rob' that functions as both exoskeleton and end-effector types device. Furthermore, HRI can be improved by monitoring the interaction forces between the robot and the wearer. Existing upper limb robots lack the ability to monitor interaction forces during passive rehabilitation exercises; measuring upper arm forces is also absent in the existing devices. This research work aimed to develop an innovative sensorized upper arm cuff to measure the wearer's interaction forces in the upper arm. A PID control technique was implemented for both joint-based and end-point exercises. The experimental results validated both types of functionality of the developed robot.

Design and Development of an Upper Limb Rehabilitative Robot with Dual Functionality.

Home-based hand rehabilitation has excellent potential as it may reduce patient dropouts due to travel, transportation, and insurance constraints. Being able to perform exercises precisely, accurately, and in a repetitive manner, robot-aided portable devices have gained much traction these days in hand rehabilitation. However, existing devices fall short in allowing some key natural movements, which are crucial to achieving full potential motion in performing activities of daily living. Firstly, existing exoskeleton type devices often restrict or suffer from uncontrolled wrist and forearm movement during finger exercises due to their setup of actuation and transmission mechanism. Secondly, they restrict passive metacarpophalangeal (MCP) abduction-adduction during MCP flexion-extension motion. Lastly, though a few of them can provide isolated finger ROM, none of them can offer isolated joint motion as per therapeutic need. All these natural movements are crucial for effective robot-aided finger rehabilitation. To bridge these gaps, in this research, a novel lightweight robotic device, namely "Flexohand", has been developed for hand rehabilitation. A novel compliant mechanism has been developed and included in Flexohand to compensate for the passive movement of MCP abduction-adduction. The isolated and composite digit joint flexion-extension has been achieved by integrating a combination of sliding locks for IP joints and a wire locking system for finger MCP joints. Besides, the intuitive design of Flexohand inherently allows wrist joint movement during hand digit exercises. Experiments of passive exercises involving isolated joint motion, composite joint motions of individual fingers, and isolated joint motion of multiple fingers have been conducted to validate the functionality of the developed device. The experimental results show that Flexohand addresses the limitations of existing robot-aided hand rehabilitation devices.

Flexohand: A Hybrid Exoskeleton-Based Novel Hand Rehabilitation Device.

Building control architecture that balances the assistive manipulation systems with the benefits of direct human control is a crucial challenge of human-robot collaboration. It promises to help people with disabilities more efficiently control wheelchair and wheelchair-mounted robot arms to accomplish activities of daily living.

Eye-gaze control of a wheelchair mounted 6DOF assistive robot for activities of daily living.

Upper limb dysfunctions (ULD) are common following a stroke. Annually, more than 15 million people suffer a stroke worldwide. We have developed a 7 degrees of freedom (DoF) exoskeleton robot named the smart robotic exoskeleton () to provide upper limb rehabilitation therapy. The robot is designed for adults and has an extended range of motion compared to our previously designed ETS-MARSE robot. While providing rehabilitation therapy, the exoskeleton robot is always subject to random disturbance. Moreover, these types of robots manage various patients and different degrees of impairment, which are quite impossible to model and incorporate into the robot dynamics. We hypothesize that a model-independent controller, such as a PID controller, is most suitable for maneuvering a therapeutic exoskeleton robot to provide rehabilitation therapy. This research implemented a model-free proportional-integral-derivative (PID) controller to maneuver a complex 7 DoF anthropomorphic exoskeleton robot (i.e., ) to provide a wide variety of upper limb exercises to the different subjects. The robustness and trajectory tracking performance of the PID controller was evaluated with experiments. The results show that a PID controller can effectively control a highly nonlinear and complex exoskeleton-type robot.

Robustness and Tracking Performance Evaluation of PID Motion Control of 7 DoF Anthropomorphic Exoskeleton Robot Assisted Upper Limb Rehabilitation.

In this paper, an autonomous exercise generation system based of fuzzy logic approach is presented. This work attempts to close a gap in the design of a completely autonomous robotic rehabilitation system that can recommend exercises to patients based on their data, such as shoulder range of motion (ROM) and muscle strength, from a pre-set library of exercises. The input parameters are fed into a system that uses Mamdani-style fuzzy logic rules to process them. In medical applications, the rationale behind decision making is a sophisticated process that involves a certain amount of uncertainty and ambiguity. In this instance, a fuzzy-logic-based system emerges as a viable option for dealing with the uncertainty. The system's rules have been reviewed by a therapist to ensure that it adheres to the relevant healthcare standards. Moreover, the system has been tested with a series of test data and the results obtained ensures the proposed idea's feasibility.

Autonomous Exercise Generator for Upper Extremity Rehabilitation: A Fuzzy-Logic-Based Approach.

A cerebrovascular accident, or a stroke, can cause significant neurological damage, inflicting the patient with loss of motor function in their hands. Standard rehabilitation therapy for the hand increases demands on clinics, creating an avenue for powered hand rehabilitation devices. Hand rehabilitation devices (HRDs) are devices designed to provide the hand with passive, active, and active-assisted rehabilitation therapy; however, HRDs do not have any standards in terms of development or design. Although the categorization of an injury's severity can guide a patient into seeking proper assistance, rehabilitation devices do not have a set standard to provide a solution from the beginning to the end stages of recovery. In this paper, HRDs are defined and compared by their mechanical designs, actuation mechanisms, control systems, and therapeutic strategies. Furthermore, devices with conducted clinical trials are used to determine the future development of HRDs. After evaluating the abilities of 35 devices, it is inferred that standard characteristics for HRDs should include an exoskeleton design, the incorporation of challenge-based and coaching therapeutic strategies, and the implementation of surface electromyogram signals (sEMG) based control.

Hand Rehabilitation Devices: A Comprehensive Systematic Review.

The walking stability of a humanoid robot is a fundamental problem due to the complex nonlinear dynamic model of the robot's legs. This work introduces the performance tracking control for the humanoid NAO robot by using a Nonlinear Disturbance Observer (NDO)-based Fixed-time Terminal Sliding Mode (FTSM). The influence of uncertain external disturbance is considered while implementing the control strategy to improve the walking motion of the NAO robot. An NDO is adapted to estimate the uncertainties and external disturbances. A novel FTSM surface is proposed to drive the tracking errors to zero in fixed-time. The designed NDO-based FTSM control law achieves robustness while reducing the chattering phenomenon. The Lyapunov's stability theory is used to establish the fixed-time stability of the sliding surface and system states under the proposed control method. To validate the performance of the proposed NDO-based FTSM control, a real-time experiment was conducted on a humanoid NAO robot to demonstrate the improved tracking performance in the presence of the uncertain perturbation effect. The effectiveness of the proposed controller design is validated on a flat, upward inclined surface, and compared to another controller.

Walking position commanded NAO robot using nonlinear disturbance observer-based fixed-time terminal sliding mode.

According to the World Health Organization, hundreds of individuals commence wheelchair use daily, often due to an injury such as spinal cord injury or through a condition such as a stroke. However, manual wheelchair users typically experience reductions in individual community mobility and participation. In this review, articles from 2017 to 2023 were reviewed to identify means of measuring community mobility and participation of manual wheelchair users, factors that can impact these aspects, and current rehabilitation techniques for improving them. The selected articles document current best practices utilizing self-surveys, in-clinic assessments, and remote tracking through GPS and accelerometer data, which rehabilitation specialists can apply to track their patients' community mobility and participation accurately. Furthermore, rehabilitation methods such as wheelchair training programs, brain-computer interface triggered functional electric stimulation therapy, and community-based rehabilitation programs show potential to improve the community mobility and participation of manual wheelchair users. Recommendations were made to highlight potential avenues for future research.

Mohammad Habibur Rahman

Department of Mechanical Engineering,
BioRobotics Lab,
Department of Mechanical Engineering, BioRobotics Lab

University of Wisconsin-Milwaukee

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment

Mohammad Habibur Rahman

.css-o250i3{font-size:18px;font-family:Open Sans,sans-serif;line-height:21.6px;}Department of Mechanical Engineering,BioRobotics Lab,Department of Mechanical Engineering, BioRobotics Lab

University of Wisconsin-Milwaukee

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment

Department of Mechanical Engineering,
BioRobotics Lab,
Department of Mechanical Engineering, BioRobotics Lab