Posts Tagged gesture recognition
[Abstract] Artificial intelligence-based interactive virtual reality-assisted gaming system for hand rehabilitation
[Abstract] Feature Evaluation of Upper Limb Exercise Rehabilitation Interactive System Based on Kinect – Full Text PDF
The virtual rehabilitation system combining virtual rehabilitation environment and upper limb rehabilitation technology is interactive and interesting, which can improve the enthusiasm and initiative of patients for rehabilitation training, improve the efficiency of rehabilitation training and improve the effect of rehabilitation treatment. This paper firstly conducts in-depth research and analysis on the research progress of the upper limb rehabilitation robot system, and deeply studies the principle and rehabilitation principle of the stroke caused by hemiplegic dyskinesia, and summarizes the goals and methods of the upper limb rehabilitation system design. Secondly, the hand motion tracking is realized by Kinect’s bone tracking, and the optimal tracking distance is determined experimentally, which verifies the stability and robustness of the tracking. Static gesture recognition adopts two gesture recognition schemes based on Kinect depth image and color space model respectively. Finally, using the rehabilitation robot and Kinect sensor as the hardware platform, the virtual rehabilitation training system experimental platform is constructed, and the horizontal rehabilitation exercise and the three-dimensional space rehabilitation exercise are respectively studied experimentally, and the exercise data obtained by using healthy subjects as the experimental object is analyzed. Based on this, the validity and feasibility of the Kinect-based upper limb exercise rehabilitation interactive system were verified.
[ARTICLE] Mirror Therapy Using Gesture Recognition for Upper Limb Function, Neck Discomfort, and Quality of Life After Chronic Stroke: A Single-Blind Randomized Controlled Trial – Full Text
Mirror therapy for stroke patients was reported to be effective in improving upper-extremity motor function and daily life activity performance. In addition, game-based virtual reality can be realized using a gesture recognition (GR) device, and various tasks can be presented. Therefore, this study investigated changes in upper-extremity motor function, quality of life, and neck discomfort when using a GR device for mirror therapy to observe the upper extremities reflected in the mirror.
A total of 36 subjects with chronic stroke were randomly divided into 3 groups: GR mirror therapy (n=12), conventional mirror therapy (n=12), and control (n=12) groups. The GR therapy group performed 3D motion input device-based mirror therapy, the conventional mirror therapy group underwent general mirror therapy, and the control group underwent sham therapy. Each group underwent 15 (30 min/d) intervention sessions (3 d/wk for 5 weeks). All subjects were assessed by manual function test, neck discomfort score, and Short-Form 8 in pre- and post-test.
Upper-extremity function, depression, and quality of life in the GR mirror therapy group were significantly better than in the control group. The changes of neck discomfort in the conventional mirror therapy and control groups were significantly greater than in the GR mirror therapy group.
We found that GR device-based mirror therapy is an intervention that improves upper-extremity function, neck discomfort, and quality of life in patients with chronic stroke.
In patients with acute stroke that occurred >6 months previously, 85% have upper-limb disorders, and 55% to 75% have upper-limb disorders . The upper-limb movement function is decreased due to weakening of upper-limb muscles, which is primarily caused by changes in the central nervous system and secondarily by weakness due to inactivity and reduced activity [2,3].
Activities of daily living are limited due to body dysfunction, and most stroke patients have limited social interaction; these disorders reduce the quality of life [4–6]. In addition, stroke patients may experience depression due to reduced motivation . Depression results in loss of interest and joy, anxiety, fear, hostility, sadness, and anger, which negatively affect functional recovery and rehabilitation in stroke patients .
Constraint-induced movement therapy, action observation training, and mirror therapy have been recently studied as therapies for upper-extremity motor function . These interventions are used to increase the use of paralyzed limbs to overcome disuse syndromes, observe and imitate movement, and change the neural network involved in movement. Providing various tasks in upper-extremity rehabilitation is necessary and virtual reality is used as a method for providing various tasks [9,10].
Interventions using virtual reality require cognitive factors, such as judgment and memory, as the task progresses. It can use visual and auditory stimuli, and can induce interest and motivation, helping stroke patients to be mentally stable and motivated . Gesture recognition (GR) is a topic that studies the reading of these movements using algorithms. These GR algorithms mainly focus on the movement of arm, hands, eyes, legs, and other body parts. The main idea is to capture body movements using capture devices and send the acquired data to a computer . A remarkable example is shown in physical rehabilitation, where the low-cost hardware and algorithms accomplish outstanding results in therapy of patients with mobility issues. A 3D motion input device is required for upper-body rehabilitation in virtual reality. The Leap motion controller, a GR input device, has been recently released, which monitors hand and finger movements and reflects them on the monitor . In addition, game-based virtual reality can be realized using a GR device, and various tasks can be presented.
Mirror therapy has been used as a therapeutic intervention for phantom pain in amputees. The painful and paralyzed body parts are covered with a mirror. The mirror is placed in the center of the body, and the movement of the paralyzed body is viewed through the mirror. The patient has a visual illusion that the paralyzed side is normally moving . Mirror therapy for stroke patients was reported to be effective in upper-extremity motor function and daily life activity performance . However, conventional mirror therapy methods require high concentration and can become tedious, making active participation difficult . In addition, conventional mirror therapy differs from the actual situation wherein a mirror positioned at the center of the body should be viewed with the head sideways. Because patients are in a suboptimal posture, they may have neck discomfort after mirror therapy. The body has muscle strength disproportion when maintaining poor posture for a long time. This results in inadequate tension on adjacent muscles and joints, resulting in movement restriction, reduced flexibility, pain, and changes in bone and soft tissue .
This study investigated the effect on upper-extremity motor function, quality of life, and neck discomfort by using GR device mirror therapy in patients with chronic stroke, and evaluated the efficacy of this technique.
[ARTICLE] FarMyo: A Serious Game for Hand and Wrist Rehabilitation Using a Low-Cost Electromyography Device – Full Text PDF
One of the strategies used in recent years to increase the commitment and motivation of patients undergoing rehabilitation is the use of graphical systems, such as virtual environments and serious games. In addition to contributing to the motivation, these systems can simulate real life activities and provide means to measure and assess user performance. The use of natural interaction devices, originally conceived for the game market, has allowed the development of low cost and minimally invasive rehabilitation systems. With the advent of natural interaction devices based on electromyography, the user’s electromyographic data can also be used to build these systems. This paper shows the development of a serious game focused on aiding the rehabilitation process of patients with hand motor problems, targeting to solve problems related to cost, adaptability and patient motivation in this type of application. The game uses an electromyography device to recognize the gestures being performed by the user. A gesture recognition system was developed to detect new gestures, complementing the device’s own recognition system, which is responsible for interpreting the signals. An initial evaluation of the game was conducted with professional physiotherapists.
[Abstract] Gesture Interaction and Augmented Reality based Hand Rehabilitation Supplementary System – IEEE Conference Publication
[ARTICLE] Modeling Based on Computational Intelligence for Physiotherapeutic Rehabilitation Games – Full Text PDF
Over the last years, the use of computational environments, like serious games, has been one of the strategies to improve commitment and motivation of patients undergoing rehabilitation. Beyond providing motivation, these systems are able to simulate life activities and provide means to automatically monitor users interactions, assuring that the patient is performing the exercises correctly, thus allowing the user to perform the exercises without the need of constant monitoring by a health professional. The aim of this work is to develop a modeling for construction of serious games, whose interaction is given by gestures performed by hand and wrist. The model includes an automatic continuous evaluation of rehabilitation exercises executed by the patient and dynamic game balancing using computational intelligence methods.