Posts Tagged games
Video games are constantly evolving and today they are one of the main types of entertainment. As we live in the digital age, the implementation of IT solutions in other areas of activity remains relevant. Today, almost all processes use IT technologies: calling a taxi, ordering food, education, shopping, and so on. The use of IT technologies in the field of medicine is not uncommon. But it’s not often that you see video games being used in this area. Video games and their development are an integral part of the IT sphere. The technologies that exist now allow us to create our own game products, which can then be implemented in other processes. This research is aimed at studying the term of “gamification”, its impact on rehabilitation processes, and the study of gamification tools and game products used in the field of medicine. In this research we propose a gamified solution for hand rehabilitation process which include 3D game that work in conjunction with the VR tool called Leap Motion. Since video games attract people with reward systems, goals and many other factors, why not to use it as a key element in process of rehabilitation? In some cases, it is more effective method rather than traditional therapy.
[ARTICLE] An Evidence-Based Intelligent Method for Upper-Limb Motor Assessment via a VR Training System on Stroke Rehabilitation – Full Text
Recently, virtual-reality (VR) has been an emerging technology, to this regard, it is widely employed by therapists to provide rich training tasks for the purpose of motor rehabilitation in clinics. Meanwhile, along with the progress of sensing technologies as means for the interaction with virtual environment, a large amount of data, such as motor trajectory, foot pressure or electromyography, is measured via VR-based motor training tasks and is considered as important clues for functional evaluations. However, very few study thoroughly applied the sensor-based data for motor assessment, instead, evaluation scales, such as TEMPA or Fugl-Meyer, were highly relied. In this study, a VR upper-limb motor training system was proposed for stroke rehabilitation. Clinical trials with 22 stroke patients were performed to exanimate the effectiveness of the propose VR system. Moreover, a variety of motor indicators derived via motion trajectory were proposed. Further, integrating multi-model data, such as motion trajectory, task performance and evaluation scales, machine-learning method was applied to develop evidence-based assessment models in order to evaluate upper-limb motor function. The results indicated that the proposed VR system was significantly effective for motor rehabilitation. Also, a few motor indicators were found significantly different between pre and post trials and were highly correlated with the evaluation scales. Finally, with the fusion of multi-model data, the accuracy rate of machine-learning assessment model was up to 92.72% which revealed its great potential for clinical use.
Stroke is one of the three leading causes of death in developed countries, accounting for about 10% of global death . Stroke is the leading cause of death and adult disability in the country, and the main disability burden in middle- and high-income countries . Traditional rehabilitation aims to stimulate the relevant nerve tissue of stroke patients through continuous motor training, thereby helping patients maintain the current strength of the body muscles, and restoring their ability for daily life as much as possible –. Moreover, it assesses the rehabilitation effects with evaluation scale. However, long-term motor training in regard to rehabilitation is boring and lacks real-time feedback. Further, mainstream evaluation scales, like FMA, WMFT, TEMPA, are subjective that require experienced therapists in assessing rehabilitation, which consumes a large amount of time and medical resources.
VR is a computer-based technology that allows users to interact with the simulated environments through multiple sensations and to have “real-time” feedback. Specifically, VR is able to generate a battery of training tasks targeting a variety of rehabilitation goals in the therapy. As a result, a large number of studies have been conducted on the impact of VR technology on motor rehabilitation –. Also, home-based VR motor training systems were proposed –. Further, a variety of gamed-based commercial devices, similar to VR characteristics, were promoted –. Results found that VR technology has significant effects on stroke rehabilitation training –. Moreover, the application of VR technology to stroke rehabilitation training can make the boring training process entertaining, thereby reducing the psychological burden of patients, and maintaining their long-term participation enthusiasm , . Also, it can highly handle the situation in which patients are unwilling to cooperate with traditional rehabilitation therapy . The patient’s training goals can also be adjusted according to physical conditions .
However, the efficacy of previous VR training systems were mostly examined by evaluation scales –, in spite that VR training systems were able to collect a huge amount of sensing data, such as motion trajectory, foot pressure or electromyography, which is considered as a kind of objective data. In a number of studies, the VR system was only used for motor training, and the objective training data collected by the system was not used as the basis for evaluation. The evaluation scale is mainly scored by the therapist, therefore, the data is considered as a kind of subjective data. Even though some studies – have intended to perform further analysis on sensing data in order to derive motor indicators to interpret the progress of motor functions, they did not discuss the correlation between proposed motor indicators and evaluation scales, lacking reliability and validity.
With the improvement of the computing power of computers, machine learning has been developed rapidly in recent years and is widely used in data mining, computer vision, natural language processing, etc. In medical diagnosis, some researchers use machine learning to analyze medical images and detect the patient’s status ; some researchers use supervised machine learning algorithms to classify patient movement data. Thereby judging the therapeutic effect of the diagnosis, with high accuracy –. However, these studies didn’t include evaluation scales in the machine learning model, instead, sensing data was solely used. Therefore, the proposed machine model lacked clinical references and wasn’t convincible from therapist perspective.
To address issues mentioned above, the research is composed of designing motor indicators based on VR data, exploring the scientific correlation between proposed motor indicators and evaluation scale, establishing evidence-based grading standards based on multi-dimensional evaluation scale data, and applying machine learning to establish a new data-driven assessment model.[…]
Hand rehabilitation is the process of recovering hand movements to return to normal. For rehabilitation to be effective, it is necessary for patients to practice repetitive movements. During the process, the patients usually feel bored, lack motivation and enjoyable time. There is a growing interest in building games for rehabilitation to make it more interesting and motivating for patients. However, the major obstacle is that the devices are expensive, and the patients must go to use them in hospitals. This paper focuses on designing and implementing hand rehabilitation software by using hand and fingertip detection. The purpose of the project is to make the rehabilitation process more accessible, enjoyable, affordable, and can be made portable for patients to use at home. Deep learning techniques were utilized to perform hand and fingertip detection. The SuperFox game is developed; the game is controlled by commands associated with hand and fingertip movements. The system was tested with 10 participants to evaluate effectiveness of the game controls. The results showed that the system is feasible in controlling the game and able to be used to create motivation and enjoyable time for patients.
[Abstract] Development of a Home-based Hand Rehabilitation Training and Compensation Feedback System
Stroke survivors often show a limited recovery in the hand function even after the recovery period (3-6 months after stroke) and at-home hand rehabilitation is common due to the long-term nature of hand rehabilitation and the limited medical resources. We designed a home-based hand rehabilitation training and compensation feedback system. A low-cost simple orthosis glove, a set of hand rehabilitation training games and a compensation detection and feedback module were designed and developed in this system. A preliminary test was carried out on the system and the results showed that the training section (the orthosis glove and the hand rehabilitation training games) of the system was friendly to the subjects and the subjects were more receptive to the system and the compensation detection and feedback module had a promising performance. This system can not only provide high intensity and incentive hand rehabilitation training, but also guide the stroke patients to correct wrong upper body postures during the training process, which can achieve better rehabilitation results. The system has the potential to become an effective home-based hand rehabilitation training and compensation feedback system.
[Abstract] Preliminary Results of Hand Rehabilitation for Post Stroke Patient using Leap Motion-based Virtual Reality
This paper introduced a rehabilitation system for the upper limb function of the post stroke patients who involved virtual reality games. Post- stroke patient is needed to perform rehabilitation to improve their hand and finger motion, which were affected from the stroke. Thus a virtual reality hand rehabilitation using Leap Motion sensor integrated with Unity software was developed, which focuses on the hand and finger movement of the patient. There are three games created namely Space game, Cannon game and Piano games in order to evaluate the performance of the users. Data from 10 normal subjects playing each virtual game in one minute has been collected and analysed. The results show that average values of objects can be destroyed by the normal people in Space game, Cannon game and Piano game is 9,23 and 20 respectively. Feedback has been received and these virtual reality games hopefully could facilitate the recovery of motor functions in stroke patients.
[Abstract] Attention Enhancement and Motion Assistance for Virtual Reality-Mediated Upper-limb Rehabilitation
Dysfunctions of upper limbs caused by diseases such as stroke result in difficulties in conducting day-to-day activities. Studies show that rehabilitation training using virtual reality games is helpful for patients to restore arm functions. It has been found that ensuring active patient participation and effort devoting in the process is very important to obtain better training results. This paper introduces a method to help patients increase their engagement and provide motion assistance in virtual reali-ty-mediated upper-limb rehabilitation training. Attention en-hancement and motion assistance is achieved through an illusion of virtual forces created by altering the drag speed between the cursor and the object presented on a screen to the patient as the only feedback. We present two game forms using the proposed method, including a target-approaching game and a maze-following game. The results of evaluation experiments with human participants showed that the proposed method could provide path guidance that significantly improved path-following performance of users and required more involvement of the users when compared to playing the game without attention enhance-ment and motion assistance.
[Abstract] Design and Implementation of An Interactive Hand Rehabilitation Training System Based on LabVIEW
With the development of science and technology in multidisciplinary fields of automation control, rehabilitation medicine and robotics and the improvement of people’s living standards, medical rehabilitation robots are playing an increasingly important role in life. The traditional hand rehabilitation robots are exoskeleton rigid robots with complex structure and small fault tolerance. It is dangerous for the rehabilitation of human finger joints, while soft wearable hand rehabilitation robots have better safety and flexibility. For the rehabilitation needs of stroke fingers, a virtual online game of human-computer interaction is developed using LabVIEW and a soft wearable hand rehabilitation robot, in order to improve the initiative of patients in the process of active rehabilitation training and to increase the interest of patients in active rehabilitation training, which also improves the initiative of patients to participate in active rehabilitation training.
[Abstract] Remote Monitoring of Physical Rehabilitation of Stroke Patients using IoT and Virtual Reality
The statistics highlights that physical rehabilitation are required nowadays by increased number of people that are affected by motor impairments caused by accidents or aging. Among the most common causes of disability in adults are strokes or cerebral palsy. To reduce the costs preserving the quality of services new solutions based on current technologies in the area of physiotherapy are emerging. The remote monitoring of physical training sessions could facilitate for physicians and physical therapists’ information about training outcome that may be useful to personalize the exercises helping the patients to achieve better rehabilitation results in short period of time process. This research work aims to apply physical rehabilitation monitoring combining Virtual Reality serious games and Wearable Sensor Network to improve the patient engagement during physical rehabilitation and evaluate their evolution. Serious games based on different scenarios of Virtual Reality, allows a patient with motor difficulties to perform exercises in a highly interactive and non-intrusive way, using a set of wearable devices, contributing to their motivational process of rehabilitation. The system implementation, system validation and experimental results are included in the paper.
[Abstract + References] A Virtual Reality Serious Game for Hand Rehabilitation Therapy – IEEE Conference Publication
The human hand is the body part most frequently injured in occupational accidents, accounting for one out of five emergency cases and often requiring surgery with subsequently long periods of rehabilitation. This paper proposes a Virtual Reality game to improve conventional physiotherapy in hand rehabilitation, focusing on resolving recurring limitations reported in most technological solutions to the problem, namely the limited diversity support of movements and exercises, complicated calibrations and exclusion of patients with open wounds or other disfigurements of the hand. The system was assessed by seven able-bodied participants using a semistructured interview targeting three evaluation categories: hardware usability, software usability and suggestions for improvement. A System Usability Score (SUS) of 84.3 and participants’ disposition to play the game confirm the potential of both the conceptual and technological approaches taken for the improvement of hand rehabilitation therapy.
1. A. Elnaggar and D. Reichardt, “Digitizing the Hand Rehabilitation Using Serious Games Methodology with User-Centered Design Approach”, 2016 International Conference on Computational Science and Computational Intelligence (CSCI), pp. 13-22, 2016. Show Context View Article Full Text: PDF (1150KB) Google Scholar
2. L. S. Robinson, M. Sarkies, T. Brown and L. O’Brien, “Direct indirect and intangible costs of acute hand and wrist injuries: A systematic review”, Injury, vol. 47, no. 12, pp. 2614-2626, Dec. 2016. Show Context CrossRef Google Scholar
3. D. Johnson, S. Deterding, K.-A. Kuhn, A. Staneva, S. Stoyanov and L. Hides, “Gamification for health and wellbeing: A systematic review of the literature”, Internet Interv., vol. 6, pp. 89-106, Nov. 2016. Show Context CrossRef Google Scholar
4. C. Prahm, “PlayBionic Interactive rehabilitation after amputation or nerve injury of the upper extremity”, Christian Doppler Laboratory for Restoration of Extremity Function and Rehabilitation, 2019. Show Context Google Scholar
6. D. Ganjiwale, R. Pathak, A. Dwivedi, J. Ganjiwale and S. Parekh, “Occupational therapy rehabilitation of industrial setup hand injury cases for functional independence using modified joystick in interactive computer gaming in Anand Gujarat”, Natl. J. Physiol. Pharm. Pharmacol., vol. 9, pp. 1, 2018. Show Context CrossRef Google Scholar
7. H. A. Hernández, A. Khan, L. Fay, Je.-S. Roy and E. Biddiss, “Force Resistance Training in Hand Grasp and Arm Therapy: Feasibility of a Low-Cost Videogame Controller”, Games Health J., vol. 7, no. 4, pp. 277-287, Aug. 2018. Show Context CrossRef Google Scholar
8. J. Broeren, L. Claesson, D. Goude, M. Rydmark and K. S. Sunnerhagen, “Virtual Rehabilitation in an Activity Centre for Community-Dwelling Persons with Stroke”, Cerebrovasc. Dis., vol. 26, no. 3, pp. 289-296, 2008. Show Context CrossRef Google Scholar
9. J. Broeren, M. Rydmark and K. S. Sunnerhagen, “Virtual reality and haptics as a training device for movement rehabilitation after stroke: A single-case study”, Arch. Phys. Med. Rehabil., vol. 85, no. 8, pp. 1247-1250, Aug. 2004. Show Context CrossRef Google Scholar
10. C. N. Walifio-Paniagua et al., “Effects of a Game-Based Virtual Reality Video Capture Training Program Plus Occupational Therapy on Manual Dexterity in Patients with Multiple Sclerosis: A Randomized Controlled Trial”, J. Healthc. Eng., vol. 2019, pp. 1-7, Apr. 2019. Show Context CrossRef Google Scholar
11. M. E. Gabyzon, B. Engel-Yeger, S. Tresser and S. Springer, “Using a virtual reality game to assess goal-directed hand movements in children: A pilot feasibility study”, Technol. Heal. Care, vol. 24, no. 1, pp. 11-19, Jan. 2016. Show Context CrossRef Google Scholar
12. M. King, L. Hale, A. Pekkari, M. Persson, M. Gregorsson and M. Nilsson, “An affordable computerised table-based exercise system for stroke survivors”, Disabil. Rehabil. Assist. Technol., vol. 5, no. 4, pp. 288-293, Jul. 2010. Show Context CrossRef Google Scholar
13. J. Shin et al., “Effects of virtual reality-based rehabilitation on distal upper extremity function and health-related quality of life: a single-blinded randomized controlled trial”, J. Neuroeng. Rehabil., vol. 13, no. 1, pp. 17, Dec. 2016. Show Context CrossRef Google Scholar
14. R. Lipovsky and H. A. Ferreira, “Hand therapist: A rehabilitation approach based on wearable technology and video gaming”, 2015 IEEE 4th Portuguese Meeting on Bioengineering (ENBENG), pp. 1-2, February 2015. Show Context View Article Full Text: PDF (1901KB) Google Scholar
15. C. Schuster-Amft et al., “Using mixed methods to evaluate efficacy and user expectations of a virtual reality-based training system for upper-limb recovery in patients after stroke: a study protocol for a randomised controlled trial”, Trials, vol. 15, no. 1, pp. 350, Dec. 2014. Show Context CrossRef Google Scholar
16. Y. A. Rahman, M. M. Hoque, K. I. Zinnah and I. M. Bokhary, “Helping-Hand: A data glove technology for rehabilitation of monoplegia patients”, 2014 9th International Forum on Strategic Technology (IFOST), pp. 199-204, 2014. Show Context View Article Full Text: PDF (625KB) Google Scholar
17. M. da Silva Cameirão, S. Bermúdez, I Badia, E. Duarte and P. F. M. J. Verschure, “Virtual reality based rehabilitation speeds up functional recovery of the upper extremities after stroke: A randomized controlled pilot study in the acute phase of stroke using the Rehabilitation Gaming System”, Restor. Neurol. Neurosci., vol. 29, no. 5, pp. 287-298, 2011. Show Context CrossRef Google Scholar
18. M. R. Golomb et al., “In-Home Virtual Reality Videogame Telerehabilitation in Adolescents With Hemiplegic Cerebral Palsy”, Arch. Phys. Med. Rehabil., vol. 91, no. 1, pp. 1-8, Jan. 2010. Show Context CrossRef Google Scholar
19. R. Proffitt, M. Sevick, C.-Y. Chang and B. Lange, “User-Centered Design of a Controller-Free Game for Hand Rehabilitation”, Games Health J., vol. 4, no. 4, pp. 259-264, Aug. 2015. Show Context CrossRef Google Scholar
20. N. Arman, E. Tarakci, D. Tarakci and O. Kasapcopur, “Effects of Video Games-Based Task-Oriented Activity Training (Xbox 360 Kinect) on Activity Performance and Participation in Patients with Juvenile Idiopathic Arthritis: A Randomized Clinical Trial”, Am. J. Phys. Med. Rehabil., vol. 98, no. 3, pp. 174-181, 2019. Show Context CrossRef Google Scholar
21. S. Cho, W.-S. Kim, N.-J. Paik and H. Bang, “Upper-Limb Function Assessment Using VBBTs for Stroke Patients”, IEEE Comput. Graph. Appl., vol. 36, no. 1, pp. 70-78, Jan. 2016. Show Context View Article Full Text: PDF (4692KB) Google Scholar
22. E. Tarakci, N. Arman, D. Tarakci and O. Kasapcopur, “Leap Motion Controller-based training for upper extremity rehabilitation in children and adolescents with physical disabilities: A randomized controlled trial”, J. Hand Ther., pp. 1-9, Apr. 2019. Show Context CrossRef Google Scholar
23. Y.-T. Wu, K.-H. Chen, S.-L. Ban, K.-Y. Tung and L.-R. Chen, “Evaluation of leap motion control for hand rehabilitation in burn patients: An experience in the dust explosion disaster in Formosa Fun Coast”, Burns, vol. 45, no. 1, pp. 157-164, Feb. 2019. Show Context CrossRef Google Scholar
24. T. Vanbellingen, S. J. Filius, T. Nyffeler and E. E. H. van Wegen, “Usability of Videogame- Based Dexterity Training in the Early Rehabilitation Phase of Stroke Patients: A Pilot Study”, Front. Neurol., vol. 8, no. DEC, pp. 1-9, Dec. 2017. Show Context CrossRef Google Scholar
25. M. Iosa et al., “Leap motion controlled videogame-based therapy for rehabilitation of elderly patients with subacute stroke: a feasibility pilot study”, Top. Stroke Rehabil., vol. 22, no. 4, pp. 306-316, Aug. 2015. Show Context CrossRef Google Scholar
26. A. M. D. C. Souza and S. R. Dos Santos, “Handcopter Game: A Video-Tracking Based Serious Game for the Treatment of Patients Suffering from Body Paralysis Caused by a Stroke”, 2012 14th Symposium on Virtual and Augmented Reality, pp. 201-209, 2012. Show Context View Article Full Text: PDF (795KB) Google Scholar
27. A. L. Borstad et al., “In-Home Delivery of Constraint-Induced Movement Therapy via Virtual Reality Gaming”, J. Patient-Centered Res. Rev., vol. 5, no. 1, pp. 6-17, Jan. 2018. Show Context CrossRef Google Scholar
28. N. J. Seo, J. Arun Kumar, P. Hur, V. Crocher, B. Motawar and K. Lakshminarayanan, “Usability evaluation of low-cost virtual reality hand and arm rehabilitation games”, J. Rehabil. Res. Dev., vol. 53, no. 3, pp. 321-334, Jul. 2016. Show Context CrossRef Google Scholar
29. G. C. Burdea, A. Jain, B. Rabin, R. Pellosie and M. Golomb, “Long-term hand tele-rehabilitation on the playstation 3: Benefits and challenges”, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 1835-1838, 2011. Show Context View Article Full Text: PDF (479KB) Google Scholar
30. M. R. Golomb, M. Barkat-Masih, B. Rabin, M. Abdelbaky, M. Huber and G. Burdea, “Eleven Months of home virtual reality telerehabilitation – Lessons learned”, 2009 Virtual Rehabilitation International Conference, pp. 23-28, 2009. Show Context View Article Full Text: PDF (1370KB) Google Scholar
31. X. Huang, F. Naghdy, G. Naghdy and H. Du, “Clinical effectiveness of combined virtual reality and robot assisted fine hand motion rehabilitation in subacute stroke patients”, 2017 International Conference on Rehabilitation Robotics (ICORR), pp. 511-515, 2017. Show Context View Article Full Text: PDF (1865KB) Google Scholar
32. G. Tieri, G. Morone, S. Paolucci and M. Iosa, “Virtual reality in cognitive and motor rehabilitation: facts fiction and fallacies”, Expert Rev. Med. Devices, vol. 15, no. 2, pp. 107-117, Feb. 2018. Show Context CrossRef Google Scholar
33. B. Garrett, T. Taverner, D. Gromala, G. Tao, E. Cordingley and C. Sun, “Virtual Reality Clinical Research: Promises and Challenges”, JMIR Serious Games, vol. 6, no. 4, pp. e10839, Oct. 2018. Show Context CrossRef Google Scholar
[Abstract] RehabFork: An Interactive Game-assisted Upper Limb Stroke Rehabilitation System – IEEE Conference Publication
In this paper, we present the design and development of a game-assisted stroke rehabilitation system RehabFork that allows a user to train their upper-limb to perform certain functions related to the task of eating.
The task of eating is divided into several components: (i) grasping the eating utensils such as a fork and knife; (ii) lifting the eating utensils; (iii) using the eating utensils to cut a piece of food; (iv) transferring the food to the mouth; and (v) chewing the food. The RehabFork supports the user through sub-tasks (i)–(iii).
The hardware components of RehabFork consist of an instrumented fork and knife, and a 3D printed pressure pad, that measure and communicate information on user performance to a gaming environment to render an integrated rehabilitation system.
The gaming environment consists of an interactive game that utilizes sensory data as well as user information about the severity of their disability and current level of progress to adjust the difficulty levels of the game to maintain user motivation. Information pertaining to the user, including performance data, is stored and can be shared with care providers for ongoing oversight.