(MP4 9.46 MB)
Posts Tagged augmented reality
LAS VEGAS, Jan. 8, 2019 /PRNewswire/ — She has a face, body and endearing personality. Meet Addison, a conversational speech interface including visual, Artificial Intelligence and ambient augmented reality, created by electronic caregiver™, a division of SameDay Security, Inc. Designed to transform the home into a fulltime health and wellness environment, Addison appears on 15-inch media screens throughout a residence and provides support to consumers with features including medication management, care plan adherence, social experiences and emergency response.
What began as a futuristic concept for Anthony Dohrmann, Founder and Chief Executive Officer of SameDay Security, Inc., quickly became reality with the design, innovation and creation of Addison Care™. “We wanted to give new life to voice-based virtual assistants in a way that dramatically expands the utility of voice platforms, while significantly enhancing the user experience. Addison will transform the way people interact with technology. She uniquely inspires a feeling of affection, helping people connect and better embrace their new tech,” Dohrmann said.
Built using Amazon Sumerian, a service provided by Amazon Web Services (AWS) that helps organizations create and run virtual reality (VR), augmented reality (AR), and 3D applications quickly and easily without requiring any specialized programming or 3D graphics expertise, the team at electronic caregiver™ was able to bring to life something others thought impossible. They sing the praises of Sumerian saying it changed the way and speed at which they were able to develop Addison. “Having a web-based platform like Sumerian that will host the complexity of artwork, skill and technology behind Addison has already set us apart,” says Joseph Baffoe, company President of SameDay Security, Inc. “What used to take us months or even years to create, now takes a matter of days. Amazon Sumerian has saved time and millions of dollars and can be credited with enabling us to create Addison.”
With the significant growth of the aging population, Addison has set her sights on creating an enjoyable user experience in the home, while also helping to shoulder some of the burden home healthcare is experiencing. High costs and low employee retention are two of the consistent pains in home healthcare. “10,000 people turn 65 every day and of the people needing home healthcare, only about 3% can afford it,” said Dohrmann. “We are encouraged that we will be the option these companies are able to provide to a prospective client who otherwise would have been turned away.”
Imagine a 3D, crystal clear health professional and personal assistant in your home. Though she lives with you, Addison is presented in stunning scenes and interactive environments that develop over time and are uniquely targeted to you and your needs. Her features, combined with just a one-hour set up time, will make Addison a staple in home technology. “Addison powered by Sumerian are cutting-edge interactive solutions that can transform home and healthcare. Addison Care represents a quantum leap forward in addressing the medical, financial, and social realities of an aging population and their caregivers,” stated Mark Francis, Head of Product Marketing for Amazon Sumerian, AWS.
Addison currently provides peace of mind with immediate response to emergencies. She monitors vitals via Bluetooth devices while also providing a demonstration. Addison assists with nutrition, weight loss goals, plans of care management, examinations and monitored medication reminders. She even assesses movement and changes in gait during your day-to-day activities to evaluate your risk of falling, all while working to check health status for trends of improvement or decline.
The future looks bright for Addison Care™ and the features that we can expect in the future. “People have always wondered what voice assistants might look like in the real world, and we’re going to show them at CES in January,” said Dohrmann. The company is actively applying features to provide a better user experience for accessing local business services, transportation, physician-on-demand and environmental information. “We want Addison to be the total package – including home healthcare, rehabilitation support, fitness programs, virtual companionship and social engagement with peers,” said Dohrmann. “Addison is already remarkable, but we’re going to continue innovating and researching to continuously create a superior in-home experience.”
In preparation for CES in Las Vegas, Nevada, new disclosures and websites are scheduled to go live in late December 2018. Until recently, most of Addison has been confidential.
Las Vegas, Nevada – Consumer Electronics Show; January 8-11, 2019
Booth: Sands Convention Center Halls A-D – 42142
About SameDay Security, Inc. and Electronic Caregiver
SameDay Security (SDS) is one of the fastest growing monitored technology providers in the U.S. and one of only a handful of nationwide service providers. Known as electronic caregiver™ and founded in 2009, SDS currently provides automated home care solutions and safety devices nationwide to thousands of clients. SDS has invested over $35,000,000 in patient screenings, research and development. SDS will disclose a new capital offering after CES to fuel new product launches and expansion. SDS has developing contracts with hundreds of home care partners across America who will participate in Addison Care™ marketing to their clients. New clinical trials are scheduled with G60 Trauma of Phoenix, Arizona, involving 500 patients over 3 years to determine the impact on patient outcomes, cost reduction, lower hospitalization, chronic disease management and long-term care. electronic caregiver™ employs over 70 employees and is headquartered in Las Cruces, New Mexico. www.electroniccaregiver.com
About Amazon Sumerian
Amazon Sumerian is a browser-based authoring tool from AWS designed to create and run for the development and publishing of AR, VR and 3D applications. Using Amazon Sumerian, developers and designers can build immersive apps quickly and easily without requiring any specialized programming or 3D graphics expertise. Experiences built with Sumerian are designed to be embedded into a web page or be consumed on popular hardware such as HTC Vive and HTC Vive Pro, as well as Android and iOS mobile devices. For more information, visit https://aws.amazon.com/sumerian.
SOURCE Electronic Caregiver
[Abstract + References] Training of Hand Rehabilitation Using Low Cost Exoskeleton and Vision-Based Game Interface
Motivating game-based training have the potential to improve therapy for people with neurological impairments. In recent years, the serious games have become extremely useful tools in rehabilitation field. They aim to stimulate the mobility of the body through an immersive experience that puts the user in interactive virtual environment. This paper is concerned about developing a customized augmented reality system for stroke rehabilitation. This will be done through integrating an interactive serious game interface with a hand exoskeleton device. This game-based rehabilitation system allows users to carry out physical rehabilitation therapies using a natural user interface based on Kinect’s skeletal tracking features and the electromyography (EMG) sensor. During game playing, the interactive user interface provides useful real-time feedback information such as the time required to grasp a desired dynamic virtual object, and the assigned score and thus the ability of the proposed system to provide a compensatory action regarding the dynamic behavior of the virtual target. The main goal of the developed virtual environment is to create positive influences on the rehabilitation process. Patient movement information and signals obtained from the developed exoskeleton device are used together to monitor the rehabilitation progress. The developed exoskeleton hand is a 3D printed low cost device suitable for grasping tasks that can be used even for domestic stroke patients. The developed exoskeleton device is not only a mechanical system able to perform the rehabilitation act but also it presents an effective tracking and traceability software solution. The EMG signals measured during hand motion are used to detect the intention of hand opening or closing which in turn will actuate the mechanical structure to accomplish the desired task. Parameters and results of patients’ exercises are stored and analyzed when needed to evaluate patients’ progress. The developed system is tested experimentally and it is able to restore the functions of the upper limb and mainly give patients more motivation to undergo the rehabilitation exercises.
1.Aguilar-Pereyra, J.F.: Design of a reconfigurable robotic system for flexoextension fitted to hand fingers size. In: Applied Bionics and Biomechanics (2016)Google Scholar
5.Benabdallah, I., Bouteraa, Y., Boucetta, R., Rekik, C.: Kinect-based computed torque control for lynxmotion robotic arm. In: 2015 7th International Conference on Modelling, Identification and Control (ICMIC), pp. 1–6 (2015)Google Scholar
7.Bouteraa, Y., Abdallah, I.B.: Exoskeleton robots for upper-limb rehabilitation. In: 2016 13th International Multi-conference on Systems, Signals Devices (SSD), pp. 1–6 (2016)Google Scholar
10.Bouteraa, Y., Ben Abdallah, I., Ghommam, J.: Task-space region-reaching control for medical robot manipulator. Ind. Robot: Int. J. 67, 629–645 (2018)Google Scholar
14.Chaudhary, A., Raheja, J.L., Das, K., Raheja, S., Intelligent approaches to interact with machines using hand gesture recognition in natural way: a survey. ArXiv e-prints (2013)Google Scholar
16.Cram, J.R., Kasman, G.S., Holtz, J.: Introduction to surface electromyography, 2nd edn. Jones and Bartlett Publishers, Sudbury (2010)Google Scholar
17.De Luca, C., Donald, L., Mikhail, K., Serge, H.: Filtering the surface emg signal: Movement artifact and baseline noise contamination. J. Biochem. 43(8), 1573–1579 (2010)Google Scholar
20.Gabriele, B., Sami, H., Alberto, S.: A critical analysis of a hand orthosis reverse engineering and 3d printing process. In: Applied Bionics and Biomechanics (2016)Google Scholar
21.Ho, N.S.K., Tong, K.Y., Hu, X.L., Fung, K.L., Wei, X.J., Rong, W., Susanto, E.A.: An emg-driven exoskeleton hand robotic training device on chronic stroke subjects: task training system for stroke rehabilitation. In: 2011 IEEE International Conference on Rehabilitation Robotics, pp. 1–5 (2011)Google Scholar
22.Hyesuk, K., Incheol, K.: Dynamic arm gesture recognition using spherical angle features and hidden markov models. In: Advances in Human-Computer Interaction (2015)Google Scholar
23.Zannatha, J.M.I., Tamayo, A.J.M., Sánchez, Á.D.G., Delgado, J.E.L., Cheu, L.E.R., Arévalo, W.A.S.: Development of a system based on 3D vision, interactive virtual environments, ergonometric signals and a humanoid for stroke rehabilitation. Comput. Methods Programs Biomed. 112(2), 239–249 (2013)CrossRefGoogle Scholar
25.Ismail, B.A., Yassine, B., Chokri, R.: Kinect-based sliding mode control for lynxmotion robotic arm. Adv. Human-Comput. Interact. 7921295:1–7921295:10 (2016)Google Scholar
26.Kiguchi, K.: A study on emg-based human motion prediction for power assist exoskeletons. In: International Symposium on Computational Intelligence in Robotics and Automation, pp. 190–195 (2007)Google Scholar
29.Kwon, J.S., Park, M.J., Yoon, I.J., Park, S.H.: Effects of virtual reality on upper extremity function and activities of daily living performance in acute stroke: a double-blind randomized clinical trial. NeuroRehabilitation 31, 379–85 (2012)Google Scholar
30.Le, C.H., Vander Sloten, J., Hung, L.T., Khanh, L., Soe, S., Zlatov, N., Phuoc, L., Trung, D.P.: Medical reverse engineering applications and methods. In: 2nd International Conference on Innovations, Recent Trends and Challenges in Mechatronics, Mechanical Engineering and New High-Tech Products Development, MECAHITECH, pp. 232–246 (2010)Google Scholar
40.Prochnow, D., Bermúdez i Badia, S., Schmidt, J., Duff, A., Brunheim, S., Kleiser, R., Seitz, R.J., Verschure, P.F.: A functional magnetic resonance imaging study of visuomotor processing in a virtual reality-based paradigm: rehabilitation gaming system. Eur. J. Neurosci. 37, 1441–1447 (2013)CrossRefGoogle Scholar
41.Ferguson, P.W., Dimapasoc, B., Shen, Y., Rosen, J.: Design of a hand exoskeleton for use with upper limb exoskeletons. In: International Symposium on Wearable Robotics, pp. 276–280. Springer, Cham (2018)Google Scholar
44.Takahashi, C.D., Der-Yeghiaian, L., Le, V., Motiwala, R.R., Cramer, S.C.: Robot-based hand motor therapy after stroke. Brain 131(2), 425–437 (2008)Google Scholar
46.Zhang, X., Yue, Z., Wang, J.: Robotics in lower-limb rehabilitation after stroke. Behav. Neurol. 2017, 13 (2017). Article ID 3731802Google Scholar
47.Yasemin, C., Abdullah, Y., Mihriban, Y., Ayse Esra, K., Gokhan, K., Alpaslan, G., Gul, G., Huseyin, U., Meliha, K.: Evaluation of invasive and noninvasive methods for the diagnosis of helicobacter pylori infection. Asian Pac. J. Cancer Prev.: APJCP: APJCP 17(12), 5265–5272 (2016)Google Scholar
[Abstract] Gesture Interaction and Augmented Reality based Hand Rehabilitation Supplementary System – IEEE Conference Publication
PHOENIX, Dec. 7, 2018 /PRNewswire/ — Virtual Caregiving is set to enter both the healthcare industry and patient home settings. In January 2019, G60 Trauma (G60Trauma.org) will begin testing Addison Care, the world’s first, comprehensive virtual caregiving system to provide real time, 24/7 patient monitoring and care.
Addison Care provides exciting new components to an interactive voice platform to demonstrate an interactive, augmented reality feature tied to visual sensing and connected home devices. Now, not only can you have a two-way conversation with an Electronic Caregiver, but the technology comes alive with an expertly designed augmented reality character named Addison, developed on AWS Sumerian. Addison provides a breakthrough user interface.
What can Addison do? In a clinical setting, Addison can greet a patient, recognized through facial recognition, conduct a verbal health examination, collect vitals, and even direct a comprehensive gait and balance session to determine the probability of a ground level fall in a particular patient. In the residential environment, Addison provides medication reminders, verifies medication consumption, provides medical test reminders, monitors vitals, demonstrates rehabilitation exercises, assesses a patient’s progress, mood, fall risk and responses to escalating conditions and emergencies including contacting responders or caregivers in time of patient need.
How does Addison work? A network of wireless visual sensors, local AI (artificial intelligence)-based processors, interactive tablets, Bluetooth biometric devices and emergency monitoring devices will be setup in a residence. Addison Care will be marketed and supported by a network of nationwide private duty home care providers that will serve as both live caregivers and Addison Care representatives. CEO of SDS, Anthony Dohrmann said, “Our goal is to expand affordable population health careto the masses, while lightening the burden on providers and payers. We are delivering an exciting new form of technology to patients and the active aging to improve their quality of life and health outcomes.” Addison will be making its debut at the Las Vegas Consumer Electronics Show January 8-11, 2019, Booth: Sands Convention Center Halls A-D – 42142.
Why partner with G60 Trauma Organization? Dr. Alicia Mangram, founder of G60 Trauma in Phoenix, Arizona, is a surgeon and acclaimed trauma specialist who has devoted her career to improving trauma care through advocacy, surgical and critical care research, education and community services. G60 Trauma is a specialized care program designed for trauma patients over the age of 60, with the goal of optimizing their recovery and safely discharging them back to their homes. This partnership will allow us to study hundreds of patients who have had a ground level fall and provide us with the data and information we need to continue producing products and services geared toward prevention and superior outcomes.
With an expert research team of professionals behind hundreds of successful research publications and processes, G60 Trauma team will be conducting an expansive study involving over 500 patients to document the effectiveness of Addison Care and Electronic Caregiver on improving patient outcomes, increasing patient and family satisfaction, reducing hospital readmission and reducing mortalities. Also, improving treatment adherence with the hope of validating a more effective, outcome based, continuum of care capable of reducing the long-term pressures and costs associated with long-term care and chronic disease management.
“The costs of treatment non-adherence have been reported to be as high as $300B annually and is noted as being responsible for 50% of all treatment failures. In a period of nursing and physician shortages, where home care is inadequate in frequency partly due to high cost, our hope is that Addison Care and Electronic Caregiver can fill the gap in patient care and bring better outcomes to the masses,” Dr. Alicia Mangram stated.
About SameDay Security, Inc. and Electronic Caregiver
SameDay Security (SDS) is one of the fastest growing monitored technology providers in the U.S. and one of only a handful of nationwide service providers. Known as the Electronic Caregiver CompanyTM and founded in 2009, SDS currently provides automated home care solutions and safety devices nationwide to thousands of clients. SDS has invested over $35,000,000 in patient screenings, research and development. SDS will disclose a new capital offering after CES to fuel new product launches and expansion. SDS has developing contracts with hundreds of home care partners across America who will participate in Addison Care marketing to their clients. New clinical trials are scheduled with G60 Trauma of Phoenix, Arizona, involving 500 patients over 3 years to determine the impact on patient outcomes, cost reduction, lower hospitalization, chronic disease management and long-term care. Electronic Caregiver employs over 70 employees and is headquartered in Las Cruces, New Mexico. www.electroniccaregiver.com
G60 is a specialized trauma care program developed by Dr. Alicia Mangram. Since 2009, Dr. Mangram has devoted her career to improving trauma care through advocacy, surgical and critical care research, education and community services. In the beginning of her career, she quickly realized that a traumatic injury in patients 60 years and older could occur from a simple fall resulting in a hip fracture. The traditional approach was to admit them to a medical facility and await medical clearance for pre-existing conditions such as diabetes, heart disease, etc. prior to any surgery.
While patients waited for medical clearance, other medical related complications could develop. Recognizing the cause of these complications lead to a paradigm shift and implementing an aggressive care approach for our G60 population. Through evidence-based research, Dr. Mangram and her team developed a care plan to address the needs of G60 trauma patients. These care plans achieved several goals, such as: Expedited early identification in the ER, admission to trauma service, alternative pain management modalities, for example, hip block, multidisciplinary care rounds with integration of the Biopsychosocial Model, evaluation of care approach through research and data analysis, achievement of optimal level of functioning and independence upon discharge.
View original content to download multimedia:https://www.prnewswire.com/news-releases/electronic-caregiver-enters-clinical-trials-with-g60traumaorg-300762135.html
SOURCE Electronic Caregiver
It looks like Mark Priest is walking down the hall using arm crutches, but from his perspective, he says “I’m trying to chase Pac man. Keep my head steady, keep a nice cadence.”
Priest is putting the visor technology to the test. “The concept is to improve my gait and my stride by keeping a certain speed.”
The technology he is using could revolutionize the way people with catastrophic injuries are helped.
“I have a spinal cord injury at level T-9 and T-12 of the vertebrae,” Priest explained.
The Inspire Lab, headed by Doctor Randy Trumbower, focuses on helping people move again. This year, his team of scientists created a new technology using augmented reality.
Trumbower said, “Augmented reality is a mix between what’s real and what’s not real…It’s a game changer for sure.”
That means computer generated images are superimposed over the real environment. For example, a patient can follow a Pac man around the room at changing speeds.
“Different grades, steps, obstacles, things that you maybe wouldn’t experience in a traditional therapy setting,” said Preist.
It also means that this therapy can be targeted. “The thing that is attractive about this particular technology is that it extends those benefits in a way that is more personalized,” said Trumbower.
And ultimately it allows a patient to use that technology anywhere.
Priest said, “My goal is to improve my walking and get off the use of Loftstrand crutches and just be more independent in my day to day living.”
While Priest can only use the visor for short periods, he has still seen improvements. Friday was the first time he tried it without crutches.
“I’m really excited to see the advancement of this technology and how it can help.”
The lab is still in the early stages with the technology, but the promise is there and the work continues.
Virtual reality (VR) and augmented reality (AR) technologies are still at an early stage, but both could have significant benefits for the NHS.
Healthcare organisations could be spending as much as $5bn globally on AR and VR by 2025 according to one prediction, with potential applications ranging from surgical simulation and diagnostic imaging to patient care and rehabilitation. VR headsets — like the Oculus Rift or HTC Vive — offer a fully immersive experience while AR headsets — like Microsoft HoloLens or Magic Leap — allow you to overlay virtual objects onto the real world to create a mixed-reality experience. Both options are being explored by doctors around the world.
And while countries with private healthcare systems are leading the way in VR adoption, countries dominated by publicly-funded healthcare are also exploring these technologies.
Surgeons in Poland have already demonstrated how Google Glass could be used to help plan heart procedures, and now NHS clinicians are following suit. Microsoft’s HoloLens has been used to help surgeons plan operations: for example, surgeons at Alder Hey hospital in Liverpool hope to use it to visualise patients’ scans during procedures, while three surgeons in three separate UK hospitals have used it for bowel cancer surgery.
A team of surgeons at Queen Mary’s Hospital have also been experimenting with wearing HoloLens headsets during surgery, overlaying a map of the patient’s anatomy — showing the path of blood vessels and the course of muscle groups — onto them during surgery. The map is created using CT scans of the patient, and allows the surgeons to navigate away from important structures during surgery. “There’s a lot of activity in this area now these types of devices are readily and commercially available,” says Philip Pratt, research fellow in the department of Surgery & Cancer at Imperial College London.
For example, surgeons who can visualise anatomy using the headsets can more easily avoid sensitive structures when making incisions, potentially reducing the time it takes for the patient to heal and therefore the time they spend in hospital, and similarly reduce the need for any secondary or corrective surgery.
Training up future doctors could also be a growth area for VR. While universities, rather than the NHS, are charged with training medical students, the vast majority of graduates from UK medical schools will go on to work in the NHS, and so their degrees are designed to fit the needs of the health service. Once qualified, junior doctors still receive significant amounts of training within their NHS hospital placements too.
There are already a handful of proof-of-concept anatomy teaching modules that use AR. One medical school in the US is planning to do away with its anatomy lab altogether in favour of using HoloLens.
And for junior doctors — those undertaking training in a medical speciality such as general surgery, psychiatry, or respiratory medicine — VR is likely to have an even greater role in their future training, helping them learn how to perform new procedures in a virtual hospital and even experience them from the patient’s point of view to help improve their communication skills. NASA has even considered using AR headsets to help astronauts conduct medical examinations aboard the International Space Station.
VR and AR won’t just be doctors’ tools, however: early experiments are showing that patients too could be seeing more virtual reality headsets in their future.
Companies like Oxford VR have been trialling the use of VR technology to help mental health patients. The University of Oxford spinout has been using simulated environments and a virtual coach to help people tackle their fear of heights.
The National Institute of Health Research is funding Oxford VR to the tune of £4m to develop a VR therapy package for patients with psychosis; it is also working on a package for young people with social anxiety. Commercial VR headsets are combined with custom software to create virtual versions of the environments that patients would typically find difficult, allowing them to explore those situations safely and, eventually, become comfortable with them. The NIHR said it believes the funding will help create a VR product that will be taken up by the NHS.
VR therapy has also been tested at King’s College and the South London and Maudsley trustfor improving auditory hallucinations in people with schizophrenia, and to help families affected by the Grenfell fire.
There have also been signs that virtual reality could be used for neurological, as well as psychiatric, conditions. Traumatic brain injury can leave people severely disabled, and can require intensive rehabilitation before they’re able to perform their day-to-day activities unassisted. It’s thought VR could be used for both assessing and treating traumatic brain injury. For example, avatars in VR have been used to assess patients’ higher brain functions or detect cognitive problems, while virtual kitchens have helped healthcare professionals assess how people with traumatic brain injury can undertake normal daily activities. VR has also been used to improve balance or attention after traumatic brain injury.
SEE: Executive’s guide to the business value of VR and AR (free ebook)
For now, however, most use of VR as a treatment tool is very much in the pilot stage, offered to relatively few people; larger trials with hundreds of participants would be needed before it would be possible to assess the benefits of such treatments for the population as a whole.
It’s worth remembering that even outside of the healthcare space VR and AR are at an early stage; the hardware is still cumbersome, the applications still evolving, and the pricing still way too high. As the general market evolves, ways to apply the technology to the NHS may become clearer. Sectors such as retail, for example, where spending on new technology is less constrained, will potentially act as examples of how the technology can be used in the healthcare.
“When I see AR or VR in the retail environment, I think it’s almost desensitising some of the use cases that the NHS can then take a more bold step towards,” Andrew Finlayson, managing director of Accenture Interactive, told ZDNet.
“I do think the more that gaming and those techniques are becoming popular, the more that those companies will make their technologies more accessible to the wider populace, and they will either drop the price or they will subsidise the headsets — make them cheaper so they can sell more games, or telecoms or media. I think gaming is bringing down some of the cost and accessibility that would allow more virtual and augmented reality [in the NHS].”
The success of AR and VR has been just around the corner for decades, but if the most recent crop of headsets proved a success with consumers and business, expect to see a lot more use of such technologies in the NHS in the near future.
[Thesis] Designing an augmented reality video game to assist stroke patients with independent rehabilitation
Israeli companies are using futuristic technologies to simplify complex surgery, manage rehab, relieve pain, soothe autistic kids and much more.
Spine and heart surgeons will use augmented reality (AR) to simplify complex procedures. Autistic children will get relief from sensory overload with a calming virtual reality (VR) system.
These and other scenarios are made possible by Israeli innovations tapping into the tremendous potential of AR and VR for healing and wellbeing.
The methods are similar: AR superimposes static and moving images to enhance an actual environment, while VR immerses the viewer in a simulated three-dimensional environment.
“Israel is on the frontlines in some areas of this technology,” says Orit Elion, a professor of physical therapy at Israel’s Ariel University, which hosted a conference last year to strengthen cooperation between AR and VR developers and researchers for health applications.
Elion helped develop a VR-based tele-rehab service at the Gertner Institute of Chaim Sheba Medical Center in Tel Hashomer, now used across Israel to enable monitored home physical or occupational therapy sessions for patients living far from healthcare centers.
“There aren’t so many programs in the world like this — a service that has no geographic boundaries,” Elion tells ISRAEL21c.
Currently, she is investigating how VR training can help with balance and fall prevention in the elderly. “VR is a dream for that, because you can manipulate the environment with all kinds of visual input,” she says.
Here are other examples of Israeli AR and VR in the health sector.
Surgical Theater makes a portfolio of VR products based on the notion that surgeons could train for complex procedures much like the Israeli founders of the company trained for Israel Air Force missions. Neurosurgeons at major medical centers and academic institutions in the United States and elsewhere are utilizing Surgical Theater’s VR medical visualization platforms for surgical planning and navigation, patient education and engagement, and training surgical residents.
In the first quarter of 2018, RealView Imaging will release its long-awaited HOLOSCOPE-i, designed to deliver live, in-air 3D holographic visualizations during interventional cardiology procedures.
Powered by the Intel RealSense SR300-Series camera based on RealView’s proprietary digital light shaping technology, HOLOSCOPE-i is the first commercial system allowing clinicians full and direct control of 3D images in real time. Surgeons can rotate, zoom, slice, mark and measure within the floating holograms.
Coming next from RealView Imaging are HOLOSCOPE-x for visualization of holograms inside the patient during interventional oncology procedures, and a holographic headset for non-medical professional applications.
Augmedics develops xvision, an AR head-mounted display for spine surgery that allows surgeons to see the patient’s anatomy through skin and tissue, as if they had “x-ray vision.” The system can project the patient’s anatomy, in real time, directly onto the surgeon’s retina, with the aim of increasing safety in surgery, reducing x-ray radiation and facilitating minimally invasive procedures.
Using xvision, surgeons will be able to visually and accurately track all their surgical instruments well within their field of vision as they work. A combination of proprietary tracking algorithms, hardware, software, an image data merging unit, and specialized instruments guide the surgeon through the operating site during major and minor procedures.
The xvision system will also utilize sensors to collect surgical information, which, when connected to a big data system, will analyze and process the data, using profound learning algorithms to provide alerts and suggestions to assist the surgeon during the procedure.
Augmedics has already performed pre-clinical cadaver trials in the US and EU. The company will start clinical studies in Q2 2018 in Israel, and later this year at the Johns Hopkins Hospital in Baltimore, Maryland.
Using VR goggles, the Calma system immerses an autistic child in a simulated underwater scene filled with corals, colorful fish, bubbles and divers.
“Children on the autism spectrum typically suffer from sensory moderation disorder, traditionally treated in a ‘white room’ where various objects are gradually introduced. This is costly and not always readily available. Our initiative simulates the white room with VR,” says Dan Kohen-Vacs, a senior computer science researcher at Holon Institute of Technology (HIT), where Calma was invented by students last year.
A management console allows the therapist to add, moderate or remove stimulants (including music) in response to the reaction of the child in real time. The goal is to train the child’s sensory regulation system to better handle auditory and visual stimulants and achieve emotional balance.
“We are completing the first proof-of-concept version and testing it in the Dekalim school in Jerusalem,” Kohen-Vacs tells ISRAEL21c. HIT’s tech-transfer company will work on commercializing the system.
“The plan is to expand to other locations. It may be possible to enable parents to use the system at home. You just need a smartphone and something like Google Cardboard that enables you to put the phone in it and wear it as headset,” says Kohen-Vacs.
Amit Bar-Tov, an occupational therapist at Dekalim, told Globes that the Calma pilot met with “great enthusiasm among the students for emotional regulation and sensory regulation, an improvement in learning capabilities, and a better connection with the environment.”
Prof. Josef Haik, director of Sheba Medical Center’s Burn Center, has been using VR for more than a decade as a bedside tool to ease the painful process of rehabilitation from severe burns.
“It’s all about early mobilization and rehabilitation, getting back to the tasks of everyday life,” Haik tells ISRAEL21c.
In 2004, Sheba installed a large Computer Assisted Rehabilitation Environment (CAREN) system in a pioneering move toward VR in treatment and rehab. Burn patients couldn’t be moved to the CAREN room so Haik came up with an inexpensive portable alternative using EyeToy, a digital camera device for PlayStation. Today he’s using Kinect with games devised for patients with certain disabilities.
VR gaming therapy offer several advantages, says Haik: The games distract patients and thereby lessen their pain perception; allow patients to adapt to seeing and accepting the look of the scarred area of their body onscreen; and use rewards such as points to encourage continuation of therapy. Moreover, the patient does not have to wear or touch anything, eliminating any risk of cross infection.
Haik reported on the therapy in a 2006 study and has presented his approach to the American Burn Association and other associations around the world.
Stroke and traumatic brain injury
The SeeMe VR rehab system was developed by physiotherapists at Beit Rivka Geriatric Rehabilitation Hospital in Petah Tikva in cooperation with Brontes Processing of Poland for stroke or traumatic brain injury patients.
It has been on the market since 2009, making it the first commercial VR system of its kind.
SeeMe’s technology transmits images to the patient’s computer via a Kinect controller or standard web camera and immerses the patient in a customized computer game requiring specific exercises set by the therapist.
The clinician can use the system to evaluate strength, endurance, range of motion, postural control, reaction time, proprioception, quality of movement, perception, divided attention and memory.
Parkinson’s disease and multiple sclerosis
Studies by scientists from the Technion-Israel Institute of Technology, Tel Aviv Medical Center and Tel Aviv University over the past decade have shown that incorporating VR headsets in gait training improved the walking abilities of people with multiple sclerosis and reduced fall risk in Parkinson’s patients. The latest study, published in Neurology in September, found that VR training actually modifies brain activation patterns in Parkinson’s patients.
PT and pain relief
Caesarea-based Motorika Medical’s ReoAmbulator robotic gait-training device helps adults and children improve walking, balance, coordination, posture or stamina while focusing on accomplishing VR tasks to improve motor or cognitive function including memory and selective attention. Combining these tasks in one session is meant to add a higher degree of challenge leading to better results. On the market since 2014, ReoAmbulator is used in two countries in Asia, five in Europe and in the United States — around 30 installations so far.
VRHealth of Tel Aviv and Boston is partnering with major players including Oculus, HTC and Microsoft to launch the first cross-platform-compatible VR medical application for rehab.
“We believe we are the only medical device company using an immersive headset as certified medical software,” founder Eran Orr tells ISRAEL21c. “What makes it a medical device is how you keep the data encrypted, how you can integrate electronic medical records and whether there is a billable insurance code for physicians to use. There is quality assurance and documentation for every app we are developing.”
VRHealth’s flagship VRPhysio software applications – two for neck therapy and one for shoulder therapy – got FDA clearance and are being implemented first in Spaulding Rehabilitation Hospital and Beth Israel Deaconess Medical Center in Boston. CE approval for Europe is expected soon.
VRHealth plans to launch additional products within a year: VRCoordi, which will work with VRPhysio to improve coordination skills, initially of children with developmental coordination disorder and various levels of autism; VRCogni to improve cognitive function in stroke, Alzheimer’s, concussion, Parkinson’s and dementia patients; VRReliever to manages chronic and severe pain through distraction; VRPsyc to enhances treatment for diagnosable mental disorders including general stress, phobias and anxieties, eating disorders, and PTSD.
“I hope our company will make a difference in the entire healthcare sector — every hospital, nursing home and assisted living — because VR can make a huge difference in many fields,” says Orr.
“I think Israel has a lot of potential in this technology because of the quality of engineers and developers able to develop products at a rapid pace and to be first to market and expand from there. That’s why we maintain our R&D in Israel.”
[WEB SITE] Augmented and virtual reality will involve human senses in verifying the operations of information systems — ScienceDaily
Many new applications aim to make information systems and machines identify their users and take their individual needs and emotions into account. VTT Technical Research Centre of Finland Ltd studied how ordinary consumers could reliably verify the operation of systems by using human senses.
In the future, machines and AI systems will have a deeper understanding of the actions of their human users. Even now, AI is able to generate an image of what a human is watching on the screen just by recording brain activity or deduce the emotions of people from microexpressions taken from their faces.
In the Human Verifiable Computing project, VTT used augmented and virtual reality to develop solutions for building trust between people and systems and facilitating the verification of information security. This is a vital aspect of the digital future, in which interaction between people and computers will be an effortless part of everyday life. “Augmented and virtual reality technologies let us make fuller use of our senses and enable the constant mutual evaluation of reliability between humans and machines,” says Senior Scientist Kimmo Halunen of VTT.
Making cryptographically verifiable computing available to human users was a key part of the project.
The project demonstrated functionalities involving computing verified with human senses. For example, augmented reality was utilized to distribute single-use passwords, which could then be used through voice recognition. Augmented reality was also utilized to give multisensory feedback by showing visual instructions to a maintenance worker who turns a valve and receives an error message if the valve is operated incorrectly. The message can be implemented as an interactive image and also presented through audio on the user’s smart glasses. In addition, haptic feedback can be provided by making the user’s smart watch or other mobile device vibrate.
The results of the project indicate that the basic technology required for the verification of computing with the human senses is already available. The combination of augmented reality and safety information will also enable new services. Current cryptographic methods and protocols are nearly always applied to communication between machines. Including the user in the interaction will nevertheless require more research and system and application development, as well as more study of human behaviour.