Skip to main content

Augmented reality comes to neurosurgery with tech developed by Leica

Virtual Reality Technology in the Operating Room
Augmented reality isn’t just for catching Pokémon anymore. A new technology from Leica Microsystems uses “image injection” to display virtual overlays within a surgical microscope to help guide a neurosurgeon’s hands. It was recently used by Dr. Joshua Bederson of Mount Sinai Health System in New York to treat a patient with an aneurysm.

Bederson worked closely with Leica and Brainlab, the company that makes the software, to develop the tool. He is now using it all of his cases, according to a statement released by Mount Sinai. Called CaptiView, the system links image-guided surgery (IGS) software to the microscope hardware itself, laying down critical visual information (such as images from a brain scan) directly on top of a patient’s brain. Both two- and three-dimensional images can be injected.

The software is smart enough to track both the position of the microscope as well as the focal point of the eyepieces, updating in real time as the surgeon works. “That means the microscope knows where I am looking,” Bederson says in the above video from Mount Sinai. “You operate with far greater confidence and visual and spatial awareness.”

Bederson likens CaptiView to using a GPS when driving. It provides real-time navigational assistance that can make a procedure more efficient and and even safer. Like switching from satellite to map view, operators can also toggle between the live feed and preoperative images.

While IGS software isn’t new, the ability to see all pertinent information in a heads-up display directly through the microscope could be a game changer for neurosurgery. “The brain has a very complicated anatomy,” Bederson explains. “The more we can bring technology into that very critical environment, I think the better we’ll be.”

Editors' Recommendations

Daven Mathies
Former Digital Trends Contributor
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
The Future of Vision: Augmented reality contact lenses will make you bionic
A contact lens from Mojo Vision promises augmented reality

Augmented reality contact lenses have been "around the corner" for years. They're finally set to arrive. Mojo Vision

Technology is reshaping every aspect of our lives. Once a week in The Future of series, we examine innovations in important fields, from farming to transportation, and what they will mean in the years and decades to come. 

Read more
Spatial is what would happen if Slack and Zoom had a virtual reality baby
Spatial

Spatial is the New Virtual Office | Oculus for Business

When it comes to communication mediums that let you clearly express yourself, emails are generally better than text messages, phone calls are better than emails, and Zoom-style video calls are better than phone calls. Could virtual reality be better than a video call?

Read more
Bose pulls the plug on its audio-based augmented reality platform
Bose Alto AR sunglasses

Two years after debuting its prototype augmented reality glasses, Bose is stepping away from its efforts to bring augmented reality to your ears. Key Bose AR employees have left the company, according to a report by Protocol, and Bose's AR partners have been informed that their apps will stop working in the coming weeks.

The decision comes six months after the company announced it would close all of its U.S. retail store locations and move its entire sales operation online.

Read more