Skip to main content

Practice makes perfect: How VR is revolutionizing surgical training

PrecisionOS

When it comes to hospitals, so far in 2020 the biggest concern has been about them being totally overloaded due to the effects of the coronavirus pandemic. Images circulating online have shown exhausted medical staff, faces reddened and blotchy after long days wearing PPE masks and visors. Even without crises like the predicted shortage of ventilators in some places, most of us expect that hospital staff are busier than ever with patients right now.

It’s absolutely right to think that. Many of them are. But there are also scenarios in which medical professionals don’t have enough opportunity to ply their craft. One of those is training for surgical procedures.

Surgery residents have long been getting less hands-on experience than they would like. After completing residency, a large number say that they do not feel ready to perform core procedures independently. Since practice makes perfect, that’s not great news — and it could only be threatened further by coronavirus-induced social distancing, shuttering medical schools and causing many elective surgeries to be pushed back or put on hold.

Could virtual reality help?

Training the next generation

That’s the idea of Dr. Danny Goel, a surgeon based in Vancouver, BC, Canada. Goel is also the CEO and co-founder of a company called PrecisionOS, which makes VR surgical training tools for those who need them. They can be used for upskilling existing surgeons or allowing them to maintain their high level of skill. Alternatively they can help train the next generation of surgeons and medical professionals so that they’re ready — and practiced — to save lives when the time comes.

PrecisionOS

“Outside of direct patient care, a current solution has yet to be implemented for low risk, yet highly impactful and efficient [education of] surgeons, trainees, and other health care providers on a global scale,” Goel told Digital Trends. “The current models are limited in access and utility. Virtual reality training and education permits the end-user to make decisions while realizing the impact of those decisions. This will serve as a tool for assessment and provides greater insight on how we may improve as a global medical community.”

PrecisionOS wasn’t developed with the current coronavirus pandemic in mind. Unless you’re a company founded in the past few months, no business imagined the way that COVID-19 would change the habits and way of life of large quantities of people. But it nonetheless reflects a change that has only been becoming more prominent in recent years.

The idea was to find a way to allow trainees to practice procedures over and over without exposing patients to risk. Cadavers are an alternative for this kind of training, although they are frequently in short supply — and, when they are available, can only be practiced on in certain contexts.

The VR-tuous circle of value

Previous studies have shown that the highest volume surgeries typically yield the best outcomes for patients. Low volume surgeries, by comparison, can mean increased complications, longer periods of time spent in the operating room, and higher costs. This is sometimes referred to as the “virtuous circle of value,” whereby greater patient volume and, therefore, practice means more rapidly accumulated experience, which translates into better results.

A gamified virtual reality system like the one that PrecisionOS has developed poses one high-tech answer. “All surgical procedures can be simulated [with our software],” Goel said. “The only hardware that is required is a standalone and untethered headset. Currently we are using the Oculus Quest. All the information is available on this hardware, which can be used anywhere at any time.”

PrecisionOS

The procedures themselves are carried out using generic VR controllers. While that might not be perfect for fine-grain practice (other VR training systems include specialist controllers, although they can only simulate a limited number of procedures as a result), it’s still enough for people to get to grips with particular operations.

PrecisionOS’s VR setup allows users to both get some one-on-one practice carrying out procedures, as well as working together in a group, via a multiplayer feature. This enables various avatars to carry out virtual sessions together — even when “together” might mean in entirely different locations.

“In my opinion, this technology is a major disruption of education and learning in surgery,” Goel said. “We are not digitizing our current model of training, but are challenging it through layers of depth and complexity.”

The PrecisionOS system is already being used by several training programs and institutions. Goel said that the “most integrated” use of the technology has been at the University of Connecticut, which has been using the system for the past few months. “We have since rolled out to many others, including the Mayo Clinic,” Goel said.

The future of medicine is here

Incorporating emerging technologies into medicine poses a challenge. Reasons for this can range from the complexities of FDA regulation to the high human cost of getting something wrong. The Silicon Valley mantra of “move fast, break things” understandably works a lot better for A/B testing of new user interface elements than it does A/B testing of new ways to treat yourself or your loved ones.

PrecisionOS

Nonetheless, there have been some impressive advances in recent years, driven by breakthroughs in technology. Smart surgical glasses bring augmented reality into the operating room. HD endoscopes allow surgeons to look around inside patients without having to make large incisions. And, befitting the age of social distancing, 5G and advanced surgical telerobots make it possible for operations to be carried out without the lead surgeon having to be in the room — or even the same state — as the patient.

Isn’t it about time that medical training took the same leap into the future?

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more
AI turned Breaking Bad into an anime — and it’s terrifying
Split image of Breaking Bad anime characters.

These days, it seems like there's nothing AI programs can't do. Thanks to advancements in artificial intelligence, deepfakes have done digital "face-offs" with Hollywood celebrities in films and TV shows, VFX artists can de-age actors almost instantly, and ChatGPT has learned how to write big-budget screenplays in the blink of an eye. Pretty soon, AI will probably decide who wins at the Oscars.

Within the past year, AI has also been used to generate beautiful works of art in seconds, creating a viral new trend and causing a boon for fan artists everywhere. TikTok user @cyborgism recently broke the internet by posting a clip featuring many AI-generated pictures of Breaking Bad. The theme here is that the characters are depicted as anime characters straight out of the 1980s, and the result is concerning to say the least. Depending on your viewpoint, Breaking Bad AI (my unofficial name for it) shows how technology can either threaten the integrity of original works of art or nurture artistic expression.
What if AI created Breaking Bad as a 1980s anime?
Playing over Metro Boomin's rap remix of the famous "I am the one who knocks" monologue, the video features images of the cast that range from shockingly realistic to full-on exaggerated. The clip currently has over 65,000 likes on TikTok alone, and many other users have shared their thoughts on the art. One user wrote, "Regardless of the repercussions on the entertainment industry, I can't wait for AI to be advanced enough to animate the whole show like this."

Read more