Skip to main content

Defense giant BAE wants to replace fighter jet controls with augmented reality

bae systems augmented reality planes rs12405 dp068281 lpr
Image used with permission by copyright holder
To paraphrase the movie Zoolander, augmented reality (AR) is so hot right now. Used to refer to technology designed for superimposing a computer generated image onto a user’s view of the real world, AR has been leaped on by tech leviathans ranging from Apple to Google — all of whom are convinced that it represents the next frontier for consumer technology.

AR isn’t just considered transformative for regular users, however. United Kingdom defense giant BAE Systems believes that augmented reality has a valuable role to play in the future of combat. BAE is known for its far-out tech concepts, which have ranged from UAVs that can be “grown” using chemistry in large-scale labs to submarines piloted by virtual reality. In a “wearable cockpit” concept unveiled today, BAE’s department of military air and information showed off its ideas for incorporating AR and virtual reality (VR) technology into combat jet cockpits.

This “mixed reality” tech could be used for both training and combat scenarios, with the use of a Striker II full color Helmet Mounted Display (HMD) for projecting augmented and virtual reality displays and controls in front of the pilot’s eyes — entirely replacing the need for physical cockpit layouts.

Image used with permission by copyright holder

“Because the controls and displays are projected onto the helmet display, the technology allows pilots to customize the cockpit display and the way they interact with it based on their own personal preferences and mission objectives,” Suzy Broadbent, human factors lead for cockpits at BAE Systems, told Digital Trends.

“The move away from hard wired controls and displays and into virtual reality is something that has interested us for a while. However, it is only now that the technology is developing enough for us to see it as a definite potential for use in the fast jet domain. The idea is that the pilot can ‘wear the cockpit,’ and the innovations within HMI technologies allows us to provide a variety of methods for the pilot to interact with the system beyond the traditional HOTAS (Hands On Throttle And Stick).”

In addition to this, BAE’s proposed system focuses on “adaptive autonomy,” meaning that it could monitor pilot health and mental workload and, based on its assessments, shift what it is showing to the pilot at any one time. If mental workload becomes too much, the system could allow the aircraft to take over certain tasks the pilot would otherwise manually control.

“This is a technology demonstration concept, but one which is being looked at in research and development terms for potential exploitation on future platforms,” Broadbent continued. “The platforms of the future will be more ‘information heavy’ than ever and, we will therefore need more innovative ways of presenting that information to a pilot to allow them to interact with it.”

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more