Skip to main content

Defense giant BAE wants to replace fighter jet controls with augmented reality

bae systems augmented reality planes rs12405 dp068281 lpr
Image used with permission by copyright holder
To paraphrase the movie Zoolander, augmented reality (AR) is so hot right now. Used to refer to technology designed for superimposing a computer generated image onto a user’s view of the real world, AR has been leaped on by tech leviathans ranging from Apple to Google — all of whom are convinced that it represents the next frontier for consumer technology.

AR isn’t just considered transformative for regular users, however. United Kingdom defense giant BAE Systems believes that augmented reality has a valuable role to play in the future of combat. BAE is known for its far-out tech concepts, which have ranged from UAVs that can be “grown” using chemistry in large-scale labs to submarines piloted by virtual reality. In a “wearable cockpit” concept unveiled today, BAE’s department of military air and information showed off its ideas for incorporating AR and virtual reality (VR) technology into combat jet cockpits.

This “mixed reality” tech could be used for both training and combat scenarios, with the use of a Striker II full color Helmet Mounted Display (HMD) for projecting augmented and virtual reality displays and controls in front of the pilot’s eyes — entirely replacing the need for physical cockpit layouts.

Image used with permission by copyright holder

“Because the controls and displays are projected onto the helmet display, the technology allows pilots to customize the cockpit display and the way they interact with it based on their own personal preferences and mission objectives,” Suzy Broadbent, human factors lead for cockpits at BAE Systems, told Digital Trends.

“The move away from hard wired controls and displays and into virtual reality is something that has interested us for a while. However, it is only now that the technology is developing enough for us to see it as a definite potential for use in the fast jet domain. The idea is that the pilot can ‘wear the cockpit,’ and the innovations within HMI technologies allows us to provide a variety of methods for the pilot to interact with the system beyond the traditional HOTAS (Hands On Throttle And Stick).”

In addition to this, BAE’s proposed system focuses on “adaptive autonomy,” meaning that it could monitor pilot health and mental workload and, based on its assessments, shift what it is showing to the pilot at any one time. If mental workload becomes too much, the system could allow the aircraft to take over certain tasks the pilot would otherwise manually control.

“This is a technology demonstration concept, but one which is being looked at in research and development terms for potential exploitation on future platforms,” Broadbent continued. “The platforms of the future will be more ‘information heavy’ than ever and, we will therefore need more innovative ways of presenting that information to a pilot to allow them to interact with it.”

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
IKEA’s augmented reality app just got a whole lot more clever
ikeas augmented reality app just got a whole lot cleverer ikea place

When you step inside an IKEA store, you do so in the full knowledge that it might be half a day -- perhaps longer -- before you'll be reemerging into the daylight. And when you do finally make it to the exit, it’s likely to be with a wallet far lighter than when you arrived. That’s just the way it goes with IKEA.

When your purchases get delivered, the final step is to discover whether they actually fit the rooms they were intended for. While most of your judgments may be on the mark, there’ll always be a couch that looks out of place or a dining table that doesn’t quite fit. And situations like that can cause all kinds of hassle.

Read more
Apple reportedly canceled development of its augmented reality glasses
apple file system

It looks like Apple may have run into some walls with the development of its augmented reality glasses. According to a new report from DigiTimes, Apple "terminated" the development of the new glasses. The report also notes that Apple has instead "temporarily stopped" developing the new tech, so it's unknown if Apple will revisit the idea in the near future or not. It's also important to note that a number of reports cast doubt on the idea that Apple has canceled the project, so it's possible that the report isn't true at all.

Over the past few months, multiple outlets have reported that Apple is working on developing its own augmented reality glasses, including insiders like analyst Ming-Chi Kuo and Bloomberg reporter Mark Gurman. The DigiTimes report, however, suggests that the team working on the new glasses was disbanded back in May and assigned to different teams.

Read more
Minecraft Earth gameplay debuts at WWDC with augmented reality build
Minecraft Earth AR WWDC apple ios gameplay demo

Swedish game development studio Mojang teased a new location-based mobile AR game during Microsoft Build 2019, and fully revealed its new project, Minecraft Earth, in mid-May. During Apple’s special livestream event that kicked off the World Wide Developers Conference (WWDC) on June 3, the team took the stage for a live demonstration of the capabilities of Minecraft Earth.

First, the two Mojang staff members showed off a small creation transposed onto a table. The creation was made of various resources that a typical Minecraft player utilizes, and we also saw running water, fireworks, and mobs. Through the Minecraft Earth smartphone app, one player was able to see what the second player was holding in their hands. Via this, we saw one of the staff build in real time before adding her own character into the build.

Read more