Skip to main content

Engineers build new camera capable of taking pictures in five dimensions

Stefan Heist, Friedrich Schiller University / Fraunhofer IOF

Engineers in Germany have developed a new compact imaging system that’s capable of recording hyperspectral images in five dimensions. This 5D process means capturing data related to multiple wavelengths of light, along with spatial coordinates, as a function of time. The 5D system represents the first laboratory setup in which high-quality spatial and spectral resolution, depth accuracy, and high frame rate imaging have all been combined into a single compact system. It opens up exciting possibilities for security, medical imaging — and even grocery shopping.

The basic principle of the sensor is not dissimilar to the stereo vision that we possess as humans. However, instead of two eyes, which are limited to the detection of only visible light, the 5D imaging system utilizes two hyperspectral cameras operating in the visible to near-infrared range. Because the scene is captured from two slightly different directions, it’s possible to establish the depth information by identifying points on the surface that are present in both camera views. These images can be taken as rapidly as 17 frames per second, making this system faster than similar ones.

“There is a rapidly growing number of applications, which require the determination of more than just one property of macroscopic measurement objects,” Stefan Heist, research group leader at Friedrich-Schiller University, Jena, and the Fraunhofer Institute for Applied Optics and Precision Engineering, told Digital Trends. “Whether in medical imaging, precision agriculture, or optical sorting, for meaningful and reliable results, both the shape of the objects and their spectral properties have to be measured.”

The technology could prove useful for taking historical records of cultural artifacts — not just how they appear but also their material composition. To showcase this application, the researchers used their 5D camera to digitally document a historical relief globe from 1885. It could also be used for rapid, contactless identification of persons for security purposes — with spectral information adding another layer to existing biometric systems.

Right now, the imaging system is about the size of a laptop, although the researchers are hoping to shrink it further. “If the entire sensor can be further miniaturized so that it can eventually be placed in the smartphone, end users at home can [also] benefit from the technology,” Heist said. “It could then be used, for example, for the fast inspection of the condition of fruit or vegetables, or for personal medical monitoring.”

While he noted that the implementation of some of these uses cases will “take some time,” this is still an exciting step forward when it comes to imaging technology.

You can read more about it in a research paper recently published in the journal Optics Express.

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more