Skip to main content

Researchers develop a smartphone app that can help the blind take pictures

smartphotoThe idea of a blind photographer seems like an oxymoron at first; after all, the ability to see and frame the shot before snapping the picture seems like the most basic asset to photography. Not to researchers from the University of California at Santa Cruz. The team has developed a smartphone app that can help photographers take pictures without needing to see what’s in front of them.

The unnamed app is the work of a team led by Dustin Adams, and the technology builds on existing smartphone facial detection sensors to create something that will guide partially-sighted users to create perfect photographs (or something close to it, at least).

Adams and his team started by polling more than 50 people between the ages of 18 and 78, all of whom had some degree of visual impairment – from fully blind to slight light perception – about the problems they had taking photographs. Using their feedback as a baseline for “must-have” elements they needed to work on, the team found that the most necessary adaptation wasn’t just how to help frame the shot, but to also fix control placements.

So to that, the USCS team said goodbye to buttons. The test app is voice controlled, allowing the user to take a picture without finding the right shutter buttons on the screen. Instead of finding the app icon on the phone, users can activate the app with upward swipe gesture and the app will begin talking to the user to identify the number of people in the frame before the shot is taken.

Once activated, the camera has a 30 second countdown before the picture is taken. In that time, audio cues will continue to count the number of people in the frame, allowing the user time to get everyone in shot, and explain whether the subjects are in focus. In addition to the speech guidance, the app also records the user within that 30 second window and the user can choose to save that audio file in combination with the photo to help with organization or photo sharing. Of course, thanks to most smartphones’ standard of built-in GPS, pictures can be geotagged.

So it seems like the app is useful for taking photos of friends and family and not so much the things surrounding the vision-impaired, but at least it’s a start. Sadly, the app hasn’t been made available to the public just yet. Before that happens, the UCSC research team will present the findings of their study at the Pervasive Technologies Related to Assistive Environments conference in Rhodes, Greece, later this month. Perhaps after that, it won’t be long before anyone could become a better photographer, regardless of their skill level or eyesight.

Editors' Recommendations

Graeme McMillan
Former Digital Trends Contributor
A transplant from the west coast of Scotland to the west coast of America, Graeme is a freelance writer with a taste for pop…
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more