Skip to main content

Facebook uses AI to help the blind ‘see’ images

facebook ai image reader for blind on blue
Facebook uses AI to read image descriptions for blind people Image used with permission by copyright holder
Facebook is ready to help blind people ‘see’ images via artificial intelligence. The new feature, called automatic alternate text, works with existing screen reader apps used by blind and visually impaired people. The AI-generated descriptions identify objects and scenes but there is no facial recognition –although we can imagine it’s on the way. So you if you share an image with A visually impaired friend it won’t tell him or her who is in the picture or what everyone is wearing, but it might read “Image may contain: three people, smiling, birthday cake.”

There are more than 246 million people around the world with severe visual impairments and 39 million who are blind, according to Facebook. More than 2 billion photos are shared daily on Facebook, Instagram, Messenger, and WhatsApp. Automatic alternate text can help social media be more inclusive.

Facebook’s automatic alternate text introduction follows Twitter’s announcement last week of a 420 image character description field also intended for visually impaired people who use screen readers with mobile devices. With the Twitter app the person who composes the Tweet also writes the description. The Facebook feature automatically attempts to describe the image, with the disclaimer “Image may contain.” Of course, a Facebook post creator has plenty of space to describe images already, while Twitter limits regular text to just 140 characters. In each case blind and visually impaired people get less of a raw deal.

Facebook’s automatic alternate text feature is available now for people who use iOS devices in English in the U.S., U.K., Canada, Australia, and New Zealand. The company plans to support more platforms, languages, and market in the near future.

The accuracy of Facebook’s automatic alternate text feature matters and will likely improve over time.

We imagine that facial recognition is already on the planning board. On the other hand, perhaps it’s better not to attempt to identify people in photos Until the tech is flawless. Imagine if a Facebook screen reader misidentified and called out the wrong names. In some circumstances that could be pretty embarrassing.

Editors' Recommendations

Bruce Brown
Digital Trends Contributing Editor Bruce Brown is a member of the Smart Homes and Commerce teams. Bruce uses smart devices…
ChatGPT AI chatbot can now be used without an account
The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.

ChatGPT, the AI-powered chatbot that went viral at the start of last year and kicked off a wave of interest in generative AI tools, no longer requires an account to use.

Its creator, OpenAI, launched a webpage on Monday that lets you begin a conversation with the chatbot without having to sign up or log in first.

Read more
YouTube tells creators to start labeling ‘realistic’ AI content
YouTube on Roku.

YouTube is taking steps to try to help viewers better understand if what they’re watching has been created, whether completely or in part, by generative AI.

“Generative AI is transforming the ways creators express themselves -- from storyboarding ideas to experimenting with tools that enhance the creative process,” YouTube said in a message shared on Monday. “But viewers increasingly want more transparency about whether the content they’re seeing is altered or synthetic.”

Read more
Copilot: how to use Microsoft’s own version of ChatGPT
Microsoft's AI Copilot being used in various Microsoft Office apps.

ChatGPT isn’t the only AI chatbot in town. One direct competitor is Microsoft’s Copilot (formerly Bing Chat), and if you’ve never used it before, you should definitely give it a try. As part of a greater suite of Microsoft tools, Copilot can be integrated into your smartphone, tablet, and desktop experience, thanks to a Copilot sidebar in Microsoft Edge. 

Like any good AI chatbot, Copilot’s abilities are constantly evolving, so you can always expect something new from this generative learning professional. Today though, we’re giving a crash course on where to find Copilot, how to download it, and how you can use the amazing bot. 
How to get Microsoft Copilot
Microsoft Copilot comes to Bing and Edge. Microsoft

Read more