Skip to main content
  1. Home
  2. Web
  3. News

Captionbot is another AI from Microsoft, and it's not doing so hot either

By

microsoft captionbot screen shot 2016 04 17 at 3 26 32 pm
Image used with permission by copyright holder
You’d think that after its last AI chat bot fiasco, Microsoft would’ve learned its lesson — or at least waited a bit longer before introducing another monster to the world. Luckily for us, history has a tendency to repeat itself, and the company’s latest creation is a sometimes hilarious entity known as Captionbot. The premise is simple — recognize the contents of a photo, and come up with an appropriate caption. But alas, while the concept may be straightforward, the execution isn’t always so cut and dry. And social media has been quick to point out all of Captionbot’s faux pas.

In one case, the artificial intelligence system thought that Michelle Obama was a cellphone. And there’s also the time when the dress that launched a thousand debates (you know, the blue and black or white and gold dress) confuses the bot as much as it confused all of us. The system thought the dress was a cat wearing a tie (or in some cases, a suitcase).

Recommended Videos

The bot also looks to be attempting to rewrite history, absolutely refusing to identify Hitler as the infamous Nazi leader he was. When CNNMoney fed the AI photos of the dictator and swastika, more often than not, Captionbot responded, “I really can’t describe the picture” alongside a confused emoji. Strangely enough, it could identify other famous Nazis like Joseph Mengele and Joseph Goebbels.

Osama bin Laden is another infamous face Captionbot can’t recognize, although it is unclear whether this is due to restrictions Microsoft put in place to prevent Tay-esque disasters from taking place. “We have implemented some basic filtering in an effort to prevent some abuse scenarios,” a spokesperson noted of the limitations.

You can upload your own photos for Captionbot to analyze, but proceed at your own risk. Sometimes, this bot gets it very, very wrong. Just check out a couple of our favorite examples below.

#captionbot thinks Michelle Obama is a cell phone. pic.twitter.com/FtC6tP6Ben

— David Sim (@davidsim) April 14, 2016

Captionbot.ai 's view of my avatar: pic.twitter.com/OUctTxhx0p

— Richard Gadsden (@po8crg) April 14, 2016

Microsoft's image captioning tool sees through the so-called "moon landings" https://t.co/WWr7O1XeE3 H/T @robmanuel pic.twitter.com/BDd9X4KdNp

— Ralph Harrington (@ralphharrington) April 14, 2016

Editors' Recommendations

Topics
Lulu Chang
Lulu Chang
Former Digital Trends Contributor
Fascinated by the effects of technology on human interaction, Lulu believes that if her parents can use your new app…
Snapchat hopes its new AI selfie feature will be a moneymaker
A screenshot of Snapchat's new AI-powered Dreams feature.

Snapchat Dreams

Snapchat was quick to jump aboard the AI bandwagon when it launched its “My AI” chatbot in February. And now the platform has released another feature that, like My AI, also harnesses generative AI.

Read more
Microsoft says bizarre travel article was not created by ‘unsupervised AI’
Microsoft logo

According to a recent article posted by Microsoft Travel on microsoft.com, attractions worth checking out on a visit to the Canadian capital of Ottawa include the National War Memorial, Parliament Hill, Fairmont Château Laurier, Ottawa Food Bank ... hang on, Ottawa Food Bank?

Spotted in recent days by Canada-based tech writer Paris Marx, the article puts Ottawa Food Bank at number 3 in a list of 15 must-see places in the city. And as if that wasn't bad enough, the accompanying description even suggests visiting it “on an empty stomach.”

Read more
Microsoft ‘special event’ set for September – Surfaces and AI announcements likely
microsoft

Microsoft has announced it will be holding what it describes as a “special event” in New York City on Thursday, September 21, though at the current time, it’s giving little away on what it’s about.

The expectation is that the tech giant will unveil some new products, though at this point it’s only possible to speculate. In that case, updates to its Surface hardware could certainly be incoming, including for its flagship Surface Laptop Studio, which launched two years ago and is therefore due for a refresh.

Read more