Skip to main content

Google's video AI was tricked into thinking a video about apes was about spaghetti

researchers trick google cloud video intelligence into misclassifying videos data center header
Google
While artificial intelligence is an incredibly important field that’s growing by leaps and bounds, perhaps its most interesting lessons concerns just how incredible the human brain is at performing certain functions. While computers might be better at performing math and looking dozens of chess moves into the future, they can’t yet compete with the human brain at figuring out things like a video’s topic.

A recent research project demonstrated just that fact by feeding videos to Google’s Cloud Video Intelligence API and seeing if it could determine exactly what a given video was about. Apparently, this seemingly simple task is a challenge for Google’s AI and points out the difficulty of creating automatic systems to categorize video, as Motherboard reports.

The research team in question works at the University of Washington, and the team used some trickery to see how smart the Google API really is. Currently in beta, the Google Cloud Video Intelligence API has one job, which was to “make video searchable” and to annotate video to make it easier for humans to search through them.

In their tests, the researchers injected extraneous, and subliminal, images of a pasta bowl into a video featuring primatologist Jane Goodall and gorillas. The result was that the Google AI concluded that the video was actually about spaghetti and not the apes. Another example involved placing a picture of an Audi into a video about tigers, which caused the AI to conclude that the video was about cars.

University of Washington

Although it might sound somewhat comical, these mistakes point out a serious issue with the AI. As the researchers noted in their conclusion:

“However, we showed that the API has certain security weaknesses. Specifically, an adversary can insert an image, periodically and at a very low rate, into the video in a way that all the generated shot labels are about the inserted image. Such vulnerability seriously undermines the applicability of the API in adversarial environments.”

Even worse, according to the researchers, “Furthermore, an adversary can bypass a video filtering system by inserting a benign image into a video with illegal contents.” The fact that the process of doing so requires no specialized knowledge about the AI’s machine learning algorithms or about video annotation in general was particularly disturbing.

Ultimately, what the research points out is that AI has a long way to go before it can match the human brain in determining things like a video’s topic. Inserting subliminal messages into video has been known for a long time to affect the human psyche, but at least a human wouldn’t think that a video about apes is actually about spaghetti — the human would probably just start craving pasta instead.

Editors' Recommendations

Mark Coppock
Mark has been a geek since MS-DOS gave way to Windows and the PalmPilot was a thing. He’s translated his love for…
Google Bard could soon become your new AI life coach
Google Bard on a green and black background.

Generative artificial intelligence (AI) tools like ChatGPT have gotten a bad rep recently, but Google is apparently trying to serve up something more positive with its next project: an AI that can offer helpful life advice to people going through tough times.

If a fresh report from The New York Times is to be believed, Google has been testing its AI tech with at least 21 different assignments, including “life advice, ideas, planning instructions and tutoring tips.” The work spans both professional and personal scenarios that users might encounter.

Read more
Apple GPT is real and may be coming sooner than you think
Siri on an iPhone.

Apple has been conspicuously absent in generative AI news, while OpenAI, Microsoft, Google, and Meta are making headlines with their advances daily. However, the iPhone maker hasn't given up, and a privacy-focused Apple AI is undergoing internal testing.

According to a Bloomberg report, Apple is working on a chatbot and has already been testing it internally. Reporter Mark Gurman's sources claim that Apple's AI plans are expected to be revealed in a major announcement in 2024. Apple engineers are said to refer to the AI as "Apple GPT" internally, suggesting it could use a generative pretrained transformer (GPT) somewhat similar to OpenAI's model.

Read more
The best AI video editing tools
KateFrames Studio AI editor.

If you want to make video content, you need to know how to edit. At least, you used to. With the power of some of the latest artificial intelligence video editing tools, you can get by with just a few clicks. Some of the best AI video editors have the power to craft your content for you or repackage it for different platforms with just the click of a button.

You'll still need to record the footage yourself (most of the time), and there's no substitute for a good human-driven edit, but if you want some AI tools to help you out and expedite your editing, here are the best AI video editing suites you can use right now.

Read more