Skip to main content

Google can catch shoulder surfers peeking at your phone

google shoulder surfers smartphone alert shopping cafe
Image used with permission by copyright holder
Imagine you’re in town waiting for a friend. With time to kill before they arrive, you do what most people do and get your smartphone out. You might flick through your Twitter timeline, check Facebook, open Instagram, or tap out a message on WhatsApp. You fail to notice the stranger standing right behind you, looking at your display.

Would you like your phone to be able flag such an occurrence with an on-screen message along the lines of, “There’s someone else looking at your display,” or perhaps something more direct, like, “Hey! Stop looking at my phone right now, creep!” though such harsh words may admittedly cause an unwanted public altercation.

It turns out that researchers at Google have been developing such a privacy-focused feature, and have now posted a video demonstrating how it works.

The feature uses the front-facing camera to scan the faces of anyone looking toward the phone. If the software spots someone it doesn’t recognize, it flashes up the message: “Stranger is looking alert!”

In Google’s recently posted demonstration video (below) spotted by Quartz, the researchers have had a bit of fun by adding a stream of Snapchat-inspired rainbow-colored vomit coming from the stranger’s mouth.

NIPS 2017 Accompaniment Demo Video

According to the video’s introduction, it seems like this may be more of an experimental project, or possibly the seed of an idea that could one day be offered as an option on our phones.

The feature is set to be presented at next week’s Neural Information Processing Systems conference in Long Beach, California, by Google researchers Hee Jung Ryu and Florian Schroff.

The technology can work for a range of “lighting conditions and head poses,” according to the researchers’ notes, and recognizes a face in two milliseconds, so you’ll know pretty darn quick if someone is peering over your shoulder.

A feature like this would come in handy if you’re in a busy place and you’re reading or writing personal messages, or if you’d simply prefer to keep your smartphone display to yourself.

It might work better in some situations than others, though. On a crowded train, for example, a fellow passenger may just glance at your screen simply because it’s human nature to do so. That could result in the alert popping up with annoying regularity, in which case it would prove more useful if it showed after a few seconds once the technology determined that the shoulder surfer is taking a long, lingering look rather than a fleeting one.

With facial recognition technology already well developed and front-facing camera technology improving all the time, we imagine such a feature could be added to most smartphones with little effort, though whether shoulder surfing is enough of a problem that users would find it useful is another question entirely.

Editors' Recommendations

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
This is the one AI feature from Google I/O 2024 I can’t wait to use
Google Photos app on a Google Pixel 8 Pro.

Google’s main I/O 2024 keynote was jam-packed with a ton of new AI features that are coming to desktop and mobile, thanks to Gemini. There will be new ways to search Google through video and multimodal prompt requests, while smartphones eventually get AI superpowers through the camera with Project Astra.

But there’s one feature that really stuck out to me: Ask Photos with Gemini in Google Photos.
First, what is Gemini?

Read more
Google has a magical new way for you to control your Android phone
Holding the Google Pixel 8 Pro, showing its Home Screen.

You don’t need your hands to control your Android phone anymore. At Google I/O 2024, Google announced Project Gameface for Android, an incredible new accessibility feature that will let users control their devices with head movements and facial gestures.

There are 52 unique facial gestures supported. These include raising your eyebrow, opening your mouth, glancing in a certain direction, looking up, smiling, and more. Each gesture can be mapped to an action like pulling down the notification shade, going back to the previous app, opening the app drawer, or going back to home. Users can customize facial expressions, gesture sizes, cursor speed, and more.

Read more
Google just announced 10 huge updates for your Android phone
The Home Screen on the Google Pixel 8 Pro.

Google I/O, the annual everything-Google-software fest, has kicked off. As usual, Android takes center stage. From enhanced privacy and Google Wallet upgrades to theft detection and app safety checkups, there’s a lot to look forward to here.

From Android 15 features to more general Android updates, here’s a breakdown of all the major Android announcements from I/O 2024.
Making life easier with Google Wallet

Read more