Skip to main content

An app uses your smartphone camera to tell if you’re alert at work

In the boring old days, our smartphone cameras just took pictures. Then they started letting us confirm our identity, through tools like Apple’s Face ID. Soon, they could help track your alertness as well.

At least, that’s the basis for a new research project coming out of Cornell University. Researchers there have developed a tool which uses a smartphone camera to keep tabs on alertness at work — by measuring the size of your pupils each time you unlock your phone. It can do this because people’s pupils change size over the course of the day. When individuals are alert, the sympathetic nervous system makes their pupils dilate in order that they can take in information more easily. When they’re tired, the parasympathetic nervous system causes the pupils to contract. Since all of us look at our phones at work (don’t pretend this doesn’t include you!), developing an alertness measurement tool for this device makes perfect sense.

“The goal of this technology is to explore a new way in which we can measure people’s level of alertness in an unobtrusiveness and naturalistic way, in particular at the moments when people interact with their mobile devices,” Vincent Tseng, a Ph.D. student in Cornell’s Department of Information Science, told Digital Trends. “Essentially, the app takes a burst of images when people unlock their phone. [It additionally] collects other passive sensor data that also affect people’s alertness or pupil size, such as environmental light intensity. With all these passively collected sensor data, the application uses machine learning to predict how alert the user is, [which helps reveal their] reaction time.”

Sure, the idea of your boss receiving a notification to say your work smartphone has revealed that you’re not paying attention is kind of dystopian. But there are potential applications for this technology that would be genuinely helpful — and maybe even life-saving. For instance, clinicians typically look at devices (hopefully not their personal smartphones) during surgery. A front-facing camera on these devices could help track their alertness throughout procedures, which can take multiple hours to complete in some cases. Should the app detect a surgeon’s level of alertness to be plummeting, it could trigger an intervention that lets another person step in or the operator to take a short break.

“Our ultimate goal is to better understand how our productivity and performance fluctuate throughout the day,” Tseng continued. “By knowing how … different processes change throughout the day, we may have a better picture of when are the optimal times for us to focus and accomplish important tasks.”

A paper describing this project was recently presented at the International Conference on Human-Computer Interaction with Mobile Devices and Services.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Google Messages vs. Samsung Messages: Which app should you use?
Google messages versus samsung messages app icons side by side on Galaxy Z Fold 5.

Amid the rise of third-party messaging apps, texting remains a popular means of messaging in the U.S. If you own an Android phone, you've likely used or heard of Google Messages, which is positioned as the default text messaging app for Android. It is the culmination of Google's long history with multiple messaging platforms. Google has pursued smartphone companies to use its Dialer and Messages apps as their default since at least 2017 and now mandates them to use Google Messages as the default messaging app on all devices.

Meanwhile, if you have been a Samsung user in the past, you have likely also known and experienced the Samsung Messages app, which comes preinstalled on all Samsung phones and cannot be uninstalled. This is despite losing its spot as the default messaging app on Samsung Galaxy smartphones.

Read more
The Oura Ring just got a lot more helpful if you’re pregnant
The side of the Oura Ring Horizon.

The Oura Ring has long been one of our favorite smart rings on the market. Now, it's getting even better, as Oura is introducing a new feature called Pregnancy Insights. It's only the latest in a series of announcements made recently by the company.

The Pregnancy Insights feature in the Oura Ring is designed to support women throughout their pregnancy journey by offering useful information and increasing awareness. This feature includes a gestational age tracking tool, which helps users keep track of their estimated due date. It also provides regular weekly updates on the physical changes that one might expect during pregnancy.

Read more
No, the Journal app on your iPhone isn’t spying on you
Apple Journal app on an iPhone 15 Pro.

If you've spent any time on Facebook, TikTok, or any other social media site over the last couple of days, there's a chance you've seen people claiming that your iPhone is spying on you — specifically, with a feature called "Journaling Suggestions."

One post I stumbled across on Facebook made it sound rather frightening, warning me that the feature shares my FULL NAME and EXACTLY where I'm located to anyone nearby. The post told me to go and toggle the setting off immediately because it was "Very scary stuff!!"

Read more