Skip to main content

Fussy, hungry, or in pain? This app accurately translates your baby’s cries

Image used with permission by copyright holder

Speech recognition and machine translation tools are two of the most useful everyday applications of artificial intelligence as it exists today. Both of them allow our words to be understood by a machine and turned into actionable commands, used either to control devices like the Google Home smart speaker or to have a conversation with someone who speaks a different language to us. Could similar machine learning A.I. technology also be used to help decipher a baby’s cries, and in the process shed some light on exactly what it is that they are attempting to communicate?

The makers of a new free Android and iOS app called Chatterbaby certainly believe that it can. Developed by researchers at the University of California, Los Angeles, the app is based on an algorithm that’s able to work out exactly what each baby cry means and relay this information to parents. According to its creators, it can do this with astonishing accuracy; far more, in fact, than the guesswork with which most first-time parents react to their baby’s crying.

“I have four children; this project came about after I realized that number three had cries that sounded remarkably similar to my first two babies,” Ariana Anderson, assistant professor and lead in the UCLA research, told Digital Trends. “Since I am a statistician, I see patterns everywhere. I wanted to test whether the vocal patterns I could hear in my own children were present in other children as well. We decided to put this algorithm into our free Chatterbaby app not just to help parents of babies now, but to help them later as well when their children are older.”

Image used with permission by copyright holder

To create the Chatterbaby app, Anderson and fellow researchers started by uploading 2,000 audio samples of infant cries. They then used A.I. algorithms to try and discover (and therefore explain) the difference between pain-induced cries, hunger-induced cries, and fussiness-induced cries.

“The training was done by extracting many acoustic features from our database of pre-labeled cries,” Anderson continued. “Pain cries were taken during vaccinations and ear-piercings. We labeled other cries using the parent-nomination and a ‘mom-panel’ consisting of veteran mothers who had at least two children. Only cries that had three unanimous ratings were used to train our algorithm, which changes and improves regularly. We used the acoustic features to train a machine learning algorithm to predict the most likely cry reason. Within our sample, the algorithm was about 90 percent accurate to flag pain, and over 70 percent accurate overall.”

Anderson does, however, note that parents should still use their best judgement, “and remember that their brain and their instincts are far more powerful than any artificial intelligence algorithm.”

While the Chatterbaby app could be useful for many parents — especially the aforementioned first-time parents — Chatterbaby could prove particularly helpful in certain scenarios. For example, it could be handy in situations in which one or both parents are deaf or hard of hearing, providing notification when their eyes are otherwise occupied.

Image used with permission by copyright holder

It may also turn out to be a powerful tool in diagnosing autism at a younger age. At present, autism is diagnosed later in childhood, often around the age of three. Finding ways of predicting autism as soon as possible is something a number of researchers have been working toward, since this could allow for earlier intervention to take place. Anderson suggested that one way of picking up an early cue regarding autism may be found in listening for unusual vocal patterns in infants.

Previous studies have shown promising results in detecting abnormal vocal patterns with at-risk children, but these sample sizes are small. In an attempt to add more data to the pile, Chatterbaby offers a voluntary study which parents can enter into. Right now, it’s still at an early stage, but long term it could provide valuable insights that allow an earlier diagnosis.

“By inviting people into our research study with the Chatterbaby cry translator, we can them follow them for six years and provide free screenings for autism which they can do from their own home,” Anderson continued. “If their children are higher risk, they can then go to their doctor for a full evaluation. We want to bring the lab to the participant, instead of the participant to the lab. By offering a free service in our app that is of high-value to new parents, we believe we can connect with parents and improve our ability to identify risk factors for autism. We believe that a baby’s voice can be one of many risk factors to improve our understanding of autism.”

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more