Skip to main content

Google’s ARCore platform can now track faces, boasts improved memory

Google is continuing to improve its augmented reality platform, ARCore, and has released an update for Android and iOS that adds facial augmentation and improves the existing Cloud Anchors that allowed for AR object permanence.

That sounds complicated, but it’s less complex than it initially seems. The new addition, Augmented Faces, allows users to attach fun effects to their faces that follow their movements and react to their expressions in real time. The technology is similar to iOS’s Animojis and Memojis — except with a key difference. While iOS’s in-built AR effects require a depth-sensing camera (the TrueDepth selfie lens on the latest iPhones), ARCore’s new feature is able to recreate this effect without the need for advanced hardware. To achieve this, Augmented Faces lays a 3D mesh over your face with 468 individually tracked points — with each point corresponding to a specific point on the AR effect. Basically, think of Snapchat’s filters, but better.

The second major part of this update consists of improvements to ARCore’s Cloud Anchors. Introduced in May 2018, Cloud Anchors allow for a certain amount object permanence between devices. Essentially, draw an arrow on a wall with an Android device, and a friend on an iPhone will be able to see it. That may seem minor, but imagine being able to leave a breadcrumb trail of AR directions for a friend while you’re out, or view AR models of spacecrafts together.

This sort of social AR experience is something Google is eager to explore, and this update makes the existing cloud anchors more robust and efficient. More angles are processed when the anchor is created, making steadier and more realistic — so elements are less likely to come loose from their anchor and drift across your screen.

Outside of exceptions like Pokémon Go or Harry Potter: Wizards Unite, it’s probably fair to say augmented reality plays little role in most people’s lives. Part of the reason for that is, well, it doesn’t really have much use yet. However, Google’s recent addition of AR directions to Google Maps — which uses your phone’s camera and screen to overlay directions on the real world — shows what’s possible with augmented reality. This update for ARCore may not be the most exciting update so far — but it’s a big step along the road to AR becoming from commonplace in our lives. If you’re eager to check out what’s currently possible in AR, check out our list of the best AR apps for Android and iOS.

Editors' Recommendations

Mark Jansen
Mark Jansen is an avid follower of everything that beeps, bloops, or makes pretty lights. He has a degree in Ancient &…
How to save text messages on iPhone and Android
iMessage on an iPhone.

We receive a lot of important information via text. Whether it’s a date you need to set or important work-related info, you might find yourself wanting to save a text message. Modern smartphones all offer a way to back up your core data and transfer it to another device. However, transfers sometimes don’t include your text messages unless you save them ahead of time or are transferring across the same mobile operating system.

Here's how to save your text messages in Android and iOS.
How to save your text messages on iPhone
There are multiple ways to backup your iPhone text messages. Here are the easiest.
How to make iPhone text message backups using iExplorer
The most universal method of saving your iPhone text messages is via the iExplorer program.

Read more
Google is launching a powerful new AI app for your Android phone
Google Gemini app on Android.

Remember Bard, Google’s answer to ChatGPT? Well, it is now officially called Gemini. Also, all those fancy AI features that previously went by the name Duet AI have been folded under the Gemini branding. In case you haven’t been following up all the AI development flood, the name is derived from the multi-modal large language model of the same name.

To go with the renaming efforts, Google has launched a standalone Gemini app on Android. Moreover, the Gemini experience is also being made available to iPhone users within the Google app on iOS. But wait, there’s more.

Read more
I need this iOS concept feature on my iPhone right now
An iOS concept showing a Smart Stack of widgets below the app dock.

It's always fun to imagine and speculate what new smartphone operating systems will bring. With Apple's iOS 18 update launching later this year — and reported to be a big one — there's a lot of anticipation over what Apple's next iPhone update will bring to the table.

We don't know much about what the next iOS update will offer, but there is one feature that I now need it to have. Product designer Gavin Nelson recently shared an iOS concept feature on X (formerly Twitter) and Threads, and it looks incredible.

Read more