Skip to main content

Lego partners with Apple to add augmented component to physical playsets

iPad Lego AR game
Image used with permission by copyright holder

Lego already gives creative builders the chance to physically make something only limited by their own imagination, but now your playsets are going to look a whole lot cooler with the addition of Apple’s ARKit 2.0 technology. Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

During Apple’s WWDC 2018 presentation, Martin Sanders, Lego’s director of innovation, took the stage to show off how ARKit 2.0 can be used with physical Lego sets to create something even more impressive in augmented reality. With the help of Apple ARKit 2.0, Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

With the “Assembly Square” playset placed on a table in front of him, Sanders aimed at it with an iPad and, with the press of a button, created an entire town around the physical building on his screen. Other shops, sidewalks, and grass appeared, nearly indistinguishable from the physical set.

It’s made possible through the 3D object detection in the ARKit 2.0, which allows users to add additional foliage, buildings, people, or cars. Small icons visible above certain people and objects in the world even allow you to take part in missions. These can include situations that require urgent action, such as a building catching fire (with a firetruck, you can put out the inferno). During the WWDC stage demonstration, Sanders also rescued multiple trapped citizens from the roof of a building using a helicopter.

If you approach one of the buildings with your camera and attempt to peer inside, you’ll find the buildings bustling with activity. With a quick tap, you can even peel back the outside walls of multiple buildings to observe them like you would a dollhouse.

ARKit 2.0 allows up to four players to experience a Lego world at the same time, with the changes made by one player instantly visible on the others’ screens. When you’re done playing for the day, you can save all progress and tie it to your physical set, allowing you to start from the same point when you’re ready to play again.

“When we combine physical and digital together like this, it really opens up those creative play possibilities,” Sanders said.

Lego promises more AR experiences will be available in the App Store later this year. We’re crossing our fingers for something Harry Potter- or Star Wars-themed.

Editors' Recommendations

Gabe Gurwin
Former Digital Trends Contributor
Gabe Gurwin has been playing games since 1997, beginning with the N64 and the Super Nintendo. He began his journalism career…
Delta emulator changes logo after Adobe lawsuit threats — but just barely
A collage of the delta emulator.

Delta is a popular iOS game emulator, but it ran into a small problem with its logo recently. The app developer claims that Adobe threatened legal action against it if it didn't change the logo, so it did -- by doing the bare minimum.

The latest update, 1.5.4, released on May 17, and the version history notes on the Apple App Store highlight the change. While the update also added a "revised context menu for games," the big thing is clearly the "new icon to avoid legal trouble."

Read more
iOS 17.5 just launched with a huge security feature for your iPhone
Apple iPhone 15 Plus and Apple iPhone 15 Pro Max seen from the back.

Apple iPhone 15 Plus (left) and Apple iPhone 15 Pro Max Andy Boxall / Digital Trends

Apple has just released the iOS 17.5 update for iPhones, which brings a host of new features. For European Union residents, it enables Web Distribution, which means you can sideload apps from the internet and won’t be limited to the App Store.

Read more
Apple’s new iPads look amazing, but there’s one big problem
Renders of the 11-inch and 13-inch models of the iPad Pro 2024.

After a year-long drought, Apple finally released some new iPads during its Let Loose event on May 7. Though it was just the iPad Air and iPad Pro models that were updated, we did get a 13-inch option for the iPad Air along with the standard 11-inch size, as well as iPad Pros with new OLED displays.

The iPad Airs now come equipped with an M2 chip inside, while the iPad Pros mark the debut of the new M4 chip. Exciting stuff, right? Unfortunately, as enticing as the hardware is, there is still one thing holding the iPad back -- and it's all Apple's fault.
Exciting new hardware, boring old software
iPad Air 2024 Apple

Read more