Skip to main content

Apple plans to make iOS the largest augmented reality platform around, overnight


Pokemon Go was undeniably one of 2016’s biggest gaming success stories, offering a wholly new mobile experience that hinged on location-based gameplay and augmented reality technology. Today at WWDC 2017, Apple unveiled ARKit, a new platform that will allow developers to integrate computer vision into their projects with greater ease than ever before.

Apple’s senior vice president of software engineering, Craig Federighi, debuted ARKit with a live demonstration on stage. He used an iPhone to run a test application that could place virtual objects on a surface in front of him at the touch of a button.

The coffee cup that Federighi set on the table remained in place as he moved around with his iPhone in hand, without the kind of stuttering or unwanted rotation that can break immersion in this kind of experience. He went on to add a lamp to the scene, which cast a realistic shadow from the coffee cup to demonstrate the way virtual objects can interact.

ARKit will provide fast, stable motion tracking that developers can build into their apps. It’s capable of seeking out planes like tables and floors, it can estimate how much ambient light is in the vicinity, and it’s capable of balancing the scale of various objects to ensure the scene is congruent.

The utility will apparently work alongside third-party frameworks like Unity and Unreal as well as Apple’s own SceneKit to give developers more freedom in their creative process.

Apple is bullish that ARKit will become the largest AR platform in the world overnight, thanks to the hundreds of millions of iPads and iPhones already out in the wild, already capable of running content created using the tools. The company has already been working with some big-name partners, with IKEA and Lego both having experimented with the platform.

Meanwhile, Niantic has used ARKit to make Pokemon Go even more immersive. The way that Pokemon are rendered in real-world environments has been improved, integrating them into their environment with a greater sense of place and space.

Wingnut AR, a sister studio of Peter Jackson’s movie production company, then demonstrated its usage of the technology on stage. A standard table top was transformed into a sci-fi battle, with explosions and artillery covering the surface and spilling out into the ‘skies’ above.

ARKit is set to launch as part of iOS 11 later this year.

Brad Jones
Former Digital Trends Contributor
Brad is an English-born writer currently splitting his time between Edinburgh and Pennsylvania. You can find him on Twitter…
Apple could end antitrust woes by making the iOS App Store more like the Mac’s
iphone xr app store

Apple is having a pretty terrible time right now amid multiple antitrust hearings and a wave of discontent over the fees it charges developers to use its App Store. It all culminated last week with the controversy of Fortnite being removed from the App Store altogether.

But there is one solution that could potentially end Apple’s woes and deal a blow for consumers and developers at the same time: Make the iOS App Store more like the Mac App Store. It is not such a crazy idea. After all, Apple already has looser restrictions on its Macs than on its iPhones. Here’s why it could be exactly what Apple needs to do.
The problem: Apple’s arbitrariness

Read more
A dangerous new jailbreak for AI chatbots was just discovered
the side of a Microsoft building

Microsoft has released more details about a troubling new generative AI jailbreak technique it has discovered, called "Skeleton Key." Using this prompt injection method, malicious users can effectively bypass a chatbot's safety guardrails, the security features that keeps ChatGPT from going full Taye.

Skeleton Key is an example of a prompt injection or prompt engineering attack. It's a multi-turn strategy designed to essentially convince an AI model to ignore its ingrained safety guardrails, "[causing] the system to violate its operators’ policies, make decisions unduly influenced by a user, or execute malicious instructions," Mark Russinovich, CTO of Microsoft Azure, wrote in the announcement.

Read more