Google wants to Jedi-mind trick your phone into a powerhouse with Seurat

By Jayce Wagner Published May 18, 2017

This story is part of our complete Google I/O coverage

google announces seurat smartphone graphics io 2017 how to watch — Image used with permission by copyright holder

At the I/O developer conference on Thursday, Google unveiled a bold plan to bring desktop-grade graphics capabilities to your smartphone — using a few behind-the-scenes tricks.

The technology, called Seurat, takes high-fidelity virtual reality scenes and works some magic to effectively downscale the underlying geometry to the point where a smartphone could render the whole scene in real time.

Google was light on the exact details but through a partnership with Industrial Light and Magic’s internal “Experience Lab” or ILMxLab, we got a chance to see the technology in action and it’s pretty impressive. Taking users into an interactive VR version of a scene from Rogue One: A Star Wars Story, ILMxLab created a lavishly detailed world using high-powered desktop hardware.

Using Google’s Seurat technology, ILMxLab was able to break down the overall polygon count and downscale textures without sacrificing too much in the way of graphical fidelity. While the downscaled version did not look quite as sharp, it only took about 13 milliseconds for a smartphone to render — down from an hour on high-end desktop hardware.

The behind-the-scenes trickery Seurat employs managed to pare down and compress the original scene from one featuring over 50 million polygons to one with just 72,000 — there was a bit of quality lost in the process, which is to be expected. The real goal of this technology is to enable better VR experiences on mobile devices, which possess only a fraction of the power a VR-ready desktop has at its disposal.

As illustrated in the demo, one key component of the technology essentially eliminates background details that are not visible to users, which enables the mobile versions of VR scenes to appear lifelike and high-quality without overtaxing smartphone hardware.

This forward leap in graphical quality is a big deal for Google’s Daydream ecosystem, which it hopes will become the standard for mobile VR and AR experiences.

Topics

Former Digital Trends Contributor

A staff writer for the Computing section, Jayce covers a little bit of everything -- hardware, gaming, and occasionally VR.

Mobile

Yes, you will want this metal Millennium Falcon iPhone case

Casetify's Star Wars themed Impact Case, and limited edition Millennium Falcon case.

We were pretty excited when Casetify announced its new Star Wars collection of phone cases and accessories at the end of April, and we’ve now got our hands on the star of the show, the Millennium Falcon limited-edition case, to see if our anticipation was justified. It’s a thing of beauty and well worth a closer look, but what about the rest of the collection?
Millennium Falcon case
Made of aluminum with a laser -tched image of the Millennium Falcon, there are only 1,000 of these cases in existence so getting one may be a challenge. Now that we’ve got one in our hands, we can see if it’s worth the effort. Let’s start with the design itself. The top-down, schematic-style design of the Falcon itself looks great, and has real texture to it. The aluminum under the design has a brushed effect and catches the light in an attractive way.

A Star Wars logo joins the outline of the Falcon, but gets a little lost in the design, although the text and the rebel insignia down the side is far more legible. The sides of the case are smooth to the touch and don’t have a brushed finish, but still provide more than enough grip so the phone isn’t in danger of slipping out your hand. I could do without the rather uninspiring “This case is made from 50% recycled materials” claim on the side of the case though.

Computing

Meta wants its next VR headset to replace your laptop

Oculus Quest VR Headset

Mark Zuckerberg wants the announcement of his company's next premium VR headset to be an "iPhone moment" -- a defining shift for virtual reality with mass consumer adoption of the technology. To achieve that vision, Meta, the company that Zuckerberg helms, will first start by replacing your trusty laptop with goggles.

Meta, which owns Facebook and the company and technology behind Oculus, is working on an unannounced premium virtual reality headset called Project Cambria, which the company briefly teased at its Connect conference. Project Cambria comes with new technology that isn’t yet available on current VR headsets, like eye-tracking and facial recognition monitoring to record your facial expressions -- as well as new optics.

Mobile

Want the Google Pixel’s astrophotography on your iPhone? There’s an app now

Nocturne brings a sort of Google Pixel astrophotography to the iPhone.

One of the premiere features offered on Google Pixel phones starting with the Pixel 4 has been astrophotography. The Google Pixel 4 and above are capable of creating great shots of the stars in the sky by taking a series of exposures over a long period of time and then stitching them together for one long exposure. It's really incredible how much detail in the night sky can be captured using the phone in your hand. Until recently, that has been a Pixel-exclusive feature.

So naturally, when I came across an app that claimed to do the same thing on the iPhone, I was intrigued. Nocturne is a free app available now that can accomplish much of what astrophotography can but on an iPhone. Nocturne is developed by Unistellar, whose primary business is in telescopes. Its latest product, the eVscope 2, is a digital motorized telescope that has some neat features. That's a conversation for another time. What's interesting for me is that Nocturne is able to bring astrophotography to non-Pixel devices.
Here's how it works
Getting back to Nocturne, the app accomplishes much of what you'll see on the Pixel's astrophotography mode but on the iPhone. It works by taking a series of exposures and stitching them together, similar to what Google does with the Pixel and the results are pretty slick.