Skip to main content

Spectator View provides a looking glass for all to see HoloLens holograms

microsoft hololens spectator view dslr
Image used with permission by copyright holder
As we saw 30 minutes into Microsoft’s recent Windows 10 Creators Update press event, the company can display what a HoloLens user sees in real time to a general audience. For instance, Microsoft “experience designer” Taj Reid pulled a holographic chair out of a floating web browser and positioned it on the stage. While he experienced all of this in first-person, the audience could see the same objects in a third-person view though the event’s large displays or via the online broadcast. Now Microsoft wants to bring this “spectator view” to all HoloLens developers.

During October’s press event, Microsoft brought out a special camera that captured Taj Reid’s demo in real time while simultaneously rendering the holograms into the live feed. Microsoft wants developers to create a similar camera by offering documentation based on its camera design, aka the Spectator View Camera. The use cases for this setup include snapping images of HoloLens wearers as they interact with holograms, live demonstrations, and video capture.

“Since a HoloLens can only be worn by one person, how do you open the view so everyone can see what that person sees? To solve this problem, we developed Mixed Reality Capture (MRC) to aid in the visualization of holograms that the wearer is seeing from a first-person perspective,” said Microsoft’s Brandon Bray in a blog on Monday.

For photo and video capture, Microsoft tested its Mixed Reality Capture technology on the Canon EOS 5D Mark III camera ($2,500) while it tested the Blackmagic Design Production Camera 4K for live demonstrations ($3,000). However, any camera with HDMI output should work, as should any add-on camera lens. Microsoft uses the Canon EF 14mm f/2.8L II USM Ultra-Wide Angle Fixed Lens ($2,100).

The camera setup consists of a tripod, a DSLR camera, a hot shoe fastener to mount a hot shoe adapter, a 3D printed adapter to connect the HoloLens mount to the camera’s hot shoe, and a machined aluminum bracket holding a HoloLens unit. The whole setup can connect to a capture card installed in a PC to preview the composite scene. Microsoft has already tested the setup using the Blackmagic Design Intensity Pro 4K capture card ($190).

On the software side, here is what developers will need:

Instructions on how to build the camera can be found here. Microsoft also provides an online Holograms 240 class showing developers how to create a shared experience through HoloLens and Windows 10 apps via Microsoft’s Universal Windows Platform. Of course, shared experiences require at least two HoloLens headsets, which cost $3,000 each.

The ultimate purpose of Spectator View is to provide a stable, third-person composite view of the HoloLens user and the holograms. Spectators can follow along with the experience without suffering through a nausea-causing “shaky cam” viewpoint created by head-mounted cameras.

Editors' Recommendations

Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
Power up your tech game this summer with Dell’s top deals: Upgrade for a bargain
Dell Techfest and best tech on sale featured.

One of the best times to upgrade your tech stack, be it your desktop, a new laptop, or some high-resolution monitors, is when great deals are to be had. Well, I'm here to share that thanks to Dell's top deals, you can power up your tech game and have most of the summer to make it happen. Maybe you're happy with your current system or setup. That's excellent, but you're likely considering upgrading somewhere, and that's precisely what these deals are all about. Dell has a smorgasbord of deals on laptops, desktops, gaming desktops, monitors, accessories, and so much more. We'll call out a few of our favorite deals below, but for now, know that you should be shopping this sale if you're interested in anything tech-related.

 
What summer tech should you buy in Dell's top deals?

Read more
I love the MacBook Pro, but this Windows laptop came surprisingly close
Apple MacBook Pro 16 downward view showing keyboard and speaker.

There are some great machines in the 15-inch laptop category, which has recently been stretched to include the more common 16-inch laptop. The best among them is the Apple MacBook Pro 16, which offers fast performance for tasks like video editing and the longest battery life.

The Lenovo Yoga Pro 9i 16 is aimed not only at other 16-inch Windows laptops but also at the MacBook Pro 16. It offers many of the same benefits but at a lower price. Can it take a place at the top?
Specs and configurations

Read more
How to set an ‘Out of Office’ message in Microsoft Teams
Person using Windows 11 laptop on their lap by the window.

Many people use Microsoft Teams regularly to communicate with colleagues both inside of the office and remotely. It is considered one of the most efficient ways to ensure you can stay in contact with the people on your team, but what if you need to let people know you’re not readily available? Microsoft Teams has a method for you to set up an "Out of Office" status for your profile to let staff members know when you’ll be gone for the afternoon, for several days on vacation, or for an extended period.
Where do I go to set up my ‘Out of Office’ status for Teams?
It is important to note that your Microsoft Teams and Outlook calendars are synced. This includes your out-of-office status and automatic replies. So, whatever you set up in Microsoft Teams will reflect in Outlook. Similarly, you can set up your out-of-office status in Outlook, and it will be reflected in Teams; however, the former has a more straightforward instruction.

First, you can click on your profile icon in Teams and go directly to Schedule an out of office, as a shortcut. This will take you to the settings area where you can proceed. You can also click the three-dot icon next to your profile icon, then go to Settings > General, then scroll down to the bottom of the page. There, you'll find out-of-office settings and click Schedule.

Read more