Skip to main content

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

HoloLens concept lets you control your smart home via augmented reality

Hololens Hackathon Project: IoT x MR
There’s no doubt that device-filled connected smart homes are on the way. The real question is how we’re going to control them.

That was the starting point of a nifty proof-of-concept project created by interaction designer Ian Sterling and software engineer Swaroop Pal during a recent HoloLens hackathon in San Francisco. Their augmented reality pitch shows how smart devices could be controlled with glances and gestures — in what Sterling calls a “virtual Zen mode,” complete with calming lights and sounds.

“The primary goal of the app is to provide a 3D spatial UI for cross-platform devices — Android Music Player app and Arduino-controlled Fan and Light — and to interact with them using gaze and gesture control,” Ian Sterling, a design student at California College of the Arts, told Digital Trends.

“The connectivity between Arduino and a mixed reality device is something which holds a huge amount of creative opportunity for developers to create some very exciting applications — be it [Internet of Things], robotics, or other sensor data visualization. Besides this, our app features some fun ways to connect devices. Our demo featured a connection between a music player and a light in order to set a certain mood in your home.”

While the so-called IoTxMR concept is just a demo, Sterling thinks it signals the way our interactions with smart devices need to go. “I feel that in order for smart devices to be less obtrusive, while at the same time becoming more robust in functionality, new forms of interaction will be a requirement,” he continues. “Whether this is with a simple app on your phone, or using mixed reality software on your phone or wearable device — such as HoloLens or Magic Leap — we will be interfacing with our smart home devices through a separate piece of smart technology.”

Hey, if it means we get to feel like Neo from The Matrix, by controlling our devices with the simple wave of a hand, courtesy of Sterling and Pal’s “visually serene and relaxing” Zen mode, consider us sold.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Nest Secure will be discontinued in April – prepare your smart home with these steps
Nest Secure Review

Google is dropping support for Nest Secure on April 8, at which time users will see a complete shutdown of its features. Whether you're using it as a bridge for your smart lock or as a home security system, the device will no longer connect to the internet, rendering it obsolete.

Google has already reached out to impacted users to let them know about the impending shutdown, but is there a replacement for Nest Secure available in 2024? And what exactly can you do to prepare for the discontinuation in April? Here's a look at everything you need to know about Nest Secure.
Check ADT for a Nest Secure replacement

Read more
Daisy is an installation and repair company designed for your smart home
The Diasy logo on a white background.

Smart homes have become increasingly complex over the past decade. From smart locks and video doorbells to security cameras and smart displays, there are a lot of moving pieces in the average smart home -- and getting them all working properly has become a hassle. Daisy, a new home technology company revealed at CES 2024, hopes to alleviate this problem, offering a professional service that installs and provides regular maintenance for your entire fleet of smart home gadgets.

The goal of Daisy is to help consumers "spend more time using and enjoying the technology in their home and less time being frustrated." Many smart home devices can be surprisingly difficult to install -- such as smart locks or smart blinds -- and if you're not comfortable installing one yourself, it can be difficult to find a reliable professional to handle the task for you. But with Daisy, it's looking like you'll have a one-stop shop for all your smart home needs.

Read more
Kohler reveals luxurious smart home products that turn your bathroom into a spa
The Kohler Anthem+ on a white table.

Kohler showed off a bevy of new products at CES 2024, including a luxurious lineup of new smart home gadgets, all of which are designed to transform your bathroom into a "personal sanctuary." Along with updates to the Numi 2.0 smart toilet and high-end Stillness Bath, Kohler showed off a new fan, sink, and bidet, as well as smart valves and more.

The Anthem+ Digital Control was one of the most intriguing items at the Kohler booth, as can power nearly all aspects of your bathroom from a single control panel. Via its touch display, it allows you to control water, light, sound, and steam. All told, it can connect to 12 water outlets to power a variety of sprayers, showerheads, and body sprays.

Read more