Skip to main content

Carnegie Mellon’s smart projector blurs the line between physical and digital desktops

Desktopography: Supporting Responsive Cohabitation Between Virtual Interfaces and Physical Objects
Back in the 1980s, people working on bringing the graphical user interface to PCs adopted the metaphor of the desktop to help people understand how to use their personal computers. Here in 2017, the technology exists to let us expand our computer interfaces out beyond our machines, and onto our real life desks.

That’s the basis for a new project developed by Carnegie Mellon’s ever-interesting Future Interfaces Group (FIG). They’ve created a nifty interface concept that allows your regular work desk to transform into one giant touchscreen — and even compensates for your desk being cluttered. If you thought the iPad Pro was big, you ain’t seen nothing yet!

Image used with permission by copyright holder

“We believe the time has come to re-imagine the light bulb as a 21st century computational appliance, illuminating our days not just with light, but information,” Professor Chris Harrison, head of FIG, told Digital Trends. “Instead of simply emitting light when a switch is flipped, why can we not emit structured light, more akin to a digital projector? Further, wherever the light may fall could become an interactive surface, infused with rich communication, creation and information retrieval capabilities. This is a low-cost, self-contained device that fits existing light fixtures: simply screw in your new ‘info-bulb’ and now your office desk or kitchen counter is an expansive multi-touch surface, able to respond to and augment your daily activities.”

The work debuted this week at the Symposium on Engineering Interactive Computing Systems. There are a few neat elements which make it particularly cool. For one, the projected augmented reality “info-bulb” manages to pull off touch sensing — while also retrofitting into standard flood bulb (BR30 LED) fittings, so it can be installed in most houses. In addition, the surfaces you can use it on don’t have to be flat, although Harrison notes that these are the most comfortable to use for prolonged periods. Finally, it includes some smart accessions to the fact that most desks aren’t simply large empty spaces by rearranging projected interface elements to avoid overlapping with your coffee mug, or even letting them “snap” to objects.

Image used with permission by copyright holder

As can be seen by the video demonstration, there’s still work to be done to areas like touch tracking to make it lower latency and improve accuracy, but this is definitely one heck of an impressive demo.

“We next plan to add a regular, visible light camera to our bulb so that we can better see information in the scene, things like written text, newspaper articles, and objects,” Harrison said. “This will let us digitize information and augment it — like Google searching right on a magazine article, digitizing hand-written shopping list, or popping up photos from your phone.”

A paper describing the work can be read here.

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more