Skip to main content

Cosy, a robotics startup, can track your position in 3D space with a camera

cosy 3d tracking mothers day grocery
Aleksandar Mijatovic
Three-dimensional depth tracking is a complicated problem without an easy solution. Solutions like Microsoft’s Kinect, Google’s Tango platform, and Leap Motion’s peripheral can pick out walls and other obstacles with the help of custom sensor arrays, but they aren’t exactly plug-and-play — short of some duct tape and a lot of coding, getting them to talk to a robot, smartphone, or other device is an ordeal.

But Cosy, a startup founded by University of Pennsylvania graduate Jonas Cleveland, might have the solution — a software framework that combines neural networking and indoor positioning to pinpoint the location of robots, smartphones, and more in three-dimensional space.

And unlike most positional tracking technologies, which rely on infrared sensors to orient objects in rooms and hallways, Cosy’s platform works on any device with a camera. “It doesn’t matter the platform — it works on fixed cameras” Cleveland said. “A lot of folks claim you’re not able to achieve [3D mapping] without using lidar, but we’ve done it. It’s all post processing.”

The robot generates a “point cloud” as it runs through the store doing inventory. Image used with permission by copyright holder

It’s a little like Snapchat’s Lenses, which use computer vision and augmented reality to lay digital objects on top of real-world environments. Cleveland wouldn’t spill the beans on Cosy’s tech, some of which is patent-pending. But if it’s anything like Lenses, it takes into account factors like rotation, occlusion, and more in real time.

Cosy is applying it to retail — specifically inventory management. Robots that are four-and-a-half feet tall robots (“about the size of a fourth grader,” Cleveland said) equipped with the startup’s software navigate the store aisles autonomously, taking note of the products on shelves. They relay that data to a central server, which updates the store’s inventory database.

Cosy sees it lightening human workloads. “We’re empowering humans to do other things,” Cleveland said. “People are not very good at tedious and mundane tasks. Inventory is incredibly labor intensive, and very inaccurate — humans hate doing inventory. We’re checking stock and seeing where items are located in the store through software, without human assistance.”

It might not be long before you see a Cosy-powered ‘bot at your local department store. The startup is in talks with three of the top twenty U.S. retailers to deploy the inventory-checking robots in the next year. And in the future, Cosy hopes to adapt the tech to smartphones — Cleveland envisions an app that directs customers to a particular section of a store, for example, or even an exact shelf.

“When you can map indoor space and all the objects, that solves a lot of problems,” said Cleveland.

Kyle Wiggers
Former Digital Trends Contributor
Kyle Wiggers is a writer, Web designer, and podcaster with an acute interest in all things tech. When not reviewing gadgets…
Ceramic ink could let doctors 3D print bones directly into a patient’s body
ceramic ink 3d printed bones bioprinting australia 2

Scientists use a novel ink to 3D print ‘bone’ with living cells

The term 3D bioprinting refers to the use of 3D printing technology to fabricate biomedical parts that, eventually, could be used to create replacement organs or other body parts as required. While we’re not at that point just yet, a number of big advances have been made toward this dream over the past couple of decades.

Read more
Super Mario 3D World + Bowser’s Fury trailer reveals wild new game mode
Super Mario 3D World + Bowser's Fury

Nintendo released a new trailer for Super Mario 3D World + Bowser's Fury, which finally reveals information on the re-release's new mode. Bowser's Fury is an entirely new adventure that features a gigantic Bowser.

Super Mario 3D World + Bowser's Fury is a Nintendo Switch version of the 2013 Wii U game Super Mario 3D World. Nintendo previously revealed that the new edition would feature something called Bowser's Fury, but this is the first time the mode has been shown in any form.

Read more
Qualcomm’s long-awaited second-gen 3D Sonic fingerprint sensor is 50% faster
qualcomm 3d sonic sensor second generation ces 2021 2nd gen

Qualcomm wants to make its in-display fingerprint sensor a little bit more seamless. Its first-generation Sonic Sensor was introduced a few years ago, and at the time offered a decent experience -- but since then, has been overtaken in terms of speed and performance by competing optical sensors. Now, Qualcomm has finally launched a new, second-generation 3D Sonic sensor with big improvements.

The new sensor is 77% larger than Qualcomm's original 3D Sonic Sensor, measuring in at 8mm square, compared to the original's 4mm by 9mm. In other words, you'll be able to place your finger on a larger portion of the screen, making the overall experience a little more seamless.

Read more