Skip to main content

Microsoft wants to stick a sensor close to your eyes to see where you’re looking

Microsoft HoloLens bottom angle
Matt Smith/Digital Trends
As computers become more integrated with our senses through augmented reality (AR) and virtual reality (VR), methods to better track what we’re sensing — or would be seeing in the real world — are becoming more and more important. This technology will also serve to increase accessibility to anyone regardless of physical abilities.

How well a computer can determine what we’re looking at is a highly important factor both in achieving more accurate AR and VR, and in helping those with physical challenges. Apparently, Microsoft has been working on a solution, as MSPU reports.

According to a Microsoft patent application, the company is working on new technology to better track a user’s eye-gaze direction. The purpose, according to the patent, would be to aid users in interacting with a computer to overcome the inability to use a mouse to move a cursor, and to help whenever a user’s hands are otherwise occupied, such as in connection with industrial control, aviation, and emergency room situations. Of course, such technology would also be of use in AR and VR applications.

As MSPU points out, Microsoft’s current premier AR solution, HoloLens, only detects where a user’s head is facing, with a line extending straight out from between the user’s eyes representing the direction of the user’s gaze. The technology outlined in the patent, however, would use a combination of sensors and processors to ascertain where the user’s eyes are actually gazing, independent of head position.

microsoft-eye-tracking-patent-1
Image used with permission by copyright holder

While other systems serving this purpose currently exist, Microsoft characterizes them as costly, complex, requiring excessive power, and bulky. The patent outlines a system that serves to reduce size, complexity, and power requirements while improving accuracy in determining eye movement and direction.

microsoft-eye-tracking-patent-2
Image used with permission by copyright holder

Basically, the system would determine eye-gaze direction relative to the user’s head direction — such as looking left while the user’s head is facing to the right — and would therefore work better for AR and VR applications than would systems that are fixed in space in front of the user. Capacitive sensors would be used that sit close enough in front of the eye to detect the eye’s bulge and would be specifically configured for a user’s physiology. A contact lens with conductive material could also be placed on the eye to enhance the responsiveness of the capacitive sensor.

As always, patents are filed for all sorts of inventions that never see the light of day. If this one makes it through to actual product development, then Microsoft will have created a cost-effective, accurate, and speedy way to sense where you’re looking. That would pay dividends for future AR and VR applications and would also help anyone who faces challenges in using a computer with a traditional keyboard and mouse.

Mark Coppock
Mark has been a geek since MS-DOS gave way to Windows and the PalmPilot was a thing. He’s translated his love for…
A dangerous new jailbreak for AI chatbots was just discovered
the side of a Microsoft building

Microsoft has released more details about a troubling new generative AI jailbreak technique it has discovered, called "Skeleton Key." Using this prompt injection method, malicious users can effectively bypass a chatbot's safety guardrails, the security features that keeps ChatGPT from going full Taye.

Skeleton Key is an example of a prompt injection or prompt engineering attack. It's a multi-turn strategy designed to essentially convince an AI model to ignore its ingrained safety guardrails, "[causing] the system to violate its operators’ policies, make decisions unduly influenced by a user, or execute malicious instructions," Mark Russinovich, CTO of Microsoft Azure, wrote in the announcement.

Read more