Skip to main content

Samsung's IBM-powered image processor capable of 2,000 frames per second

Samsung demos IBM's brain chip in a gesture recognition app
IBM’s TrueNorth neural computing chip is an exciting piece of technology, as it changes the way we look at how processors are built, potentially making them far more efficient. Looking to take advantage of that technology as soon as possible, Samsung has begun implementing that design into its latest image processor, one that is capable of 2,000 frames per second, slow-motion video.

Unlike traditional processors, IBM’s TrueNorth utilizes 4,096 microcomputing cores to form a single processor. The idea is that it operates a bit more like how the human brain handles information, with the hope that it will be more efficient. In many ways it is, as this incredibly low-power chip is already proving more than capable for the job Samsung wants it to do.

Put together at the Samsung Advanced Institute of Technology, the Dynamic Vision Sensor with TrueNorth at its core is able to process video images very quickly and efficiently, because it does things differently.

Each pixel on the sensor operates entirely independently and only reports back if it detects a change. That means static scenes, or those with less movement, require far less resources to be rendered, even in video. This is what makes it possible for cameras equipped with the sensor to take slow-motion video to the tune of 2,000 frames per second, more than 15 times what the average high-speed camera is capable of.

But more than just taking shake video of your new puppy, these sorts of sensors can have far-reaching capabilities. Automated safety features, especially in autonomous vehicles, could make use of such a sensor, as could cameras that recognize motion controls and gestures.

As CNET explains, the demo Samsung used to show off the technology showcases a person controlling their TV using gestures as diverse as a closed fist, split fingers, waves, and pinches. That’s far more advanced that we’ve seen with similar tracking technologies in recent years from the likes of Microsoft’s Kinect camera.

The military is also sniffing around the technology, which offers potential for drones and remote camera systems to detect unusual changes in video streams.

Jon Martindale
Jon Martindale is the Evergreen Coordinator for Computing, overseeing a team of writers addressing all the latest how to…
A dangerous new jailbreak for AI chatbots was just discovered
the side of a Microsoft building

Microsoft has released more details about a troubling new generative AI jailbreak technique it has discovered, called "Skeleton Key." Using this prompt injection method, malicious users can effectively bypass a chatbot's safety guardrails, the security features that keeps ChatGPT from going full Taye.

Skeleton Key is an example of a prompt injection or prompt engineering attack. It's a multi-turn strategy designed to essentially convince an AI model to ignore its ingrained safety guardrails, "[causing] the system to violate its operators’ policies, make decisions unduly influenced by a user, or execute malicious instructions," Mark Russinovich, CTO of Microsoft Azure, wrote in the announcement.

Read more