New Sony Patent Could Use AI and a Camera Pointed at Your Fingers to Work Out What Button You’ll Press Next

Sony's New Patent Aims to Reduce Gaming Latency with AI and Sensors

A recently filed Sony patent reveals a potential solution to reduce input latency in future gaming hardware. The patent, WO2025010132, titled "TIMED INPUT/ACTION RELEASE," utilizes an AI model and additional sensors to predict user inputs, thereby minimizing the delay between input and on-screen action.

Sony's PlayStation 5 Pro already features PlayStation Spectral Super Resolution (PSSR), an upscaler. However, newer technologies like frame generation can introduce latency, impacting responsiveness. Competitors AMD and Nvidia have addressed this with Radeon Anti-Lag and Nvidia Reflex, respectively. Sony's patent suggests a similar approach.

The patent describes a system incorporating a machine-learning AI model that anticipates user commands. This prediction is aided by an external sensor, potentially a camera observing the controller, to identify the impending input. The patent specifically mentions using camera input as input to the machine learning model. Alternatively, the sensor could be integrated into the controller itself, possibly leveraging analog buttons.

While the patent's exact implementation in a future PlayStation console (like the PlayStation 6) is uncertain, it indicates Sony's commitment to mitigating latency issues. This is particularly relevant given the increasing prevalence of frame generation technologies like FSR 3 and DLSS 3, which often add latency.

The technology would be particularly beneficial for fast-paced games requiring both high frame rates and low latency, such as twitch shooters. However, the ultimate application of this patent in future hardware remains to be seen.