STMicroelectronics STSW-IMG035 gesture recognition software

Click2Contact

STMicroelectronics has launched free engineering software for touchless gesture-based controls in simple consumer and industrial applications, to be used with the company’s VL53L5CX FlightSense time-of-flight (ToF) multi-zone ranging sensor. Gesture recognition with ToF sensors is a breakthrough technology that enables sophisticated interactions with a wide variety of devices.

Initially a feature of high-end vehicles, gesture-based interaction can enhance numerous types of equipment, including kitchen appliances, thermostats, smart-home and smart-lighting controls, laptops, AR/VR headsets, tablets and smartphones. ST is now making gesture detection simple for mass-market applications with the companion software for its multi-zone ToF ranging sensor. Together, the sensor and software calculate in real time the X/Y/Z coordinates of the hand, enabling hand tracking and thus recognition of gestures like tapping, swiping, level control and more.

Conventional gesture-recognition systems typically use intrusive camera-based machine vision. ST says its solution lets designers build systems that benefit from greater user privacy and lower power consumption, and that work in the dark without needing external illumination, unlike vision-based solutions. The lightweight gesture algorithm can run on a low-power microcontroller and demands minimal system resources, so is easily integrated in an existing application.

The STSW-IMG035 software package is specially designed for the VL53L5CX multi-zone direct time-of-flight (dToF) ranging sensor and can be used with all STM32 microcontrollers. The ToF sensor provides 64 zones with high accuracy ranging up to 400 cm with a wide, square-edged, 63° diagonal field of view. The turnkey gesture package features resources including a GUI, example code and libraries.

For more information: https://www.st.com/en/embedded-software/stsw-img035.html.