Free thermal dataset for ADAS and autonomous vehicle testing

Teledyne FLIR has announced the release of an expanded free thermal dataset for advanced driver assistance systems (ADAS) and self-driving vehicle researchers and developers. The expanded thermal imaging dataset allows the automotive and academic community to quickly evaluate vehicle safety algorithm performance, neural network testing and thermal sensors, such as the FLIR ADK.

When combined with visible light cameras, LIDAR and radar, thermal sensors help create a comprehensive and redundant system to identify and classify roadway objects using sensor fusion data. Testing has demonstrated that thermal sensors are uniquely capable of seeing pedestrians, large animals and other vulnerable road users in conditions where current automatic emergency braking (AEB) systems are challenged, including in total darkness, most fog, smoke, shadows, inclement weather, and sun or headlight glare.

The expanded starter dataset nearly doubles the original free dataset and features more than 26,000 annotated images from the US, England and France in day- and night-time conditions. It also triples the number of categories and now includes person, bike, car, motorcycle, bus, train, truck, traffic light, fire hydrant, street sign, dog, skateboard, stroller, scooter and other vehicle labels.

“The industry-first free thermal dataset has been used by developers and as a tool in academic research to explore safety of automated driving technology with thermal imaging,” said Chris Posch, Director of Automotive Engineering at Teledyne FLIR. “The expanded dataset, with more images and categories, will further enhance detection and classifications models, especially focused on automatic braking capabilities as part of a multispectral, sensor-fused system.”

In an ongoing effort to make roads safer, 20 automakers committed to the US Congress that all newly manufactured cars and trucks will be equipped with AEB systems by 1 September 2022. Furthermore, high-profile testing and demonstrations from leading organisations demonstrate the need for more effective and intelligent systems to improve vehicle safety, especially in challenging conditions where thermal cameras excel. With the potential for millions of thermal-enabled AEB on vehicles, Teledyne FLIR anticipates the cost of its thermal sensor to continue to decrease significantly, which will encourage wide-scale adoption and ultimately enable safer vehicles and roads.

For more information and to access the enhanced free thermal dataset, visit https://www.flir.com.au/oem/adas/adas-dataset-form/.

Please follow us and share on Twitter and Facebook. You can also subscribe for FREE to our weekly newsletter and bimonthly magazine.