Benefits of sensor data fusion for driver assistance systems
The multi purpose camera and radar sensor complement each other perfectly. Thanks to its technology based on radio frequencies, the radar sensor is particularly good at measuring longitudinal distances and speeds irrespective of the weather conditions, while the multi purpose camera features a very high level of precision when it comes to lateral measurements. Thanks to LED flicker mitigation mode implemented in the hardware even flickering light sources like pulsed LED lights from traffic signs, traffic lights, turn and brake lights can be captured without over-saturating the image (by e.g. long exposure times).The use of artificial intelligence helps to improve lane detection regardless of lines and boundaries, thus increasing the availability of functions. With the help of powerful software algorithms during sensor data fusion, objects can be acquired, classified, and tracked reliably. The result is a highly detailed and authentic “picture” that provides the basis for robust interpretation of the vehicle’s surroundings. This greatly reduces erroneous warnings and increases the performance of functions.
The radar sensor and multi purpose camera combination makes it possible to implement further assistance and safety functions, such as automatic emergency braking to prevent collision with vehicles ahead and protect pedestrians. If the driver doesn’t react in the event of an impending rear-end collision and both sensor systems detect the critical object, the assistance function will automatically intervene and trigger a full emergency stop.
Sensor data fusion can also significantly enhance functions in the area of comfort and convenience. Thus, for instance, thanks to the lateral measuring accuracy of the multi purpose camera, the adaptive cruise control (ACC) can detect a vehicle entering the driver’s own lane – either planned or unplanned – much earlier, enabling the system to respond more dynamically. With the help of the radar sensor, the system can correctly identify the lane in which the vehicles ahead are driving, thus enhancing the capabilities of the ACC, particularly on curvy stretches of road. Thanks to sensor data fusion, the radar sensor system can incorporate the speed limits identified by the video sensors into the driving strategy of the assistance system. This increases the safety and reliability of the driver assistance system.
The fusion of radar sensor and multi purpose camera data is also highly relevant for automated driving. The Bosch road signature makes it possible for automated vehicles to determine their precise position and enables highly accurate and robust vehicle localization based on road features. In this context, radar and camera sensor systems and the fusion of their data provide important information on objects in the vehicle’s surroundings. While the video sensor system is able to detect relevant features in the surroundings of the vehicle, like road lanes and traffic signs, the radar sensor can identify stationary features, such as guardrails and traffic sign gantries. The fusion and processing of this collected data provides a constantly updated picture of the surroundings to help with high-precision localization.