Features and functionality of the multi purpose camera generation 3
In detecting and processing objects and structures with maximum reliability, the third-generation multi purpose camera from Bosch plays an essential part for cutting-edge driver assistance systems and partially automated driving. It utilizes an innovative, high-performance system-on-chip (SoC) with a Bosch microprocessor for image-processing algorithms. Its unique multipath approach combines classic image-processing algorithms with artificial-intelligence methods for comprehensive scene interpretation and reliable object detection.
With its algorithmic multipath approach and the innovative system-on-chip, this generation of cameras has been specially developed for high-performance driver assistance systems. For example, in line with this approach to image processing, the multi purpose camera uses the following technical paths simultaneously: The first of these is the conventional approach already in use today. Via programmed algorithms, the cameras recognize the typical appearance of such object categories as vehicles, cyclists, or road markings.
The second and third paths are new, however. For the second path, the camera uses the optical flow and the “structure from motion” (SfM) to detect road-limiting raised objects such as curbs or safety barriers. The motion of associated pixels is tracked. The camera uses this information in the two-dimensional image to approximate a three-dimensional structure of the surroundings.
The third path relies on artificial intelligence. On the one hand, thanks to machine-learning processes, the camera has learned to classify objects such as cars parked by the side of the road. On the other hand, the latest generation can differentiate between surfaces that are part of the road and those alongside the road via neuronal networks and semantic segmentation. Additional paths are used as required: These include classic procedures for line identification or light detection.
The camera’s design fully satisfies the requirements of driver assistance systems to enhance safety, comfort, convenience, and efficiency. Its detection characteristics make it suitable for a wide range of partially automated functions, such as lane departure warning assistants. The camera satisfies numerous legal requirements, such as UN regulation UN R130 concerning the lane departure warning system (LDWS) in Europe, in addition to the many functions mandated by regional laws. In addition, the camera supports object-based functions for automatic emergency braking or adaptive cruise control (ACC) by supplying a control unit with relevant information via the integrated system interface.
The camera not only serves as a basis for many different safety functions: It also facilitates a number of driver information and comfort functions, such as intelligent headlamp control and road sign information. In combination with the connected horizon, the camera is ideally matched to legal requirements set out by the General Safety Regulation (GSR) concerning the intelligent speed limit assist (ISA).
