Sense – Bosch provides the automated vehicle with all of its senses

Info package for download

Download all important system information here.

Information package for drivers

Everything about Sense at a glance

Infographic Sense

Information package for journalists

Everything about Sense at a glance

Infographic Sense

Surround sensors: the eyes and ears of automated cars

In order to drive autonomously and safely, self-driving cars always need to be focused on their surroundings with the aid of their surround sensors (“Sense”). Cameras, radar and ultrasonic sensors are the eyes and ears of an automated car and supply all the information required by the vehicle to perceive its entire surroundings. Additional sensors are even aligned inward into the passenger compartment, enabling the system to make autonomous decisions as to whether the driver is capable of taking control of the vehicle again if necessary.

But automated cars are aware of even more than their immediate surroundings: using up-to-date, high-resolution digital maps and connected real-time data from the cloud, the vehicle can also access external information such as traffic or weather data. Taken together, the vehicle therefore avails of a solid basis of information for the smart vehicle computer, which uses it for exact calculations. For a safe and relaxing drive in a self-driving car.

fewer accidents

Using sensory data of the car’s surroundings, automated vehicles can detect critical situations faster and avoid them better than human drivers.

more relaxed driving

Automated vehicles can detect monotonous situations like traffic jams and take over the driving task. Thus, drivers reach their destination more relaxed.

Sensors for the surroundings: you visualize your environment, your car processes thousands of images

But what’s happening around the vehicle? One requirement for automated driving involves reliable and precise perception of the surroundings. As the vehicle is required to move autonomously in real traffic situations, it must be able to detect and localize all relevant road users within the entire vehicle environment (360 degrees). This entails several sensors applying various surveying principles to monitor each area of the vehicle’s surroundings. This improves the reliability and stability of information. Most of the sensors required for these tasks are already in volume production today. For example, partially automated systems are already available which support drivers in difficult situations. These include remote park assist, garage park assist, home zone park assist, traffic jam assist or highway assist.

In specific cases radar, video and ultrasonic sensors are not sufficient to deliver plausible data of two sensors constantly. Which is why Bosch is working on new sensor technologies to meet the high demands on surroundings perception. The data provided by individual sensors are combined and processed to form a comprehensive environmental model representing all static and dynamic objects. Entirely new hardware and software technologies and new algorithms are used for this calculation.

The standard combination of radar, video and ultrasound technology is not, however, capable of covering all applications, which is why Bosch is working on new sensor technologies to meet the high demands on surroundings perception. The data provided by individual sensors are combined and processed to form a comprehensive environmental model representing all static and dynamic objects. Entirely new hardware and software technologies and new algorithms are used for this calculation.

Various sensor technologies cover the entire vehicle surroundings.

Navi 4.0: sensors, digital maps and connectivity heighten the car’s sense of orientation

High-definition digital maps point automated vehicles in the right direction

A basic requirement for highly and fully automated driving is represented by vehicle localization which must be both exact and constantly available. A single sensor is unable to fulfill these requirements which is why a combination of surround sensors (for detecting landmarks such as lane markings and buildings) with satellite navigation and correction service as well as inertial sensors and a digital map is used. High-definition digital maps are used for this purpose which contain far more layers of information than the maps for standard sat-nav devices. They also support the automated vehicle in planning individual driving maneuvers, e.g. whether the vehicle should change lanes or not. Through connectivity with the cloud, the data contained in the maps are constantly updated enabling inclusion of dynamic factors such as temporary closed lanes in travel plans. For the so-called road signature, Bosch has developed a pioneering solution for creating key parts of high-definition maps using vehicles’ radar and video sensors, literally as they drive by.

Road condition services help automated cars to drive even better

Information on current road conditions is also required by automated vehicles in order to detect potential dangers at an early stage and to ensure safety during driving. For these innovative road condition services, Bosch uses weather data supplied by its partner Foreca in a first expansion stage, in order to draw conclusions about possible hazards such as aquaplaning, ice or snow. Automated cars can then adapt their driving behavior to the respective conditions, choose a different route or ask the driver to take control if a safe onward journey cannot be guaranteed in automated mode.

In the future, Bosch will be supplementing its predictive road condition services to include data from the vehicle. What inside and outside temperatures are measured by the car? Are the wipers activated? Connectivity means that such information does not stay unused in the vehicle but reaches the cloud through the respective manufacturer’s backend. Bosch also evaluates the control interventions by the ESP® skid protection system in order to determine the friction value and condition of the road surface. All data combined and evaluated intelligently result in a smart Bosch service – and a feeling of safe automated driving.

Sensors for the driver: What happens if the driver does not take control?

Highly and fully automated functions need to monitor the driver as well as the vehicle’s surroundings. After all, drivers are not obliged to monitor the system when these functions are in operation. They can pass full control to the system, at least for a certain period of time or for a defined situation, after which the driver is requested to take control of the driving task – and the vehicle must be able to detect if the driver is capable of doing so. Bosch has already developed systems such as driver drowsiness detection which constantly monitors the driver and issue warnings in dangerous situations such as fatigue or microsleep.

The system passing driving responsibility to the driver remains a challenge for engineers. How is the driver informed, how long does the driver need to take over? What happens if the driver does not take control? One possible scenario: If the driver fails to take over, even after multiple alerts, as the car approaches a freeway exit, the automated vehicle would stop autonomously on the hard shoulder.

Automated vehicles must have three fundamental skills: They need to perceive and interpret (Sense) their surroundings, use this information to make forecasts and derive a suitable driving strategy (Think), and then implement it reliably and safely (Act). Sensing the immediate environment is the task of the surround sensors which combines camera, radar and ultrasonic. Vehicle intelligence enabling it to interpret its surroundings and find the optimal driving strategy is made possible by software and algorithms which use the information gleaned from sensors as well as data from other connected systems.

Systems such as the powertrain, steering and brakes ensure that the respective driving strategy is then implemented on the road. This process of sensing, thinking and acting takes place during the entire journey. When applied to human beings, this process is similar to constant interactions in the body during which the sensory organs pick up stimuli which are processed by the brain before the nerve pathways, muscles and limbs implement the brain’s control signals as actions.

More about Think

Contact +49 (0)711 400 40990
Start request
Your Industry and concern
Next
Your message
Next
Your personal details
Next
Close
Trade fairs and events

Exchange ideas with our
experts on site.

Detailed overview
Media Center

Download more information on this subject.

More information
Registration Media Service (E-Mail and RSS Feeds) Register now
Media Center
Topic overview and press releases