Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
The Reinvention of the Car
How to Consider Safety Aspects for Launching Autonomous Driving
Dr. Michael Hafner, 10.10.2018
Vice President Drive Technologies and Automated Driving
Daimler AG
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
ADAS: advanced driver assistance systems The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 2
The Reinvention of the car … happens in four main pillars
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
1. Innovations in series cars: ADAS Update
2. Why full vehicle automation makes sense: Motives
3. Where are we heading to: SAFE Technology
ADAS: advanced driver assistance systems The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 3
The Reinvention of the car – autonomous and accident free
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
Mercedes-Benz has the
longest history in ADAS1997 Sandwich Concept
2002 PRE-SAFE®
2003 Active Light Functions
1996 Brake Assist System
2006 PRE-SAFE® Brake, Intelligent Light System
2007 Blind Spot Assist2008 Active Park Assist
1995 ESP®, Sidebag
1998 Distronic Windowbag, Adaptive Airbags
2009 Attention Assist, Adaptive Highbeam Assist, Lane Keeping Assist, Speed Limit Assist, Self-Adaptive Rear Belt Force Limiters
2000 Integral Safety Approach
2005 Adaptive Brake Lights, Brake Assist System BAS PLUS,
NECK-PRO Head Restraint
2010 Active Blind Spot Assist, Active Lane Keeping Assist
1978 ABS1980 Airbag, Belt Tensioner
1989 Automatic Rollover Bar
2011 COLLISION PREVENTION ASSIST, PRE-SAFE® Brake with City Braking Function, Night View Assist with
Spotlight-Function
2012 360° Camera, Side Wind Assist by ESP®
2013 Intelligent Drive: DISTRONIC PLUS with Steering Assist and Stop&GoPilot, PRE-SAFE® Brake with
Pedestrian Detection, BAS PLUS with Cross Traffic Assist, PRE-SAFE® PLUS, PRE-SAFE® Impulse, Beltbag, MAGIC
BODY CONTROL, Adaptive Highbeam Assist Plus
2014 COLLISION PREVENTION ASSIST PLUS
2016/17/18 Intelligent Drive Next Level: Map enhanced Active Distance Assist DISTRONIC and Active Steering
Assist, Active Lane Change Assist, Active Speed Limit Assist, Active Emergency Stop
Assist, Active Brake Assist with Cross Traffic Function, Evasive Steering Assist, PRE-SAFE®
Sound, PRE-SAFE® Impulse Side
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 4
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
Mercedes-Benz Driver Assistance Package
Active Distance Assist DISTRONICo Route based speed adjustment
o Active Speed Limit Assist
Car-to-X Communication
Active Blind Spot Assist
PRE-SAFE®
Sound
PRE-SAFE® PLUS
Evasive Steering Assist
Active Lane Keeping Assist
Active Steering Assisto Active Lane Change Assist
o Active Emergency Stop Assist
MULTIBEAM LEDo ULTRA RANGE high beam
ATTENTION ASSIST
Active Brake Assistwith Pedestrian Detection, Cross-Traffic Function and
Congestion Emergency Braking Function
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 5
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
Map Based Speed Adjustment
Driver Assistance Package: Route Based Speed Adaption for advanced comfort
• Predictive speed reduction before curves, intersections, roundabouts, tollbooths
and for turning based on map data
• Speed adaption is related to DRIVE SELECT (ECO/COMFORT/SPORT) incl. sailing downhill in ECO-Mode in selected engines
• Vehicle will not be stopped due to oncoming or crossing traffic, e.g. at roundabouts or intersections
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 6
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
Intelligent Real-Life-Safety… only assist if neccessary
Animation Active Braking Assist with Cross-Traffic-Function
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 7
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
Animation Evasive Steering Assist
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
Animation Intelligent Drive
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
Field Validation of Driver Assistance Systems at Mercedes-Benz
Testing around the World
© OpenStreetMap contributors The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 10
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
Why full vehicle automation makes sense:
Motives
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 11
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar:
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 12
Different Reasons for Vehicle Automation
Shared Mobility =
Lower Traffic Density
Growing mobility
needs & urbanization
Towards
Zero Emissions
Customer centered
mobility = Comfort
Use Time more
effectively
Seamless customer
journeys
Maturity of
Technology
More affordable
Transportation
Max. connectivity of
vehicle / services
Improved Road
Safety
‘The last 130 years of automobile were exciting, but the
next few years will be much more interesting.’
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 14
SAFE TechnologyWhere are we heading to?
15The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018
Folie in Ursprungsform
Wechsel des Folienlayouts
im Menü über:
Start // Absatz // Listenebene
Wechsel zwischen weißem und
schwarzem Folienlayout über Menü:
oder
Self Driving Car Sensor Set to handle all relevant Use Cases
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 16
Lidars + Cameras on the rooftop Stereo and Traffic Light Camera behind windscreen
Radar, Lidar and Ultrasonic
at the front
SVS and Radar around the car
Radar and Ultrasonic at the rear
Detect end of laneLost cargoLane change at night
Traffic lightsEmergency vehicles
Parking and driveaway
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar: Safe system architecture by redundancies in sensors, processors,
actuators, power supply and functional algorithms
17ECU= Electronic Control Unit, CPU= Central Processing Unit, GPU= Graphics Processing Unit The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 17
Sourround Cam
Lidar
Radar
GPUStereo CameraSensor ECUs
fail-safe
Sensor-Fusion
& Driving
fail-safe
AI
AI
AI
AI
Actuation
fail-operational
GPU
GPU
GPU
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar: Artificial Intelligence (AI) is Key to understand Sensor Data
Dense Data ClassificationMotion DetectionFusion &
Localization
Situation
Analysis
Maneuver
Planning
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 18
Cross
Modality
Fusion
Mic Fusion
Video
Perc.
Lidar
Perc.
Radar
Perc.
Env. Model
Beh. Gen.
Planning
USS Fusion
Loc
HD Map
MAP DOWNLOAD
Radar
Camera
Lidar
ECU
AI
CloudAI
AI
AI
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar: Test your own perception capabilities vs. a Neural Network
Check the image for three (3!) seconds and then have a look at the result of the Neural Network, which had
only a mere 30 milliseconds glance at it. Ready to start?
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 19
Not sure whether some “New Players” would have detected the crossing truck ...
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar: Daimler has published the Cityscapes Dataset
50 major German Cities
5000 precisely labeled frames
>4000 downloads
www.cityscapes-dataset.com
CNN
AI
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 20
Universities/Experts can compare the performance of their CNNs
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar: Relevant data is needed to finalize the Software Development
Complete Scene Book Adequate Training Data Set Independent Validation Data Set
Sequences
Sequences
Ground Truth
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 21
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar: Image Understanding: CNNs only perform well,
if training data and training parameters are chosen carefully
Example: Night performance of CNN: if trained with day data…
… and if trained with proper night data
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 22
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar:
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 23
Intelligent World Drive – experience and data from five continents
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar: ISO 26262 Development: Safe Setup and full validation of
Lev. 4-5 is key
Safety Diver is responsible driver!
Driver qualification - DAI
• Safety driver training and qualification
based on evaluation of take over
maneuvers
• Second person in car for system
operation
• Regular safety driver instruction
• Safety concept approved by TÜV
SW-Testing
EE HiL test rigs
proving grounds,
test facilities
24
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 25
Daimler joined forces with Bosch in common Project House to
combine strenths of OEM and Tier1
• Vehicles
• Integration of systems
in vehicle line
Common Development of AD-Kit to be used in Robo Cars
+
Sensor Algorithms
Motion Control
Environment Fusion
Behavior Generation
System
Testing
IT & Process Support
Vehicle Control Center
• Hardware (Sensors,
Actors, ECUs)
• Software for HW
components
Embed. SW Infrastr.
Project House with locations in Germany and USA
Functionally SAVE acc. to ISO26262
Artificial Intelligence enabler for Autonomous Driving (Nvidia)
Nvidia – partner in key technologies
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 26
Nvidia on Technology level:
• Object Detection and Classification, e.g. Vulnerable Road Users
• Functional Safety Hardware Architecture
Nvidia on Device level:
• Used in distributed domain architecture
• Xavier as main brain
• AI 30 TOPS* at 30watts
Nvidia on System level:
• Drive Peagasus Reference Platform
• AI Processors, Frameware & Toolchain
* Trillion operations per second
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar: Enjoy a short demo drive … through the eyes of a car
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 27
Reset the slide back to its
Change the slide layout
via menu bar:
Alternating between white and black
slide layouts via menu bar:
The Reinvention of the Car | Dr. Michael Hafner | 10.10.2018 28
The Reinvention of the car is happening right now …
… and will revolutionize future mobility …