/ ()

Marcus Oh

Sr. Solution Architect in NVIDIA AutomotiveCo-founder of ITPANDA (www.itpanda.co.kr)

ITPADNA has open positions for developer at Web backend or embedded Linux. ( webmaster@itpanda.co.kr )

Personal contact ( nicemin@gmail.com )

http://www.itpanda.co.kr/mailto:webmaster@itpanda.co.kr

What happen to Automotive industry?

Big Trend in Automotive

S/W comes into the pictureIVI system has been centralizedConnectivity

TelematicsSmart phone connectivityVehicle Network

UI/UX DifferentiationAutonomous vehicle

ADAS(Advanced Driver Assistant System)

New device extensionDigital Cluster and Intelligent Cockpit

Evolving to Complicated and Integrated vehicle

Power trainSuspensionMechanical Engineering

InfotainmentTelematicsSafety & Convenience

Connected carAutonomous carElectrical vehicle

SW become more important

20% of the price of modern automobiles is attributed to embedded electronics in 2012 and will rise to 35-40% by 2015 50-70% of the ECU development costs are attributed to software85% of the functionality in modern automobiles is now controlled by software

Source: Daimler Presentation at WOC 2012

Automotive Solution overview

REAR SEAT ENTERTAINMENT

HEAD UP DISPLAY / AUGMENTED

REALITYINSTRUMENT

CLUSTER

ADVANCED DRIVER ASSISTANCE

SYSTEMSNAVIGATIONInfotainment

COMPUTER VISION

TelematicsSystem

Call Center Data Center

IVI (Inner Vehicle Infotainment)

Major Features in IVI

AV systemFM/AM/HD RadioDMB/DAB/XMUSB StorageiPod connection

NavigationBluetooth Rear View CameraDiagnostic and settingSmartphone connection and App downloadVoice Recognition

Operating system in IVI

Traditional / Proprietary VxWorksT-Engine/ITRON MS Windows Embedded Automotive QSS QNX

GENIVI Compliant Software Platforms Canonical Ubuntu MeeGoTizenMentor Embedded / Nucleus Monta Vista Linux Wind River Linux

Google Android Autosar (OSEK OS)

IVI S/W platform landscape

Proven history in AVN, but stability?

Proprietary

Low/mid-range segments

Ford/HKMC, popular in Asia where aftermarket cross over product favors WinCE

Little growth foreseen with the continued concerns around stability, boot time and royalties

2006 deployment

No.1 IVI OS but..

Proprietary

Micro kernel RTOS

Mainly used by Harman (previous owner) and Japanese Tier1's

Market share would drop sharply if Harman moved OS strategy

Rich product offering with many of IVI features available pre-bundled.

QNX Car2 Framework

2002 deployment

Gaining momentum with major sourcing starting to happen

Open source

Open media framework

Pre-developed CAN/MOST solutions

BMW, GM, Honda, HKMC, JLR, Renault/Nissan, PSA

Solution is getting richer with additional modules and features being added.

2013-14 deployment

Dominant consumer electronics world

Open source

Some small penetration in auto market

Little sourcing continues: Renault/HKMC/LG & Chinese OEMs/Tier1s.

No interest from Google for Automotive

Go it alone if you select Android.

2012-13 deployment

Driven by Linux Foundation

Open source

Work with TIZEN IVI project

Targeting multiple ECUs (IVI, Cluster, Telematics, )

Toyota, Nissan, JLR, Intel and mostly Japanese Tier1s & Silicones

Competing against or collaborating with GENIVI??

2014-15 deployment

2011 Share 50+% 2011 Share 25%Multiple Suppliers Multiple Versions Multiple Devices

IVI S/W Architecture using Android

Automotive Android Native

Framework

Application

Home

FM/AM/HD Radio

USB mp3MyMusic/MTP DMB

iPod Play

CDP

SettingRVC

USB Image

InternetRadio

SXMAudio/Data Projected Mode

Digital iPod Out

MultiMedia Telematics Bluetooth/WiFi Voice Recog. Connectivity

Apple Siri

Voice Handler

SW upgrade

BT Music

BT paring

BTHF

DiagnosticSVC

Vehicle Manager

Telephony SVC

Safety WiFi

Navi. UI

Navi.

Download Apps

Download app

AppDownloader

CAN Related

- Cluster/ DATC- Regulation - RearView

Setting

- TimePolicy- Audio- Video

Quick boot

iAP 1,2 Service

Early Camera

Digital iPod Out

MTP

Activity Manager

WindowManager

PackageManager

State observerPermissionService ServerMove Observer

Location Manager

Location ManagerLocation Provider

Power Manager

USB Host Manager

Widget Manager

Media Manager

Media ProviderMedia Scanner

MountService

OSD Manager

OSD InterfaceOSD UIOSD Manager

Service

System UI

StatusBar Manager

Add Fixed IconAdd VariableAdd Home buttonAdd status service

USB Host

Micom System

- Demon- Update- Power- Key

Mode Manager

- ModeManager- LastMode- KeyDispatcher

Broadcast

- FM/AM Radio - HD Radio- SXM

Regulations

DMB Service

Factory Service

Engineering Service

RIL Demon Bluetooth Profile - HFP, A2DP, AVRCP,- PBAP, MAP

ResourceManager

Content Provider

MediaPlayer

Android Runtime

Dalvik VM

SurfaceFlinger

Audio Flinger

Audio Policy

Projection Mode

VR Libs.

E-AVBService

Factory Set

HVAC

NAVI. Engine

Kernel(Driver)

File System I2C/I2S UART USB Touch LCD Control GPSWiFi

(802.11ac)

SDIOSD/MMC Keypad SPDIF USB Role CHG TSIF Graphic

A/VCodecs

Telematics API Connectivity API Multimedia API VR API Android API (View/Wigdet/Animation)

UI

I2S

Connectivity (Telematics, Smartphone, Car network )

Telematics system

What is Telematics?Telecommunication + Informatics

Gateway device to connect vehicle with land side server

Data hub to collect the vehicle data

Value positioning at safetyE-call service is mandatory in EU from 2015

Major service providerGM OnstarHMC Mozen & Bluelink

GM Onstar Service

Mandatory service for GM vehicles.Providing service at NA/EU/China

Easy to use 3 button and Voice Recognition.

CAN Vehicle network

Emergency

Automatics crash responseEmergency ServiceCrisis assist

Security

Stolen vehicle assistant Road side assistant Remote service

Navigation

Turn by Turn navigation eNav

Connection

HF Call Remote Link App

Diagnostics

Vehicle Diagnostic

Smart Phone Connectivity.Mirror Link App Connectivity

Technical keynote VNC baseVideo and Audio transfer

App to App communicationControl and data transfer

Advantage All you can use Driver district and fragmentation

Disadvantage Large bandwidth requiredDriver district and fragmentation

Development cost increaseLimited app support

Smart Phone Connectivity

iOS in the car (CarPlay)USB ConnectionUsing iAP2 protocolStrong Apple dependency on UX

Google OAA (Open Automotive Alliance)Projected mode and Android LVNC and Miracastwww.openautoalliance.net

Vehicle Network evolving

CAN

EthernetAVB

MOST

LIN

Flex ray

CAN ( Controller Area Network )

Bosch designed at 1985 for car network. Multi-Drop bus support Communicate based on the priority of arbitration ID Each device decides whether to drop the message.

Class Bandwidth Wire Area

High Speed CAN 1 Mbp/s 2 Wire ABS, ECU

Fault tolerant CAN 125kb/s 2 Wire Physically High reliable part.(door)

Single Wire CAN 33.3kb/s , 88.3kb/s 1 Wire Seat , remote control

Multi functional CAN All All Configured

Physical connection

Message formation

Ethernet AVB(Audio Video Bridge)

TEXT

IEEE 802 Ethernet Driver

Grand-MasterClock

Selection

802.1ASgPTP

802.1QatSRP

IEEE 1722AVTP

802.1QavShaping

Streaming MediaAPI

TCP/IPProtocol

Stack

Talker / Listener / Controller Applications

IEEE1722.1

IEEE 802.1BA(Audio Video Bridging (AVB) Systems)- Ethernet AVB Bridge and End station Requirements)

IEEE 802.1AS- Timing and Synchronization for Time-Sensitive Applications in Bridged LAN between AV devices

IEEE 802.1Qav & 802.1Qat- Forwarding & Queuing Algorithm and Traffic Shaper- Stream Reservation Protocol

IEEE 1722(Audio Video Transport Protocol)- Encapsulation AV stream

IEEE 1722.1(Audio Video Discovery, Enumeration, Connection management, and Control)- Manage the Talker and Listener

UI/UX in the car

UI/UX differentiation

Qt Framework Driven by NOKIA until 4.8 version

Adobe Flash Losing market due to the heavy license fee

XML&CSS in Android HTML5 QNX Photon UI builder Nvidia UIComposer 3D toolKanzi UI frameworkEB Guide

ADAS (Advanced Driver Assistant System)

ADAS EVOLUTION

AutonomousCar

Autonomous Car w/driver

Automated Parking

Reversible Assistance

Interpretation of 3D viewCooperative traffic/CloudGesture control of HUD

3D model of the worldHUD Augmentation

Driver Warning

202020162014

Major ADAS features

Optical Flow Histogram Feature Detection

Pedestrian DetectionBlind Spot Monitoring

Lane Departure Warning

Collision AvoidanceTraffic Sign RecognitionAdaptive Cruise Control

Next-Gen ADAS is Visual Computing

Lane & ObjectDetection

Pedestrian Detection

Urban Location Recognition

Trafic SignRecognition

Surround view

Automated Driving

http://www.google.com/url?sa=i&rct=j&q=pedestrian+detection&source=images&cd=&cad=rja&docid=ZsGVf0Jjjtk-BM&tbnid=pqoW9q6_VrJJUM:&ved=0CAUQjRw&url=http://www.pedestrian-detection.com/&ei=gbflUdiMK8mtiQKbkIDYDQ&bvm=bv.49405654,d.cGE&psig=AFQjCNFgWPuYKgESI42bMcCFyn6qAx4wbA&ust=1374095606192038http://www.google.com/url?sa=i&rct=j&q=pedestrian+detection&source=images&cd=&cad=rja&docid=ZsGVf0Jjjtk-BM&tbnid=pqoW9q6_VrJJUM:&ved=0CAUQjRw&url=http://www.pedestrian-detection.com/&ei=gbflUdiMK8mtiQKbkIDYDQ&bvm=bv.49405654,d.cGE&psig=AFQjCNFgWPuYKgESI42bMcCFyn6qAx4wbA&ust=1374095606192038

Autonomous Vehicle

Google Autonomous Vehicle Audi Autopilot vehicle

System Integration in the car

Intelligent CockpitAll systems are connected and integratedDriver Monitoring and react (inner Camera + Wearable device)Various user interface like Gesture

HUD Mirror less car

Digital cluster + IVI

Advanced User Interface

Intelligent Cockpit Case StudyAUDI TT 2014

Cluster + IVI in Single LCD

Intelligent Cockpit Case StudyMercedes S class 2014

2 wide LCD and ADAS

Hypervisor for system integration

Hypervisor Virtualization

Instrument Cluster

Operating System

Applications

IVI Stack

Operating System

Applications

RSE

Operating System

Applications

ADAS

Operating System

Applications

Hypervisor solution

Resource Manager

- Partition Loader

- Partition Mgmt.

- Health Monitor

- Shell Services

NVIDIA HypervisorSolution

NVIDIA HypervisorSolution

VM0VM1VM2VM3

Hardware

VM4

GPUCPU sMMU Multimedia IO

Conclusion

New Opportunities in Automotive Increasing competition between suppliers

triggering new technology

having technical leadership by OEMSystem Integration and platfromizaiton

New value to the driverMore safety & liberty

Q & A

Thank you!

/ ()Marcus OhWhat happen to Automotive industry?Big Trend in AutomotiveEvolving to Complicated and Integrated vehicleSW become more importantAutomotive Solution overviewIVI (Inner Vehicle Infotainment)Major Features in IVIOperating system in IVIIVI S/W platform landscapeIVI S/W Architecture using AndroidConnectivity (Telematics, Smartphone, Car network ) Telematics systemGM Onstar ServiceSmart Phone Connectivity.Smart Phone ConnectivityVehicle Network evolvingCAN ( Controller Area Network )Ethernet AVB(Audio Video Bridge)UI/UX in the carUI/UX differentiationADAS (Advanced Driver Assistant System) ADAS EVOLUTIONSlide Number 25Next-Gen ADAS is Visual ComputingSlide Number 27Autonomous VehicleSystem Integration in the carIntelligent CockpitIntelligent Cockpit Case StudyIntelligent Cockpit Case StudyHypervisor for system integrationConclusionNew Opportunities in Automotive Q & AThank you!