s5715 keynote jen hsun huang
TRANSCRIPT
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 1/55
LEAPS IN VISUAL COMPUTINGJEN-HSUN HUANG, CO-FOUNDER & CEO | GTC 2015
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 2/55
FOUR ANN
A New GPUand
Deep Learning
A Very Fast Boxand
Deep Learning
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 3/55
AMAZING YEAR IN
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 4/55
10X GROWTH IN2008
150,000
CUDA Downloads
4
,000
Academic Papers
60Universities Teaching
77Supercomputing Teraflops
6,000
Tesla GPUs
27CUDA Apps
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 5/55
2008
150,000
CUDA Downloads
4
,000
Academic Papers
60Universities Teaching
77Supercomputing Teraflops
6,000
Tesla GPUs
27CUDA Apps
2015
10X GROWTH IN
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 6/55
2015
10X GROWTH IN2008
150,000
CUDA Downloads
4
,000
Academic Papers
60Universities Teaching
77Supercomputing Teraflops
6,000
Tesla GPUs
27CUDA Apps
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 7/55
2015
10X GROWTH IN2008
150,000
CUDA Downloads
4
,000
Academic Papers
60Universities Teaching
77Supercomputing Teraflops
6,000
Tesla GPUs
27CUDA Apps
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 8/55
2015
10X GROWTH IN2008
150,000
CUDA Downloads
4
,000
Academic Papers
60Universities Teaching
77Supercomputing Teraflops
6,000
Tesla GPUs
27CUDA Apps
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 9/55
2015
10X GROWTH IN2008
150,000
CUDA Downloads
4
,000
Academic Papers
60Universities Teaching
77Supercomputing Teraflops
6,000
Tesla GPUs
27CUDA Apps
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 10/55
2015
10X GROWTH IN2008
150,000CUDA Downloads
4,000Academic Papers
60Universities Teaching
77Supercomputing Teraflops
6,000Tesla GPUs
27CUDA Apps
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 11/55
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 12/55
8 Billion Transistors
3,072 CUDA Cores7 TFLOPS SP / 0.2 TFLOPS DP12GB Memory
TITAN XTHE WORLD’S FASTEST GPU
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 13/55
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 14/55
0
1
2
3
4
5
6
7
TITAN X FORTra
D a
y s
16-core Xeon CPU TITA
~
43
…
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 15/55
8 Billion Transistors3,072 CUDA Cores7 TFLOPS SP / 0.2 TFLOPS DP12GB Memory
TITAN XTHE WORLD’S FASTEST GPU
$999
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 16/55
FOUR ANN
A New GPUandDeep Learning
A Very Fast BoxandDeep Learning
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 17/55
A SHORT HISTORY
Convolutional Neural Networks for
Handwritten Digital RecognitionLECUN, BOTTOU, BENGIO, HAFFNER, 1998
1995 2000
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 18/55
“ Delving
Human
“ Deep Im
“ Batch N
by Red
IMAGENET CHALLENGE
Accuracy %
2010 201420122011 2013
74%
84%
DNN
CV
72%
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 19/55
THE B
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 20/55
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 21/55
GPU-ACCELERAT
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 22/55
Detecting Mitosis in Breast Cancer Cells— IDSIA
Predicting the— Johannes
DEEP LEARNING REVOLUT
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 23/55
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 24/55
USERINTERFACE
ConfigureDNN
ProcessData
GPUGPU HW GPU ClusterMulti-GPU
Theano
Torch
MonitorProgress
CaffecuDNN, cuBLAS
CUDA
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 25/55
D
Configure DNNProcess Data
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 26/55
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 27/55
DIGITS DEVBOX
“ DIGITS makes it way easier
to design the best network
for the job”
0x
1x
2x
3x
4x
1
Multi-GPU
AlexNet V
— Simon Osindero A.I. Architech
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 28/55
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 29/55
FOUR ANN
A New GPU
andDeep Learning
A Very Fast Box
andDeep Learning
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 30/55
S G E M M / W
2008
48
36
12
0
24
60
72
GPU ROADMAP
Pascal 2x SGEMM/W
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 31/55
F r a m e B
u f f e r C a p a c i t y ( G B )
2008
40
30
10
0
20
50
60
GPU ROADMAP
Pascal 2.7x Memory Capacity
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 32/55
H G E M M / W
2008
96
72
24
0
48
120
144
GPU ROADMAP
Pascal 4x Mixed Precision
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 33/55
S T R E A M G B / s
2008
600
450
150
0
300
750
900
GPU ROADMAP
Pascal 3x Bandwidth
PASCAL 1
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 34/55
PASCAL 1
CONVOLUTION FULLY CONNECTED FULLY CONNECTE(compute) (bandwidth) (bandwidth)
4x (FP16) 6x 6x
Mixed Precision 3D Memory
forward backward
3D Memory
FOUR ANN
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 35/55
FOUR ANN
A New GPU
andDeep Learning
A Very Fast Box
andDeep Learning
TODA
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 36/55
TODA
FPGACV ASIC
SENSE
NEXT GEN
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 37/55
NEXT-GEN
FPGACV ASIC
SENSE
NVIDIA DRIVE PX SELF
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 38/55
NVIDIA DRIVE PX SELF
FPGACV ASIC
DNN
SENSEIMAGENET CHALLENGE
Accuracy %
2010 201420122011 2013
74%
84%
DNN
CV
72%
NVIDIA DRIVE PX SELF
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 39/55
NVIDIA DRIVE PX SELF
FPGACV ASIC
DNN
SENSEIMAGENET CHALLENGE
Accuracy %
2010 201420122011 2013
74%
84%
DNN
CV
72%
NVIDIA DRIVE PX SELF
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 40/55
NVIDIA DRIVE PX SELF
FPGACV ASIC
DNN
SENSEIMAGENET CHALLENGE
Accuracy %
2010 201420122011 2013
74%
84%
DNN
CV
72%
NVIDIA DRIVE PX SELF
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 41/55
NVIDIA DRIVE PX SELF
FPGACV ASIC
DNN
SENSEIMAGENET CHALLENGE
Accuracy %
2010 201420122011 2013
74%
84%
DNN
CV
72%
NVIDIA DRIVE PX SELF
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 42/55
NVIDIA DRIVE PX SELF
FPGACV ASIC
DNN
SENSEIMAGENET CHALLENGE
Accuracy %
2010 201420122011 2013
74%
84%
DNN
CV
72%
NVIDIA DRIVE PX SELF
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 43/55
NVIDIA DRIVE PX SELF
FPGACV ASIC
DNN
SENSEIMAGENET CHALLENGE
Accuracy %
2010 201420122011 2013
74%
84%
DNN
CV
72%
PROJECT DAVE DARP
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 44/55
PROJECT DAVE — DARP
IMAGENET CHALLENGE
Accuracy %
2010 201420122011 2013
74%
84%
DNN
CV
72%
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 45/55
DAVE IN ACTION
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 46/55
TRAINING DATA225K Images
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 47/55
TEST DRIVENo Training
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 48/55
TEST DRIVEPartially Trained (52K images)
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 49/55
TEST DRIVEFully Trained (225K images)
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 50/55
Number of Connection
Frames / Secon
Connections / Secon
NVIDIA DRIVE PX SELF
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 51/55
NVIDIA DRIVE PX SELF
FPGACV ASIC
DNN
SENSEIMAGENET CHALLENGE
Accuracy %
2010 201420122011 2013
74%
84%
DNN
CV
72%
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 52/55
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 53/55
LEAPS IN VIS
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 54/55
LEAPS IN VIS
TITAN XThe World’s Fastest GPU
DIGITS DevBoxGPU Deep Learning Platform
7/23/2019 S5715 Keynote Jen Hsun Huang
http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 55/55