傲睿智存 高效的视频处理与ai - xilinx...支持的ai网络 yolov3, densebox, resnet,...
TRANSCRIPT
傲睿智存
高效的视频处理与AI融合架构
Confidential & Copyright © Aupera Technologies 2019
End of Moore’s Law
Content changed
Intel x86 vs Domain Specific Architecture
Agile Computing Architecture
Xilinx FPGA
MPSoC Arm+FPGA
Confidential & Copyright © Aupera Technologies 2019
Xilinx Zynq Ultrascale+ MPSoC
TSMC 16nmFrom Xilinx
Confidential & Copyright © Aupera Technologies 2019
Xilinx Zynq Ultrascale+ MPSoC
From Xilinx
Confidential & Copyright © Aupera Technologies 2019
Micro Node Hardware Architecture
Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA
Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA Arm+FPGA
Ethernet Switch Ethernet Switch
x 48
Confidential & Copyright © Aupera Technologies 2019
AUP260019 英寸标准1RU/3RU服务器
56～380路视频流编解码+AI
AUPV205 边缘移动套盒
12V DC8路视频流编解码+AI
AUPV305PCIe 加速卡
8～32路视频流编解码+AI
1U/8节点
3U/48节点
Hardware Available
Confidential & Copyright © Aupera Technologies 2019
2018
Video Stream Processing Pipeline
Codec Enginedecoding
CV EngineImage
Processing
Codec EngineEncode
StreamingRTMP,
RTSP,UDP
DL EngineCNN(s)
Arm FPGAFPGA Arm/FPGA FPGA
Arm
Arm
StreamingRTMP,
RTSP,UDP
Meta Data
Storage
ArmH.264H.265JPEG
Confidential & Copyright © Aupera Technologies 2019
2019
Video Stream Processing Pipeline
Codec Enginedecoding
CV EngineImage
Processing
Codec EngineEncode
StreamingRTMP,
RTSP,UDP
Arm FPGAFPGA Arm/FPGA FPGA
Arm
Arm
StreamingRTMP,
RTSP,UDP
Storage
Arm
DL EngineCNN(s)
Meta Data
FPGA
H.264H.265JPEG
Confidential & Copyright © Aupera Technologies 2019
Whole Application Acceleration
From Xilinx
Confidential & Copyright © Aupera Technologies 2019
AupXStream Video+AI SDK
Streaming Media Framework
CV Engine Codec Engine DL Engine
Application Templates
ROI Enhanced Enc Metadata Extraction tracking/capturing
Video Transcoding Stream MixerVideo Conference
Hardware / Software Platform Generator ASICCPUFPGA
云服务管理
运营管理
平台管理
Cluster managementTask management
OAM management
Cloud service mgnt
加速引擎层
视频流处理框架
应用层
硬件抽象层
Linux操作系统
Confidential & Copyright © Aupera Technologies 2019
Fixed silicon devices are not optimized for the latest models due to long development cycles
Match the Speed of AI Innovation
Adaptable silicon allows Domain Specific Architectures (DSAs) to be updated, optimizing the latest AI models without needing new silicon
Fixed silicon devices are not optimized for the latest models due to long development cycles
AI Models Are Rapidly Evolving
From Xilinx
Confidential & Copyright © Aupera Technologies 2019
产品及型号 AUPV205-BOX边缘AI智能分析盒/PCIe加速卡
AUPV2601边缘智能分析服务器
AUPV2603中心智能分析服务器
视频格式 H.264/H.265
视频流协议 rtmp\rtsp\srtp\udp\tcp\http
视频解码路数（4K ~ 360P） 8路 @1080P 硬解 56路 @1080P 硬解 368路 @1080P 硬解
视频编码路数（4K ~ 360P） 8路 @1080P 硬编 56路 @1080P 硬编 368路 @1080P 硬编
图片抽帧 JPEG 硬编
支持的深度学习框架 Caffe, TensorFlow, Darknet, PyTorch
支持的AI网络 YoloV3, Densebox, Resnet, MobilenetV1-SSD，VGG16, InceptionV3/V4
工具链：DNNDK(深度神经网络开发套件) 定点，剪枝，编译，部署
AI算力 3 TOPS INT8 21 TOPS INT8 138 TOPS INT8
尺寸 169 x 165 x 48mm 掌中盒 1RU 机箱 3RU 机箱
功耗 3W/路
运维管理 支持集群管理、作业调度、健康监控、Web UI、NAT、模块热拔插
Video+AI Performance Overview
Confidential & Copyright © Aupera Technologies 2019
With Video codec and embedded AI, 7EV is Changing the Landscape of Video Processing in Data Center
AuperaTM AUP2600 Video Processing System based on Xilinx Zynq®UltraScale+™MPSoC
x86 E5 Serverx 30
GPUs
(Video Transcoding H.265)
(Inference)
AUP2603 x 1
Confidential & Copyright © Aupera Technologies 2019
Empowering Video+AI
Thank You！