aws를 활용한 미디어 스트리밍 서비스
DESCRIPTION
2014년 3월 27일 개최된 '상암에서 만나는 아마존웹서비스' 에서 AWS 이수형 수석이 발표한 'AWS를 활용한 미디어 스트리밍 서비스' 발표 자료 입니다.TRANSCRIPT
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS 를 활용한 미디어 스트리밍 서비스 CloudFront and Elastic Transcoder
[ 이수형수석 / Solutions Architect / [email protected]]
03/27/2014 1
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Agenda
Overviews• CloudFront• Elastic Transcoder• Media Use Case
Media Streaming Services• Live streaming• Video-on-Demand streaming
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
CloudFront
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront
Whole site (Dynamic & Static) deliveryLive and Video on Demand Adaptive Bitrate and RTMP Streaming HTTP/HTTPS File DeliveryLow Minimum Content Expiration Periods (Zero seconds)AWS Management Console SupportFull control via APIs Programmatic/Console InvalidationIndustry-compliant, detailed Access LogsPrivate Content for Increased SecurityPrice Classes for Cost OptimizationCookie Support
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – How it works : Non-cached object
S3, ELB, EC2
or custom
origin
CloudFrontEdge
End users
LOCALInternational
routeOverseas location
scoreboard.jpg
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – How it works : Non-cached object
S3, ELB, EC2
or custom
origin
CloudFrontEdge
End users
1. Request routed to most optimal edge location
LOCALInternational
routeOverseas location
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – How it works : Non-cached object
S3, ELB, EC2
or custom
origin
CloudFrontEdge
End users
2. If content not cached – object requested from origin
1. Request routed to most optimal edge location
LOCALInternational
routeOverseas location
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – How it works : Non-cached object
S3, ELB, EC2
or custom
origin
CloudFrontEdge
End users
3. Data transfer of content to CloudFront edge location to cache
2. If content not cached – object requested from origin
1. Request routed to most optimal edge location
LOCALInternational
routeOverseas location
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – How it works : Non-cached object
S3, ELB, EC2
or custom
origin
CloudFrontEdge
End users
4. Data transfer of cached content to end user
3. Data transfer of content to CloudFront edge location to cache
2. If content not cached – object requested from origin
1. Request routed to most optimal edge location
LOCALInternational
routeOverseas location
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – How it works : Cached object
S3, ELB, EC2
or custom
origin
CloudFrontEdge
End users
LOCALInternational
routeOverseas location
scoreboard.jpg
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – How it works : Cached object
S3, ELB, EC2
or custom
origin
CloudFrontEdge
End users
1. Request routed to most optimal edge location
LOCALInternational
routeOverseas location
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – How it works : Cached object
S3, ELB, EC2
or custom
origin
CloudFrontEdge
End users
2. Data transfer of cached content to end user
1. Request routed to most optimal edge location
LOCALInternational
routeOverseas location
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront
10 AWS Regions
50+ AWS Edge Locations
Seoul CloudFront Edge
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront
London
Paris
NY
Served from S3/images/*
3
Served from EC2*.php
2
Single CNAMEwww.mysite.com
1
Amazon CloudFrontWorld-wide content distribution
network
Easily distribute content to end users
with low latency, high data transfer
speeds, and no commitments.
Static, Dynamic & Streaming
Content
Static Contents
Dynamic
Contents
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – Dynamic Contents
Dynamic content is the interactive or personalized portion of a website, created on-the-fly for each end user
• News• Weather• Sports• Social media• Advertising• Travel
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – Dynamic Contents
• Simple DIY configuration with web console • No consultants to hire, No proprietary languages to learn
Simple to Use
• Connections to AWS regions closely monitored• Standard AWS resources (like CloudFormation)• Designed to work with origins in Amazon EC2
AWS Integratio
n
• No additional charges or set up fees• Pay only for requests and data transferLow Cost
• Multiple Cache Behaviors, Minimum Expiration Period• Multiple Origin Servers Origin Connection Protocol, Query String
Parameters• Viewer Connection Protocol ∙ Cookie Support
Features
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – Streaming Services
High internet bandwidth platform EC2 scalability & pricing model• Use it only when you need it• No need to over-commit HW or infrastructure: Grow as needed
ECO System & license flexibility• Streaming solution partners• DRM solution partners• BYOL and Pay-as-you-go
If requirement fits…• No commitment CDN service as CloudFront• Use S3 as unlimited contents storage ( 99.999999999% durability)• Easy and fully managed CloudFront + S3 VoD + Elastic Transcoder
platform
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – Media Security Requirements
AWS alignment to MPAA Security Best Practices reviewed October 2012Based on AWS Shared Responsibility ModelAWS Services In Scope• Elastic Compute Cloud (EC2), Virtual Private Cloud (VPC), Simple Storage
Service (S3), Elastic Block Storage (EBS), Relational Database Service (RDS), DynamoDB, VM Import, Elastic Load Balancing (ELB), Identity and Access Management (IAM), CloudFront, Glacier, AWS Import/Export, Direct Connect, Route 53, Elastic Transcoder, and the supporting data centers
Content Types In Scope • RAW master, high/low-resolution, watermarked/spoiled, full/partial feature content,
stills, clips, frames, shots, sequences, scripts, storyboards as well as production and post-production deliverable formats in pre-and post-theatrical release windows
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS CloudFront – Partner Ecosystems
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Elastic Transcoder
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Scalable Transcoding Architecture
SimpleStorage Service
EBS
Instance Store
EC2 VirtualServers
AMI
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Elastic Transcoder
SimpleStorage Service
EBS
Instance Store
EC2 VirtualServers
AMI
AWS Elastic TranscoderEasy-to-use scalable media transcoding
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS Elastic Transcoder Service
Amazon S3 Input Bucket
Amazon S3 Output
Bucket
Digital Media Source Asset
Digital Media Destination
Asset
AWS Elastic Transcoder
• Different bit rate• Different frame rate• Max width / height• Different sizing policy• Different Aspect ratio
Multiple types of transcoding at once& only pay for the minutes of the content
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS Elastic Transcoder Service - Details
Reduce cost• No more CapEx (server / storage / network and DC requirement)• No more OpEx (operations / maintenance and management)• Unlimited storage with S3 with 99.999999999% of durability @ no extra cost (better
durability than “most” traditional DR solution) + Unlimited archiving with Glacier• Only pay for “how many minutes” you transcoded
Enhance security• Data at rest for S3 storage• IAM to manage the resource access management• Visual watermarking for transcoded media content• Security eco systems with AWS partners
Configurable transcoding presets• Container: MP4 / TS / WebM• Video: H.264 / vp8• Audio: AAS / vorbis• Presets : up to 4 images (jpg / png)
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Media Use Case
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Pay as you go
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
NASA’s JPL used AWS to stream the images and video associated with Curiosity’s landing targeting hundreds of thousands viewer.
They developed set of EC2 Nginx cache Tier with CloudFormation to handle 25Gbps streaming each. They provisioned capacity with monitoring the actual usage.
Mars Science Laboratory
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Corporate website, 40 producer websites, streaming for iPhone and iPad applicationsUse Amazon EC2, Amazon S3, Amazon RDS, and stream 1.5 PB/m on Amazon CloudFrontBusiness Benefits• Launched and scaled multiple media services quickly• Improved server set-up time from months to 15 minutes• Improved reliability to 99.99%
PBS Online and Mobile Media on AWS
“I can’t imagine having been able to do very many of the things that we’ve done, in the timeframe that we’ve done them, without the benefit of a platform like this.”
– Jon Brendsel, VP, Products
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
More than 25 Million Streaming Members
50 Billion Events Per Day
30 Million plays every day
2 billion hours of video in 3 months
4 million ratings per day
3 million searches
Device location , time , day, week etc.
Social data
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Netflix Runs Nearly 100% of its Online Video Service on AWS, Achieves Near Zero DowntimeGlobal Use of Amazon EC2, Amazon S3, Amazon SQS, Amazon EMRBusiness Benefits• Application achieves near zero downtime• Sales to handle Netflix’s rapid online growth, 37x in 2010, over 20B requests per month by Jan 2011
Netflix on AWS
“AWS is the market leader and has been able to create a continuous and virtuous cycle.”
– Kevin McEntee, VP Content Engineering, Netflix
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
AWS Strengths for Streaming Services
High internet bandwidth platform EC2 scalability & pricing model• Use it only when you need it• No need to over-commit HW or infrastructure: Grow as needed
ECO System & license flexibility• Streaming solution partners• DRM solution partners• BYOL and Pay-as-you-go
If requirement fits…• No commitment CDN service as CloudFront• Use S3 as unlimited contents storage ( 99.999999999% durability)• Easy and fully managed CloudFront + S3 VoD + Elastic Transcoder platform
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Live Streaming
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Global Live Streaming Architecture
AWS CloudCorporate Data
centerOr Live Event Place
Virtual Private Cloud
Streaming server Live
Encoder
CAM-1
CAM-2
CAM-3
CloudFront
Edge
EdgeEdge EdgeEdge
Edge
Edge
Edge
Edge
PC
Mobile
OTT
PC
Mobile
OTT
S3
Internet
Internet
LOGS
LOGS
LOGS
1. Capture live event via cameras
2. Video editing before streaming
3. Feed edited live event to encoder at the site
4. Encode the live event and transmit to streaming server on AWS cloud
5. Streaming server forwards contents to the edge cache server
6. Streaming server saves the contents to the file
7. End-user watches the live events delivered from edge servers
9. Saved contents get stored in S3 for durability and transcoding if necessary
8. End-devices pushes logs to S3 for data analysis
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Video-on-Demand
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
Global Video-on-Demand Streaming Architecture
AWS Cloud Corporate Data center
CloudFront
Edge
EdgeEdge EdgeEdge
Edge
Edge
Edge
Edge
PC
Mobile
OTT
PC
Mobile
OTT
1. Content owner copies the media content to S3 via StorageGateway or Data Import/Export service provided by AWS2. Media contents are transcoded using Elastic Transcoder if necessary
3. CloudFront is configured for the distribution of digital contents
4. When end-users sends request for VoD streaming, it is served by closest edge cache server
5. PC / Smart devices or OTT sends out logs to S3 for data analysis
Content
MGMT
Storage Gateway
S3
LOGS
LOGS
LOGS
LOGS
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
감사합니다 .
[ 이수형수석 / Solutions Architect / [email protected]]
03/27/2014 36