archsummit全球架构师峰会 北京站2015 · growth of big data and analytics growth of...

37
ArchSummit全球架构师峰会 北京站2015 容器时代的云计算 梁胜 Rancher Labs

Upload: others

Post on 20-May-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

ArchSummit全球架构师峰会北京站2015

容器时代的云计算

梁胜 Rancher Labs

Page 2: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,
Page 3: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,
Page 4: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Growth of Devices and Apps

Growth of Big Data and Analytics

Growth of Internet of Things

Growth of Datacenters

Page 5: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Data center industry in transition

Company Last report date Quarterly revenue

YoY growth

HP Oct 31 2015 $25.71B -9.5%

NetApp Nov 18 2015 $1.45B -6.4%

Cisco Nov 12 2015 $12.7 +4%

EMC Oct 21 2015 $6.08B +1%

IBM Sep 20 2015 $19.29B -14%

Page 6: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Gartner IaaS Magic Quadrant

Page 7: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

2014

AWS 5x capacity of the nearest 14

competitors combined

2015

AWS 10x capacity of the nearest 14

competitors combined

Page 8: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Cloud IaaS is not a commodity.

Lydia Leong, Gartner

Page 9: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

What about private cloud?

Page 10: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Why has OpenStack not succeeded?

Page 11: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

The real problem: built it, but nobody came

Page 12: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Private Cloud == vSphere

Page 13: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Where do we go from here?

0

1000

2000

3000

4000

5000

6000

7000

8000

2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

VMware and AWS Revenue (in $1000,000s)

VMware AWS

Page 14: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Docker bursts onto the scene

Page 15: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

What is Docker?

• Not a replacement for VM

• As an application packaging format, it is similar to JAR, rpm, etc.

Linux

Tomcat(.tgz)

JAR WARMysql(rpm)

You do not have to use microservices to run Docker

Linux w/ Docker daemon

Tomcat

JAR WAR

Mysql

Page 16: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Why do people use Docker?

Page 17: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

One benefit: higher resource utilization

VM1

App 1.0

VM2

App 1.1

Load Balancer

VM1

App 1.0App 1.1

Load Balancer

Page 18: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

But more importantly: consistent developer experience

Page 19: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Fact: vast majority of Docker users run on AWS

Page 20: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Developer Operations

Page 21: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

The new private cloud: private container service

Private Container Service

Linux Linux Linux Linux Linux Linux

Page 22: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

What is in a private container service

Private Container Service

Linux Linux Linux Linux Linux Linux

Resource MgmtSchedulingOrchestrationApp CatalogAccess ControlMonitoringSecurityOverlay NetworkFirewallLoad BalancerBlock StorageFile StorageObject StorageDistributed DBand more …

Page 23: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

What is in a private container service

Private Container

Service

Resource Mgmt Docker Machine

Scheduling Swarm, Kubernetes, Mesos

Orchestration Compose, Kubernetes, Marathon, TOSCA

App Catalog Helm, Rancher

Access Control LDAP, AD, GitHub

Monitoring Stats, Healthchecks, Sysdig, Datadog, etc.

Security Notary, Kubernetes, Vault

Overlay network VXLAN, IPSEC, etc.

Firewall iptables

Load Balancer HAProxy, ngnix, iptables

Block Storage Ceph, EBS, SAN, etc.

File Storage Gluster, EFS, NAS, etc.

Object Storage Swift, S3, etc.

Distributed DB etcd, consul, mongo, DynamoDB, etc.

DCOS

Page 24: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Implications of private container services

• Computing resources are a commodity

• Consistent DevOps environment from laptop to cloud

Development Test Production

Private Container Service

Page 25: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

An analogy

Browser

Page 26: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

What about PaaS?

IaaS

PaaS

Private Container Service

Build/Deploy Pipeline

Page 27: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Miraculous growth of DigitalOcean

Page 28: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Simplicity wins

Page 29: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Two ways of automating application management at scale

Apps

Hosts

Config Management

Chef, Puppet, Ansible, …

Container Orchestration & Scheduling

Swarm, Kubernetes, Mesos, …

Page 30: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

What container services give us

Differentiated Infrastructure

Cost without Containers Cost with Container Services

Commoditized Infrastructure

Manual Application Deployment and Upgrade

Automated App Mgmt

Page 31: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

One Last Thing

Page 32: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Container live migration is coming

Data Center Cloud

Private Container Service

Page 33: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

AWS spot and on-demand instance

Cost of Resources

On-demand instance price

Spot instance price

Cloud lightly utilized Cloud highly utilized

Starts to kill and reclaim spot instances

Page 34: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

By monitoring spot instance price, we can know 5-10 minutes in advance that AWS will kill and reclaim spot instances

Page 35: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Rancher and Spotinst work together can save your AWS and GCE bill by 70-90%

More info http://sina.lt/eAAk

Page 36: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,

Questions?

[email protected]

Page 37: ArchSummit全球架构师峰会 北京站2015 · Growth of Big Data and Analytics Growth of Internet of Things ... Container Service Resource Mgmt Docker Machine Scheduling Swarm,