NCCU1

Copyright 2008 ITRI 工業技術研究院

1

Cloud Computing: Where Do We Go from Here?

Tzi-cker Chiueh (闕志克)

Cloud Computing Research Center for Mobile Applications (CCMA)雲端運算行動應用研究中心

NCCU2

Copyright 2008 ITRI 工業技術研究院

Cloud computing is hot!

But where is the $$ for Taiwan?

NCCU 3

Cloud Computing Basics

• “It’s cloud illusions I recall; I really don’t know clouds at all”

--- Both Sides Now, Joni Mitchell

• Our definition– Centralization of IT infrastructures– Usage-based resource allocation and charging

• Enabling technologies– HW/SW to build and run very large data centers

efficiently– Scalable, reliable and secure cloud services– Faster Internet connectivity

NCCU 4

Cloud Service Models

• Infrastructure as a Service (IaaS)– A set of virtual machines with storage space and external network

bandwidth unfurnished apartment

– Example: Amazon Web Service

• Platform as a Service (PaaS)– An operating environment including (application-specific) libraries

and supporting services (DBMS, AAA) furnished apartment

– Example: Google’s App Engine, Microsoft’s Azure, IBM’s XaaS

• Software as a Service (SaaS)– Turn-key software hosted on the cloud and accessible through the

browser hotel

– Example: salesforce.com, and all major desktop software vendors

NCCU 5

Cloud Computing Food Chain

End User

Cloud Service User

Enterprise IT DepartmentWeb Application DeveloperSaaS Provider

Enterprise UserConsumerSaaS User

Mega Data CenterSoftware Provider

Cloud Service Provider Mega Data Center OperatorCloud Application Platform Provider

IaaS, PaaS

SaaS

Mega Data CenterHardware Provider

HW SW

NCCU 6

Taiwan’s Positioning in CloudComputing Food Chain

• Just end user?• Sophisticated cloud service user or cloud application

developer? Exportable?• Operate its cloud service provider?

– Data confidentiality concern (especially for E-government service)

• Serve as a major cloud service provider in a geographical region?– Sufficient bandwidth and connectivity?– Climate and geology factors are against us

• Become a major HW/SW solution provider for cloud service providers?– data center hardware component total data center solution– ITRI/CCMA’s bet here

NCCU 7

Microsoft’s Container-based DataCenter in Chicago

NCCU 8

Inside the Container

NCCU 9

Cloud-Scale Data Center

• > 10,000 servers $50M USD apiece• Technology components:

– Container computer: Optimal HW building block for constructing a cloud data center

– Cloud OS: An end-to-end software stack that runs cloud applications and operates a cloud data center

– Non-ICT technology: seismic, fire, physical security, etc.– Integration/operation know-how: Operational

experiences and expertise for putting together and running a cloud-scale data center

NCCU 10

Data Center Solution Provider• Cloud Hardware Platform

– Servers (HP/Dell)– Storage arrays: primary and secondary (EMC/NetApp)– Network switches: LAN and SAN (Cisco/Juniper/Brocade)– Front-end Appliances:

• IPS/Firewall/NAT (Checkpoint)• Traffic Shaper (Packeteer)• Server Load Balancer (F5)• Multi-Homing Load Balancer (BIG-IP)

• Cloud Software Platform– Hypervisor (VMware, Citrix, Microsoft)– Virtualization management (VMware, Citrix, Microsoft)– Storage management (EMC, NetApp, HDS, IBM, Symantec)– Backup/replication (Symantec)– Data center automation + energy management (Tivoli, CA, BMC, HP)– Security (Symantec, Cisco, McAfee)

• Non-ICT – Power: Electricity distribution network (Delta/Emerson)– Cooling: Thermal management (APC)– Facilities: Fire, seismic, battery, physical security– Regulations

NCCU 11

Data Center Design Trends

• Containerization– Best HW packaging for cloud data centers

• Server Server rack container warehouse• Commodity HW only, not a supercomputer

– More efficient power distribution and thermal design– Unification of computing, memory, network and storage resources

• Virtualization of all HW resources: Software-definable boundaries

– Faster deployment: no on-premise installation needed– Requires light-out operation

• Google-style data center design– End-to-end redundancy

• Failure is a common case

NCCU 12

Missing Links

• Goal: Enable Taiwan to build data centers for the world • Container Computer 1.0

– Manageable container computer– Differences between a set of servers/switches/storage boxes and a

container computer? • Scalable storage/network architecture• System management software• Energy-efficient cooling

• Cloud Operating System 1.0– End-to-end data center software stack for supporting a AWS-like

service on a set of commodity HW– Tight integration of storage, resource, security and system/network

management

• First prototype of both expected at the end of 2010

NCCU 13

Container Computer 1.0

• Objective: Physical data center in a box• Architecture Design Principles:

– Commodity HW only• No storage box, appliance or accelerator

– System-wide optimization• Component vs. self-contained system• server container computer warehouse computer

• Major features:– All-layer-2 data center network architecture– Scalable internet appliance logic– Touch cooling-based thermal management

NCCU 14

Cloud Operating System 1.0Objective: Multiplexing virtual data centers on a physical data center

– No. of VM instances each with CPU performance and memory size requirement– Shared storage space requirement– External network bandwidth requirement– VPN setting– Firewall/IDS/IPS rules– Server load balancing policy– Public IP addresses– Network configuration, including DNS and DHCP– OS and application image

Design Goals: – Very very very very… easy to manage for both physical and virtual data

center administrators – Ability to hide HW failures from applications– Intelligent data center-wide power management– Multi-tenancy security– Scalability across all workloads

NCCU 15

Components in Cloud OS 1.0

Physical InfrastructureManagementTool (Dell)

Inter-PM Load Balancingand VM Fail-over (VMware)

Virtual Data Center Provisioning (VMware)

Power Management(Tivoli)

Inter-VM LoadBalancing (F5)

Network/SystemManagement

(Tivoli)

Security (Checkpoint)

Virtual Data Center Management Tool

Physical Compute Servers

All-layer-2 Network

Distributed Main/Secondary Storage

Primary/SecondaryStorage Management

(EMC)

NCCU 16

Cloud OS 1.0 Summary

• World’s first integrated data center software stack that – Integrates storage management, virtualization management,

system/network management, security, and power management – Targets at cloud-scale data centers and supports virtual data center-

based IaaS

• Competitions: – Virtual Computing Environment Coalition (Acadia): Cisco, EMC, and

VMware– Microsoft/HP Cloud Alliance

NCCU 17

Where CCMA Adds Value

IaaS

PaaS

Servers Storage Arrays Power DistributionSwitches

+Scalable System Architecture System Management Cooling

Cloud Hardware Platform

Hypervisor Virtualization Management Storage Management Security

Backup/Replication Data Center Automation Energy Management

Cloud System Software Platform

LAMP .NET WebSphere WebLogic Google App Engine

Cloud Application Middleware Platform

Local

ITRI

International

SaaS EMR Smart Grid Automated CloudificationApplications

NCCU 18

Evolution Path

Container Computer Component ODM

Container Computer OEM Container Computer ODM

Total Container Computer Solution Provider

Cloud Data Center System Integrator

Cloud Data Center System Integrator with Operator Know-how

Pow

er G

enerato

rP

ower

Plant

Total S

olutionP

rovider

Profit Margin

Taiwanese Companies’

World-wide IT Center

Asia Pacific Data and

Application Backup

NCCU 19

Success Criteria

• Bring up Taiwan’s computer HW industry to rise to the cloud computer era– A Taiwan-spec container computer that powers cloud-

scale data centers in the world

• Jump-start Taiwan’s systems software industry– A Taiwan-based cloud OS company that provide end-to-

end software stack solutions to cloud data centers in the world

• Container computer ODM Red Hat Huawei

NCCU 20

雲端運算產業發展方案15項計畫

FY98~FY10 /7.5 億元財政部14.優質經貿網絡－關港貿單一窗口計畫

FY99~ FY103/3.6億元經濟部國際貿易局11.推動貿易便捷安全雲端服務計畫

FY100~FY102/13.17億元財政部12.電子發票雲端服務

FY99~FY102/39.92億元財政部13.賦稅資訊系統整合再造更新整體實施計畫

FY99~FY103 / 7.78 億元國科會15.科技研發雲端運算服務平台計畫

FY99~FY103/6.98億元經濟部工業局5.雲端運算產業應用計畫

FY99~FY103/15億元經濟部技術處4.跨國企業研發中心及六大新興產業雲端服務旗艦計畫

計畫名稱 主責單位 期程/經費(共240億元)

1.雲端運算科技與產業技術發展計畫 經濟部技術處 FY99~FY103/37.2億元

2.研發實驗與公益用途資料中心 經濟部技術處 FY99~FY103/1.25億元

3.雲端運算旗艦公司計畫 經濟部技術處 FY99~FY103/10億元

6.建置政府雲端網路基礎服務 行政院研考會 FY100~FY103/65億元

7.防救災業務雲端服務 內政部消防署 FY100~FY103/4億元

8.教育雲端服務 教育部 FY99~FY103/16.5億元

9.全國路網車速資訊交通雲計算基礎建設 交通部 FY100~103/6億元

10.推動中小企業運用雲端服務 經濟部中小企業處 FY100~FY103/6.1億元

NCCU 21

International Competition Landscape• United States:

– Holds dominant position in all cloud computing segments– No industrial development policy

• European Union– Leverages strength in telecom equipment/service business and focuses

on “cloud service systems”for carriers• Japan

– Digital Japan Creation Project; Kasumigaseki cloud– NEC, Fujitsu, Hitachi enter the Cloud Infrastructure space

• Korea– National Computing and Information Agency : 40 agencies’IT

departments consolidated by December 2007 – Carefully chosen cloud applications/services: IPTV, Green Internet Café,

Mobile device, Smart Grid, On-line gaming, Tele-commuting, etc. • China

– Being formulated – Huawei has already grabbed most of China Mobile’s data center

businesses

NCCU 22

Conclusion

• Cloud computing is all about consolidation of IT infrastructures and usage-based resource allocation

• Most on-premise applications will eventually be cloudified

• Cloud-scale data center industry is emerging

• ITRI’s integrated data center solution, Container Computer 1.0 + Cloud OS 1.0, is expected to provide 80% of the functionalities at 1/2 cost of current market-leading solutions

NCCU 23

Thank You!

Questions and Comments?

tcc@itri.org.tw