openstack on the fabric - openstack korea january seminar 2014

AMD/SEAMICRO OPENSTACK ON THE FABRIC

JANUARY 2014

Jun Lee 이 준희 코위버 (주) | 솔루션 사업부

[email protected]

| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 2

A Vendor and End-User Perspective

• What is Fabric Compute?

• What is the use case for Cloud?

• Our experience from deploying OpenStack on a Fabric

• Bare Metal Provisioning

• Speed of Deployment

• Power and Space

OpenStack on the Fabric A use case study into deploying OpenStack on a Fabric Compute Architecture


OpenStack Interest WHAT CLOUD SOLUTIONS ARE IT ORGANIZATIONS LOOKING AT?


What is Fabric Computing?

• Severs with with Laser Beams?

No. At least not yet….

• Is it a new proprietary architecture?

No. Runs the same off the shelf OS and software. No special drivers needed.

• Do they cost a Million dollars?

No. Similar economics to rackmounts, but saves you a lot in TCO.



Traditional Rackmount Server

CPU

SeaMicro Fabric Compute System

Fabric Interconnect

Compute and Memory

Storage Networking

Disaggregate CPU/Memory, Storage,

and Networking into pools of shared resources!

Captive Resources!

Top of Rack Switches

CPU

CPU CPU

CPU CPU

CPU CPU



Rethinking the Server…


Core Components CPU & Memory, Networking, Storage



Bare Metal Server

CPU

How servers are provisioned…

Provision specific resources needed for the application

Example of provisioning a server using SeaMicro Restful API

Curl –X PUT https//chassis-ip/v0.2/storage/volume/1/myPool/Volume-1?’action=create&size=200 Curl –X PUT https//chassis-ip/v0.2/storage/volume/1/myPool/Volume-1?’action=assign&server=1/0&vdisk=2&read-only=false Curl –X PUT https//chassis-ip/v0.2/servers/1/0?’action=assign&nic=0&tagged-vlan=true&vlan-range=1-1 Curl –X PUT https//chassis-ip/v0.2/servers/1/0?’action=assign&nic=1&tagged-vlan=true&vlan-range=1000-1999 Curl –X PUT https//chassis-ip/v0.2/servers/1/0?’action=power-on&using-pxe=true


Fabric Interconnect

Compute and Memory

Storage Networking

CPU CPU

CPU CPU

CPU CPU


What does a Fabric Compute System look like?

Power Efficient Servers (64 to 256) • Up to 512 CPU cores per system • Up to 4 TB of memory. • Choice of CPUs:

• 64 AMD Opterons • 64 Intel Xeons – Ivy Bridge or Haswell • 256 Intel Atoms

Network Uplinks Cards (up to x8) • Up to 160 Gbps Uplink capacity • Choice of 10Gb and 1GB interfaces • Integrate 100Gb NPU

5.4 Petabyte of External Storage Expansion • Connect up to 16 Fabric Storage Enclosures. • 1344 external 3.5” disks.

Storage Controllers (up to x8) • Provides storage to any server • Up to 64 internal 2.5” disks per system.

Fabric Interconnect • 1.28 Tbps high performance fabric • Integrated L2 switching

10

RU

SM15000 Fabric Compute Server


The Fabric Computing Use Case

Compute Throughput

Memory Capacity

Network Bandwidth

Storage IOPS

Storage Capacity

Storage Bandwidth

Web Applications Medium/High Medium Low Medium Low Low

Hadoop Low/Medium/High Medium Medium Low Medium/High High

Object Storage Medium/Low Low High Medium High Medium

VDI Medium High Medium High Medium Medium

CDN Low Medium High Medium High High

Memcache High High Medium High Low Medium

Database High High Medium High Medium Medium

Cold Storage Low Low Low Low High Low

“Maintain a minimal set of server configs”

“Provide the right server for the workload”

Today’s Workloads have Heterogeneous Requirements



Provide customers with the service they need….

VM Hosts Bare Metal Hosts


Nova Node Nova Node


Let’s apply this to OpenStack

Controller Nodes

CPU

1TB HDD Mgt NIC

Block Storage Node (Cinder)

CPU

20 TB SSD Data+Mgt NIC

Object Storage Node (Swift)

CPU

40TB HDD Data+Mgt NIC

Nova Node

CPU

500GB SSD Data+Mgt NIC


Fabric Interconnect

CPU CPU

CPU CPU

CPU CPU

Compute and Memory

Storage Networking


OpenStack and Fabric Computing

Why OpenStack is great for the Fabric Compute Architectures

Why Fabric Architectures are great for OpenStack…?

more importantly…


Bare Metal Provisioning

Isn’t it going to be complicated?

Ironic?




Fabric Interconnect

CPU CPU

CPU CPU

CPU CPU

Compute and Memory 512 Cores 4TB RAM

128TB Internal 5PB External

Storage

160Gbps Uplinks Networking Switching

Flexible – Bare Metal Server

CPU

How servers are provisioned?

What is OpenStack? “OpenStack is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface.”



Nova Bare Metal:

• The genesis of Bare Metal in Open Stack.

• Available starting in Grizzly release.

• Provides the ability to enroll machines in Nova, and deploy images on them using PXE/IPMI.

• Overloaded libvert driver model to manage bare metal machines.

Ironic Bare Metal :

• Splits Bare Metal from Nova into it’s own project.

• Available starting in Havana release. (basic capabilities)

• Bare Metal servers are now first class citizens.

• Designed to support capabilities that are unique to hardware (not VMs)

• Database/API – HW oriented (i.e. firmware, RAID config, etc)


Bare Metal Provisioning The Difference Between Standard Servers and Fabric Servers


CPU

Flexible - Bare Metal Server

CPU

Traditional Servers – Rackmounts

• Storage and Network are fixed resources.

• You get whatever is in the box

Fabric Servers

• Provision only the storage and networking resources needed for the application

• Right sized for workloads

Supporting this with OpenStack….

• Basic Bare Metal is available today with Nova Bare Metal

• Work with Ironic Bare Metal project to enable flexible provisioning

• Eager to work with other Hardware Vendors with similar needs


How quickly, and correctly, can I deploy this?

Deploying OpenStack – Speed, Efficiency, Repeatability


What goes into deploying OpenStack?

• How many Controller, Swift, Cinder, instances do I need?

• What kind of Disks, NICs, etc should I use?

• Design Network (and possibly storage network)

• Rack, Plug, and Power up many servers and switches.

• Update system firmware and drivers.

• Learn about OpenStack

• Select and installer or build your own workflow.

(repeat when more capacity needed)

At least not at production scale… yet



Nova Compute Cinder Volume

OpenStack Controller

Neutron Network

Swift Object Legend:

Storage

Storage

Storage

Storage

Storage

Storage

Storage

Storage

Uplink

Uplink

SM15000

External

Storage

Expansion

External

Storage

Expansion

Rack and Plug Chassis • 64-256 servers, switch (TOR), shared storage

Zero Touch Provisioning • Fetches config via DHCP/TFTP • Automatically configures servers, network, and storage for

OpenStack use case

Install OpenStack components • Use an OpenStack installation tool to provision OpenStack • Today we use Mirantis Fuel – Made it easy to get started.

20 min

~40 min

~3 hrs

Total Time: ~ 4 hrs

Provisioning Process Today:

- For SeaMicro’s OpenStack Reference Architecture




~15 min to unbox, rack, and plug Couple Hours

(Automated Provisioning)



Rack and Plug Chassis • 64-256 servers, switch (TOR), shared storage

Triple“0” - Provision the Under Cloud • Undercloud Heat template

Triple”O” – Provision the OpenStack Cluster • Overcloud Heat template

Triple”O” – OpenStack-On-OpenStack

Under Cloud (Bare Metal Infrastructure)

Infrastructure

Over Cloud OpenStack Deployments

Over Cloud OpenStack Deployments

VM VM VM VM VM BM

Let’s get the industry behind one way of provisioning things. The Distro-SW and Hardware Vendors must collaborate


Power and Space – Reducing TCO

How much of a reduction can be realized with a Fabric Architecture ????

How Fabric Architectures reduce Space and Power

• Disaggregate storage from servers

• Only provision the needed storage.

• Share disks amongst servers.

• Integrated Switching (Eliminate the TOR)

• Enable energy efficient processors (Atom, ARM)

How OpenStack can help reduce Space and Power

• Automate Powering On/Off of resources when needed.

• BareMetal makes this possible.

• Need some from of DRS to move and consolidate workloads when demand decreases.

Approximate Power Savings?

We’ve measured

20-50% Savings


Power and Space How Dense Can it be?

OpenStack IaaS Rack

256 Opteron/Xeon Servers

or

1024 Atom Servers

16 TB Memory

~13KW Average

40 RU Total

OpenStack Swift Rack

5.4 Petabytes Raw

~20 KW Average

(less for cold storage)

2x 46 RU Racks


SeaMicro OpenStack Blueprint RELEASE 1.0

Included Services:

OpenStack Grizzly based

Nova Compute – virtual machines

Nova Network – VLAN based

Cinder Volume – shared block storage

Swift Storage –Object storage for images and snapshots

Other: Keystone (authentication), Glance (image mgt)

To A

cces

s Sw

itch

Capabilities - What can I do with it?

Cloud-in-a-Box: Fully integrated solution in a single SM15K

Rapid Deployment: Install and ready to deploy VMs in a few hours

Up to 3500 VMs per SM15K system

Multi Tenant Support

High Availability of OpenStack Management and Networking

Storage (Cinder/Swift) Capacity scalable to over 1 PB (Pay as you grow)

VM Size Description VMs per SM15000

tiny 1vCPU, 1GB mem, 15GB disk 3600VMs

small 1vCPU, 2GB mem, 30GB disk 1800 VMs

medium 2vCPU, 4GB mem, 60GB disk 900 VMs

large 4vCPU, 8GB mem, 120GB disk 450 VMs

xtra-large 8vCPU, 16GB mem, 240GB disk 225 VMs

• Flavors can be adjusted to meet your specific use case. Defaults are shown.


OpenStack Blueprint Roadmap

2014 – Q1

2014 – Q2 2014 – Q3

Blueprint

Major Releases Key Features

1.0 - Oct 2013

OpenStack Grizzly Release

IaaS Compute (Nova), Block Store (Cinder), Swift

Single Chassis Design

2.0 - Feb 2014

OpenStack Havana Release

+ Bare Metal Provisioning

+ Neutron

+ Multi-Chassis Design

+ Improved HA and Load Balancing

+ Improved installation automation

3.0 – Q2 2014 OpenStack Icehouse Release

Additional SeaMicro value added capabilities

Need a customized design? SeaMicro and its partners can work with you to design an OpenStack architecture that meets your business needs.

Minor release will be delivered to add incremental features.

Dates are approximate

Disclaimer: Roadmap is forward looking and subject to change.

openstack on the fabric - openstack korea january seminar 2014

Technology