master thesis presentation on 'cloud service broker

CLOUD SERVICE BROKER Carlos Gonçalves <[email protected]> Mestrado Integrado em Engenharia de Computadores e Telemática Supervised by: Prof. Dr. Diogo Gomes & Prof. Dr. João Paulo Barraca

DETI – University of Aveiro 20 December 2013

Outline •  Introduction & Motivation

• Brokering Cloud Services

• Solution for a Cloud Service Broker

• Results

• Conclusions

20 December 2013 Cloud Service Broker 2

INTRODUCTION

20 December 2013 3 Cloud Service Broker


More devices & more broadband!


Is It born in us?


We’ve been producing data …


… lots of data!


Photos, videos, music, docs, emails …


Anywhere


Anytime


Anyhow


Everything accessible at user’s fingertips


Cloud computing in a nutshell

Definition

“Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing

resources […] that can be rapidly provisioned and released with minimal management effort or service provider interaction.”

— NIST


Essential characteristics 1.  On-demand self-service 2.  Rapid elasticity 3.  Ubiquitous network access 4.  Resource pooling 5.  Measured service


Delivery models

Networking

Storage

Servers

Virtualization

Operating System

Middleware

Runtime

Data

Applications

Networking

Storage

Servers

Virtualization

Operating System

Middleware

Runtime

Data

Applications

Networking

Storage

Servers

Virtualization

Operating System

Middleware

Runtime

Data

Applications

Del

iver

ed a

s a

serv

ice

Use

r man

ages

Use

r man

ages

Del

iver

ed a

s a

serv

ice

Del

iver

ed a

s a

serv

ice

Infrastructure as a Service Platform as a Service Software as a Service


Deployment models • Public cloud • Private cloud • Community cloud • Hybrid cloud


Community cloud

On premise

Private cloud

Community cloud

Off premise

Public cloud

Community cloud

Community cloud

Interoperability Ability to easily move resources from one provider to another and between

same or different deployment models

• Heterogeneity of solutions •  Different data models, interfaces, authentication and authorization

mechanisms, … •  Vendor lock-in!

• Standardization initiatives •  OVF, OCCI, CIMI, TOSCA, CAMP, …


Motivation •  Functional requirements •  Location • Elasticity • Billing / business models


BROKERING CLOUD SERVICES


Cloud Service Broker “An entity that manages the use, performance and delivery of cloud services

and negotiates relationships between cloud providers and cloud consumers”

— Gartner


Enterprise

CSB Platform

CSPN

CSP1

CSP2

Enterprise

CSB Platform

CSPN

CSP1

CSP2CSB

Platform

CSPN

CSP1

CSP2

Enterprise

CSB Platform

Tools and CSBs • Multi-cloud tools

•  Jclouds, Deltacloud, Fog, Libcloud, Pkgcloud, Gophercloud

• Ongoing CSB projects •  Industry: Appsecute, Jamcracker •  Research: MOSAIC, STRATOS, Broker@Cloud


SOLUTION FOR A CLOUD SERVICE BROKER


Cloud Service Broker

Intelligent and autonomous CSB capable of recommending CSPs and easing applications lifecycle, orchestrating the whole process in a cloud

of clouds


Architecture overview



PaaSManager

Heroku Cloud Foundry ...

Web PortalCLI SCM

Private PaaS

Private PaaSManager

IaaSManager

Amazon EC2 Open Stack Rackspace Microsoft Azure

PaaS Manager PaaS Manager API

MonitoringEngine

CloudBees API

App#1

CloudFoundry APIApp#1 App#2

App#3

Heroku API

App#1 App#2

InformationResources

ManagementResources

IronFoundry APIApp#1 App#2

NewRelic NewRelic NewRelic

Git Server

PaaSManagerDatabase

Mgmt PaaS Adapters Info PaaS Adapters


IaaS Manager


IaaS Manager API

Data store

IaaS 1 IaaS 2 IaaS 3 ...

Common Cloud API

Images

MachinesCIMI

Private PaaS Manager


Private Paas Manager API

Cloud Foundry Mgmt

PaaS 1 PaaS 2 PaaS N

…Data store

Job queueing

SSH / NATS

…

App deployment

SCM Manager API

SVNGit Hg

User

1. Push to SCM(git/svn/hg/https)

CSB API

PM client

ApplicationsResource

PaaS Manager

PaaS Manager API

Common PaaS API

PaaS 1 PaaS 2 PaaS N

SCM client

4. REST3. REST

CSB pluginRepository Hooks

Plugins

2. REST

ACM


RESULTS


Recommendation <?xml version="1.0" encoding="UTF-8" standalone="yes"?> <manifest> <rules> <rule> <name>runtime</name> <params> <param>Ruby</param> <param>less-equal</param> <param>1.9.3</param> </params> </rule> <rule> <name>framework</name> <params> <param>Rails</param> <param>greater-equal</param> <param>3.0</param> </params> </rule> <rule> <name>service</name> <params> <param>POSTGRESQL_9_1</param> </params> </rule> <rule> <name>metric</name> <params> <param>response_time</param> </params> </rule> <rule> <name>metric</name> <params> <param>usage_cpu</param> </params> </rule> </rules> </manifest>


0

50

100

150

200

250

0 100 200 300 400 500 600 700 800 900 1000

Tim

e (m

s)

Requests

Total timeCSB time

PaaS Manager CSB Total

Average (ms) 35.878 10.893 52.976

Confidence interval (95%) 0.645 0.819 0.710

Standard deviation (ms) 10.387 1.641 11.449

Error (%) 1.797 0.935 1.341

Web API • RESTful

•  CSP recommendation •  Application CRUD operations •  Service CRUD operations •  Resources scaling •  Monitoring •  Migration •  Logging

• Security •  OAuth 1.0a •  HTTP Basic Authentication


User Consumer Service

request_token

grant request_token

redirect to auth page

authorize request_token

acknowledge authorization

redirect to consumeraccess_token

grant access_token

access protected resource

return requested data





Authentication completed

App provisioning on a Private PaaS


1.  Create VM 2.  Bootstrap Private PaaS 3.  Register Private PaaS 4.  Deploy pending apps

VM @ IaaS


PaaSManager

Private PaaSManager

IaaSManager

Private PaaS

User

1. Push application)

2

2.1

3

3.1

4, 5

4.1, 5.1

User interfaces • Web portal • RubyGem library • Command-line Interface


CONCLUSIONS


Conclusions • Cloud computing presents a new paradigm to explore

new ways of offering better solutions to customers

• Migrating from one CSP to another can be tricky, time-consuming and expensive

• Cloud interoperability should be of paramount importance

• A CSB architecture was proposed and implemented •  Recommends the most appropriate platform from a catalog of

miscellaneous PaaS offerings

•  Delivers cloud services on a cloud of clouds


Future work • PT Inovação S.A. is integrating the CSB in a larger project • PaaS CSPs have different business models

•  Predicting costs for clients is troublesome

• Reevaluate the CAMP API


Contributions •  C. Gonçalves, D. Cunha, P. Neves, P. Sousa, J. P. Barraca, and D. Gomes, “Towards a Cloud

Service Broker for the Meta-Cloud” in 12a Conferência sobre Redes de Computadores, 2012, pp. 7–13

•  http://revistas.ua.pt/index.php/crc/article/view/2035

•  DMTF CIMI Java model and client library •  LGPLv3

•  https://github.com/cgoncalves/cimi-java

•  DeltaCloud •  Discussions and testing

•  Code contribution

•  OpenStack cloud on ATNoG •  Code contributions to OpenStack

•  Add commands used by NFS volume driver to rootwrap (Cinder)

•  No handler for NFS volume (Nova)


Acknowledgments


Q & A

Thank you


CLOUD SERVICE BROKER Carlos Gonçalves <[email protected]> Mestrado Integrado em Engenharia de Computadores e Telemática Supervised by: Prof. Dr. Diogo Gomes & Prof. Dr. João Paulo Barraca
