ibm cloudant datalayer managed service with nosql€¦ · ibm cloudant data layer value...

© 2012 IBM Corporation

IBM Cloudant

Datalayer Managed Service

with NoSQL

Jun12, 2014

@인터콘티넨탈호텔인터콘티넨탈호텔인터콘티넨탈호텔인터콘티넨탈호텔

Agenda

© 2014 IBM Corporation2

� NoSQL & DBaaS의 진화, 배경설명

� IBM Cloudant의 탄생 배경

� IBM Cloudant의 특징

� IBM Cloudant의 전략

� 글로벌 성공사례

� 무료 계정등록 방법

NoSQL & DBaaS 진화진화진화진화


Bigdata시대 도래

DBaaS의 시대 도래

NoSQL의 필요성 대두, 독자적으로 개발 및 채택, 확산

Web2.0

Bigdata/Cloud/mobile 시대에시대에시대에시대에부합하는부합하는부합하는부합하는 DB의의의의요건요건요건요건


• 고성능 (Read/write)mobile, web, 폭발적인폭발적인폭발적인폭발적인동시유저수증가동시유저수증가동시유저수증가동시유저수증가환경환경환경환경

• 뛰어난 확장성 (downtime없는 fast scale-out)빈번한빈번한빈번한빈번한 update, 변동성확장변동성확장변동성확장변동성확장용이에용이에용이에용이에대응대응대응대응, 신속한확장신속한확장신속한확장신속한확장.

• 저렴한 TCO

• 외부시스템과의 연동, 특정시스템플랫폼등에특정시스템플랫폼등에특정시스템플랫폼등에특정시스템플랫폼등에제한이제한이제한이제한이없어야없어야없어야없어야한다한다한다한다.

• 고가용성 (HA,replication)

• 관리의관리의관리의관리의 편리성편리성편리성편리성 (유지보수유지보수유지보수유지보수, 장애대응장애대응장애대응장애대응)

NoSQL Database with JSON

� Key Value Stores

� Columnar Stores

� Document Stores

� Graph Stores

� Object Databases

5

50% of

NoSQL

products

are JSON-

based

document-

oriented

databases.


http://nosql-database.org

데이터데이터데이터데이터포멧의포멧의포멧의포멧의진화진화진화진화(JSON)

002342 Chanho Park hr seoul 010-4995-0001 cell002342 Chanho Park hr seoul 02-3333-0001 home002342 Chanho Park hr seoul 02-222-3333 office002343 Ryu Hyunjin hr seoul 02-222-3333 cell* 데이터 중복 최소화를 위한 데이터 구조* 데이터 무결성을 보장하는 데이터 구조* * * * 데이터데이터데이터데이터 구조구조구조구조 변경이변경이변경이변경이 어려운어려운어려운어려운 단점단점단점단점* I/O * I/O * I/O * I/O 발생이발생이발생이발생이 큰큰큰큰 구조로구조로구조로구조로 대용량대용량대용량대용량////확장확장확장확장

<employee>

<id>002342</id>

<name>Chanho Park</name>

<dept-id>hr</dept-id>

<addr>Seoul</addr>

<contacts>

<cell>010-4995-0001</cell>

<home>02-3333-0001</home>

<office>02-222-3333</office>

</contacts>

</employee>

* 데이터 포멧 및 타입을 섬세하게 표현* 구조화된 데이터 구조를 보장* 데이터의 가독성이 뛰어남* * * * 데이터데이터데이터데이터 사이즈가사이즈가사이즈가사이즈가 커짐커짐커짐커짐* XML * XML * XML * XML 파싱파싱파싱파싱(parsing)(parsing)(parsing)(parsing) 비용이비용이비용이비용이 매우매우매우매우 큼큼큼큼* * * * 대용량대용량대용량대용량 데이터에데이터에데이터에데이터에 부적합부적합부적합부적합

{employees: [ { id: “002342”,

name: “Chanho Park”,

dept-id:”hr”, addr:”Seoul”

contacts: {

cell: “010-4995-0001”,

home:”02-3333-0001”,

office:” 02-222-3333”}

} , { id: “002343”,

name: “Ryu Hyunjin”,

dept-id:”hr”, addr:”Inchon”

contacts: {

cell: “010-4995-0001”,

}]

}

* * * * XMLXMLXMLXML급의급의급의급의 데이터데이터데이터데이터 구조화구조화구조화구조화////표현력을표현력을표현력을표현력을 제공제공제공제공* XML* XML* XML* XML보다보다보다보다 데이터데이터데이터데이터 가독성가독성가독성가독성 뛰어남뛰어남뛰어남뛰어남* * * * 데이터데이터데이터데이터 파싱파싱파싱파싱(parsing)(parsing)(parsing)(parsing) 비용이비용이비용이비용이 저렴저렴저렴저렴* JSON* JSON* JSON* JSON은은은은 가장가장가장가장 범용적인범용적인범용적인범용적인 웹웹웹웹 기술기술기술기술* * * * 사용하기사용하기사용하기사용하기 쉽고쉽고쉽고쉽고,,,, 개발자개발자개발자개발자 이해도이해도이해도이해도 높음높음높음높음* BigData* BigData* BigData* BigData 시스템에시스템에시스템에시스템에 적합한적합한적합한적합한 데이터데이터데이터데이터 포멧포멧포멧포멧

RDBMS방식 XML 방색 JSON 방식방식방식방식


IBM Cloudant의의의의시작시작시작시작

� CERN 연구소의연구소의연구소의연구소의 LHC실험실험실험실험과정에과정에과정에과정에

발생하는발생하는발생하는발생하는페타바이트페타바이트페타바이트페타바이트수준의수준의수준의수준의실험실험실험실험

데이터를데이터를데이터를데이터를분산분산분산분산저장하고저장하고저장하고저장하고전세계전세계전세계전세계 140개개개개

연구소와연구소와연구소와연구소와공유하는공유하는공유하는공유하는데이터데이터데이터데이터저장소를저장소를저장소를저장소를

Boston출신의출신의출신의출신의 MIT 박사박사박사박사 3명이명이명이명이개발개발개발개발

� 분산데아타베이스분산데아타베이스분산데아타베이스분산데아타베이스, Managed Service

DB 형태라는형태라는형태라는형태라는새로운새로운새로운새로운개념의개념의개념의개념의

DBaaS컴퍼니인컴퍼니인컴퍼니인컴퍼니인 Cloudant를를를를

2008년에년에년에년에설립설립설립설립

� 2014년년년년 3월말월말월말월말공식적으로공식적으로공식적으로공식적으로 IBM솔루션이솔루션이솔루션이솔루션이

됨됨됨됨.

� 현재현재현재현재 30,000 accout에게에게에게에게데이터베이스데이터베이스데이터베이스데이터베이스

서비스서비스서비스서비스제공제공제공제공

7 © 2014 IBM Corporation

IBM Cloudant Data Layer Value

� Best-of-breed NoSQL database and clustering technology–Global network of servers across 35 data centers

–Managed 24x7 by big data experts–Replication and sync for HA/DR

8

Cloudant is a fully-managed data layer service that provides high availability, scalability, simplicity, and performance for web & mobile applications


IaaS + Cloudant = Cloudant DBaaS

NetworkingNetworking

StorageStorage

Server HWServer HW

ServerServer

VirtualizationVirtualization

O/SO/S

{{{{ IIIInfrastructure nfrastructure nfrastructure nfrastructure aaaas s s s aaaa SSSService}ervice}ervice}ervice}

Cloudant’sExpert


Platform as a Service (PaaS)

IBM Cloudant is a Database as a Service (DBaaS)

� DBaaS: Cloud database provisioning, management, and scaling

provided as a paid service to customer

� IBM offers hardware AND manage the software

(scaling, updating, maintenance): client only consumes capabilities– Pay-as-you-go or subscription (system size X number of months)

10

Security

Synchronization

Replication

Performance Tuning

Elastic Scalability

High Availability

Patching & Upgrading

Cloud

Database

Service

Customer

Application


IBM Cloudant 클러스터링클러스터링클러스터링클러스터링

� 모든모든모든모든데이터데이터데이터데이터클러스터클러스터클러스터클러스터

내부에서내부에서내부에서내부에서복제복제복제복제됨됨됨됨

� 안정적인안정적인안정적인안정적인 분산분산분산분산아키텍처아키텍처아키텍처아키텍처구현구현구현구현

� Zero Downtime 지향지향지향지향

� 가장가장가장가장진보된진보된진보된진보된 Clustering

아키텍처아키텍처아키텍처아키텍처– 마스터노드가필요없는간단한구조 (Simple Is the Best)

– 노드를추가하기만하면용량, 성능, 가용성확장가능


IBM Cloudant NoSQL DBaaS

Indexed JSON

Storage

Geo-Load BalancingGeo-Load Balancing

App Layer / Browser / Mobile AppApp Layer / Browser / Mobile App

REST (HTTPS)

Physical Storage @ IBM SoftLayer, Rackspace, Microsoft Azure, AWS

Cloudant JSON API

JSON CRUD

JSON CRUD

Multi-Master Replication

Multi-Master Replication

Device Sync

Device Sync

Lucene Search

Lucene Search

2D, 3D Geospatial

2D, 3D Geospatial

Incremental MapReduce

Incremental MapReduce Monitoring Monitoring SecuritySecurity

IO

Control

IO

Control

Managed for you 24x7 by Cloudant developer-operators


Geospatial DB & Search –지리지리지리지리정보정보정보정보

� 데이터에데이터에데이터에데이터에지리지리지리지리정보를정보를정보를정보를결합해서결합해서결합해서결합해서저장하여저장하여저장하여저장하여활용활용활용활용가능가능가능가능

– 예: 현재위치에서가장가까운주차장검색/소트, 서울시종로구에있는모든버스정류장검색

� OGC(Open Geospatial Consortium)의의의의WFS, OpenSearch 스펙에스펙에스펙에스펙에근거한근거한근거한근거한기능기능기능기능

– 다양한연산: Disjoint, Crosses, Within, Contains, Intersect, Overlaps, Touches

� GeoJSON 형식형식형식형식데이터데이터데이터데이터저장저장저장저장

– 오픈포맷으로활용도높음

� R-Tree와와와와 TPR*-Tree에에에에

기반한기반한기반한기반한효율적인효율적인효율적인효율적인

Spatial 데이터데이터데이터데이터저장저장저장저장

� Use Cases– 지역정보를활용한실시간

마케팅

– 지리정보에기반한데이터관리

http://geodemo.cloudant.com/colorado_skiing/geo/demos/cloudant/index.html


DB Replication

(Mobile sync, Data2Device)

Pull

Push

Sync

Mediate

Cluster A Cluster B

CouchDB

Mobile Device (예: ToDo List)


Cloudant Sync

• Cloudant(분산분산분산분산클러스터클러스터클러스터클러스터), CouchDB(독립독립독립독립서버서버서버서버), SmartPhone(모바일모바일모바일모바일) 간간간간

동기화동기화동기화동기화지원지원지원지원

• Offline 기기와의기기와의기기와의기기와의동기화동기화동기화동기화지원지원지원지원

• Schedule, ToDo List 등등등등데이터데이터데이터데이터디바이스디바이스디바이스디바이스간간간간자동자동자동자동동기화동기화동기화동기화

Local

Storage

Local

Storage


High Availability of Cloudant DBaaS가용성가용성가용성가용성

� LHC Computing Grid에서에서에서에서검증된검증된검증된검증된 BigCouch 아키텍처아키텍처아키텍처아키텍처

� 복수복수복수복수노드노드노드노드간간간간, 복제본복제본복제본복제본(Replica)를를를를생성하고생성하고생성하고생성하고필요할필요할필요할필요할경우경우경우경우원격원격원격원격센터에센터에센터에센터에

복제하여복제하여복제하여복제하여장애장애장애장애상황에상황에상황에상황에대응대응대응대응가능가능가능가능

� 2012년년년년 Amazon East Coast 센터센터센터센터장애장애장애장애시에도시에도시에도시에도서비스서비스서비스서비스지속했던지속했던지속했던지속했던사례사례사례사례 !!


17

어떤어떤어떤어떤문제가문제가문제가문제가있으세요있으세요있으세요있으세요?

� P대규모동시접속사용률이예상되는웹애플리케이션이나모바일앱을

개발중이신가요?

� P비용, 데이터베이스문제등으로애플리케이션빌드와배포에문제를경험하신

경험이있으신가요?

� PNoSQL데이터베이스의장점을필요하십니까?

� P오픈소스를사용하면서엔터프라이즈솔루션급의지원과 24X7의가용성을

원하십니까?

� P부담없는초기투자비용으로시작하는유연성을원하십니까?

� PSaaS (Software as a service)의시스템운영모델을원하십니까? (OpEx)

� P신속한확장과배포로안정적인서비스체계를원하십니까?

If your clients have the following questions today,

then Cloudant is your solution!

Are your clientsJ


답은답은답은답은 IBM-Cloudant입니다입니다입니다입니다.

� Scales massively

– Handle millions of daily active users

� Guaranteed performance & up time

– Removes risk of project & SLA delivery failure

� More agile development for web & mobile

– No rigid schemas to slow development

� Managed for you

– Stay focused on new development, not DB administration

Build more

Grow more

Sleep more



New Servicesand Agility

MobileDevices Cloud

Delivery

IBM Cloudant 전략전략전략전략

� Cloudant – a database-as-a-service (DBaaS) provider – that enables

developers to easily and quickly create next generation mobile and

web apps

20

Cloud– Improves the value of IBM’s solutions for Cloud, Mobile, Social, and Big Data �� Synergy effects to all 5 of IBM’s key growth areas

– Extends IBM’s Big Data & Analytics portfolio �� Data management capabilities for cloud and mobile solutions

– IBM provides a highly flexible, scalable, and capability-rich solution�� Differentiates

Delivered as a cloud service, Cloudant eliminates complexity & enables developers of fast-growing web and mobile apps to focus on developing their applications,

without the need to manage database infrastructure and growth

Analytics/Bigdata

Social

Mobile


Security

CAMS

IBM Cloudant

Success Story


Recent Competitive Results – “Oculus” case

� Cloudant recently won a deal post-acquisition with the leading virtual

reality technology company. (Facebook bought Oculus for 2 billion$)

� Results of technology evaluation demonstrate Cloudant is the clear choice

among NoSQL database solutions for web-scale & mobile applications

X – No multi-master

replication

X – No geo-load balancing

X – No indexing capabilities

X – Difficulty adding

new regions

X – Poor data throttling

X – No hosting or managed

service offer

X – No managed DR services

X – No client-server

replication

X – Poor data throttling

X – No geospatial capabilities

X – No multi-master

replication

X – No guarantee for global

data consistency

X – Poor horizontal

scalability

X – Poor global replication

abilities

X – No lockless reading &

writing

X – No hosting or managed

service offer

X – No managed DR services

X – No support for binary

attachments

X – No geospatial capabilities

83%better than:

48%better than:

32%better than:

20%better than:

How Cloudant performed3

Mark Zuckerberg bought Oculus VR.

23

-Won case against MongoDB, AWS Dynamo.

-Successful PoC with Cloudant.

-This company is now easily worth $4B

-Samsung Looks To Future, Developing Virtual Reality Headset withFacebook’s Oculus VR.

-Fast growing nodes, clusters of

Cloudant.


Joel DeYoung

Co-Founder & Director of Technology; Hothead Games

“Our code handles

hundreds of millions of

transactions a day.

Moving our data to

Cloudant has freed up our

team to focus on what

matters most: making a

great experience for users. ”

scales globally on

demand with fully

managed services

Use Case: Hothead Games

� Company Background– Mobile and web gaming company– Unexpected success required the studio to

rapidly scale out their service to accommodate increasing demand for product

– Lacked DBAs to support the growth

� Success Criteria– Database that can support high availability demand

– A managed solution to avoid hiring additional DBAs

– Improved data management – too messy with RDBMS

� Solution & Results– CLOUDANT DBaaS to provide the needed operational data store to the applications

with massive concurrent mix of low-latency read and writes

– Successfully addressed data durability demands

– Provided replication and sync capabilities not previously had across geographically

distributed data generation & for mobile devices and multiple platforms

25 © 2014 IBM Corporation

Media Streaming Challenge: User Data Management

� For each user, manage:– Profile– Media library– Listening/viewing preferences– Listening/viewing history– Likes and dislikes– Purchase history– Usage

� Also:– Store catalog titles from media publishers (usually shared as JSON)

� Millions of daily users accessing entertainment around the clock and

around the globe

Need a DBMS that can scale to handle this 24 x 7


Cloudant Media Streaming Customers

Why Streaming Media Businesses Choose Cloudant

� Fully managed distributed NoSQL

Database as a Service (DBaaS)

� Guaranteed performance & up

time

� Elastic scaling and costs

� Single, transactional JSON

“document” database with

RESTful API

� Spreads data across data centers

& devices for scale & high

availability– Geo load balancing connects users

to the closest copy

Multi-master replication distributes data across 34 data centers or devices


Novartis

successfully manages clinical

trial data with high availability,

stability, and security

John Walker, IT Director for Novartis

“Everything is incremental in the Cloudant world, so we only have

to [execute] operations on the small amount of data that’s

changing each day. Processes that were occurring in the realm of

ten to twelve hours, we have down to minutes.”

Norvatis : clinical trial data

� Company Background– $50B+ pharmaceutical company headquartered in Switzerland– Needed to create a management system for all existing clinical

trial data (from own testing and publically available information)– Data is many various formats – not ideal for RDBMS

� Success Criteria– Data in various formats and be able to transform it (raw clinical

trial data) – not suitable for RDBMS

– Raw data to format that is good for reporting– Cost effective way to manage this data �� Oracle environment a) too expensive for

scalability and b) not meeting data formatting needs

� Solution & Results– With Cloudant, Novartis is able to successfully cost-effectively manage clinical trial data

� Cloudant’s managed service means Novartis does not have to add more DBAs to support the system

� Cloudant supports the data and usage scalability that Novartis required without

having to grow an on-premise hardware footprint

– JSON document store supports data formatting & schema flexibility for various trial data


Norvatis : clinical trial data

30

-IT Director John Walker-

Scale-out with Oracle?

“Big problem with Oracle to scale out our clinical trial data. “

Completing operations in minutes — not hours:

“Processes that were occurring in the realm of ten to twelve hours, we have down to minutes.”

Why Cloudant was a great fit for his clients’ needs:

“Cloudant’s master-master replication and ability to allow work in that disconnected mode, then replicate [data] when a network connection has returned, has proved really valuable to us.”

With Cloudant managing database administration, Walker is able to hire

JavaScript experts instead of entire teams, from DBAs to developers:

“One of the things we were excited about with Cloudant is the ability to hire people who know JavaScript well and apply it to the stack. when a network connection has returned, has proved really valuable to us.”


• 지속적지속적지속적지속적데이터데이터데이터데이터모델모델모델모델확장확장확장확장이이이이효과적인효과적인효과적인효과적인데이터데이터데이터데이터유연성유연성유연성유연성

• 대규모대규모대규모대규모동시접속과동시접속과동시접속과동시접속과 Throughput(처리량처리량처리량처리량)지원에지원에지원에지원에효율적효율적효율적효율적

• 지속적지속적지속적지속적확장성확장성확장성확장성보장보장보장보장 (On-demand Scale-out)

• Social Network System(SNS)에에에에최적화된최적화된최적화된최적화된데이터베이스데이터베이스데이터베이스데이터베이스

• 시스템시스템시스템시스템라이센스라이센스라이센스라이센스비용비용비용비용최소화최소화최소화최소화,효율적은효율적은효율적은효율적은 TCO

Runkeeper

New Trends From RDBMS To NoSQL

RunKeeper (2800만만만만 가입자가입자가입자가입자): RDBMS에서에서에서에서 Cloudant 전환전환전환전환

Pain Point: RDBMS확장성확장성확장성확장성 제한제한제한제한, 사용자사용자사용자사용자 확대확대확대확대 제한제한제한제한

RunKeeper (2800만만만만 가입자가입자가입자가입자): RDBMS에서에서에서에서 Cloudant 전환전환전환전환

Pain Point: RDBMS확장성확장성확장성확장성 제한제한제한제한, 사용자사용자사용자사용자 확대확대확대확대 제한제한제한제한


Cloudant Reference

MobileMobile

• High Performance NoSQL

• Geo Search• Full Text Search• Real-time DB

Replication• Mobile Replication

• High Performance NoSQL

• Geo Search• Full Text Search• Real-time DB

Replication• Mobile Replication

RetailRetail

• High Performance Database

• 24X7 High Availability

• Scalability• TCO




Game & SNSGame & SNS







R&DR&D

• Document Oriented Database

• Scalability• Incremental

MapReduce (Indexing)


• Scalability• Incremental

MapReduce (Indexing)

MediaMedia


• 24X7 DB Hibh Availability

• Real-time Database Replication

• Data Analysis


• 24X7 DB Hibh Availability

• Real-time Database Replication

• Data Analysis


IBM Cloudant DBaaS 무료무료무료무료계정계정계정계정등록등록등록등록

33

IBM의 Cloudant 서비스솔루션(DBaaS)이라함은, DB를 Cloud 형태로하드웨어는물론설치부터운영, 모니터링까지하나의서비스로제공하는솔루션을의미합니다. DBaaS를사용하는유저는위와같은고민을할필요없이단지 DB API를이용해 Client 프로그램만개발하면됩니다.

� Cloudant DBaaSCloudant 웹사이트(http://www.cloudant.com)에서가입할수있으며, 웹사이트를통해데이터를조회하거나 DB를생성할수도있습니다. 데이터사이즈 5G까지까지까지까지

한달간한달간한달간한달간 무료무료무료무료로사용할수있습니다.

� Tutorialhttp://cloudantkug.wordpress.com/2013/07/02/tutorialno1-user-registration/

34

경청해주셔서경청해주셔서경청해주셔서경청해주셔서 감사합니다감사합니다감사합니다감사합니다.

김김김김 영영영영 일일일일

[email protected]


ibm cloudant datalayer managed service with nosql€¦ · ibm cloudant data layer value...

Documents