getting started with managed database services on aws

54
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Harry Lin (林書平), Solutions Architect, AWS May 20, 2016 Getting Started with Managed Database Services on AWS

Upload: amazon-web-services

Post on 15-Apr-2017

192 views

Category:

Technology


0 download

TRANSCRIPT

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Harry Lin (林書平), Solutions Architect, AWS

May 20, 2016

Getting Started with Managed

Database Services on AWS

What to expect from the session

• Why managed database services?

• AWS managed database options

• Amazon RDS—A relational managed database

• Amazon DynamoDB—A nonrelational managed database

• Amazon ElastiCache—A managed in-memory cache

• Amazon Redshift—A managed data warehouse

• Wrap-up

Why managed database services?

If you host your databases on-premises

Power, HVAC, net

Rack and stack

Server maintenance

OS patches

DB software patches

Database backups

Scaling

High availability

DB software installs

OS installation

you

App optimization

If you host your databases on-premises

Power, HVAC, net

Rack and stack

Server maintenance

OS patches

DB software patches

Database backups

Scaling

High availability

DB software installs

OS installation

you

App optimization

If you host your databases in Amazon EC2

Power, HVAC, net

Rack and stack

Server maintenance

OS patches

DB software patches

Database backups

Scaling

High availability

DB software installs

OS installation

you

App optimization

If you host your databases in Amazon EC2

OS patches

DB software patches

Database backups

Scaling

High availability

DB software installs

you

App optimization

Power, HVAC, net

Rack and stack

Server maintenance

OS installation

If you choose a managed DB service

Power, HVAC, net

Rack and stack

Server maintenance

OS patches

DB software patches

Database backups

App optimization

High availability

DB software installs

OS installation

you

Scaling

Quick summary of the options

Self-managed EC2 instances Fully managed

Corporate data

center

DatabaseDB on EC2

instanceRDS

What are the AWS managed DB

options?

A managed service for each major DB type

Amazon

Redshift

Data

warehouse

Amazon

DynamoDB

Document

and key-

value store

Amazon

RDS

Relationaldatabase

engines

Amazon

ElastiCache

In-memory

key-value

store

What is Amazon RDS?

Relational databases

Fully managed

Fast, predictable performance

Simple and fast to scale

Low cost, pay for what you useAmazon

RDS

Amazon Aurora

Authentication and access control

Encryption

SSL

Security groupsAmazon

RDS security

Use cases

Applicable wherever you need relational databases

eCommerce Gaming

Websites IT solutions

Apps

Reporting

RDS feature matrix

Feature Aurora MySQL PostgreSQL MariaDB Oracle SQL Server

VPC

High availability

Instance scaling

Encryption

Read replicas Oracle

GoldenGateCross-region

Maximum storage 64 TB 6 TB 6 TB 6 TB 6 TB 4 TB

Scale storage Auto

Scaling

Provisioned IOPS NA 30,000 30,000 30,000 30,000 20,000

Largest instance R3.8XL R3.8XL

M4.10XL

R3.8XL

M4.10XL

R3.8XL

M4.10XL

R3.8XL

M4.10XL

R3.8XL

M4.10XL

Amazon Aurora: Fast, available, and MySQL-compatible

SQL

Trans-

actions

AZ 1 AZ 2 AZ 3

Caching

Amazon

S3

5x faster than MySQL on

same hardware

SysBench: 100K writes/sec

and 500K reads/sec

Designed for 99.99%

availability

6-way replicated storage

across 3 AZs

Scale to 64 TB and 15 Read

Replicas

Amazon RDS is simple and fast to scale

Database instance types

offer a range of CPU and

memory selections

Scale up or down among

instance types on demand

Database storage is

scalable on demand

Amazon RDS offers fast, predictable storage

General Purpose

(SSD) for most

workloads

Provisioned IOPS

(SSD) for OLTP

workloads up to

30,000 IOPS

Magnetic for small

workloads with

infrequent access

High availability Multi-AZ deployments

Enterprise-grade fault tolerance solution for

production databases

Choose Read Replicas for scalability and enhanced

data locality

Relieve pressure on your master node for supporting reads and writes

Even faster recovery in the event of disaster

Bring data close to your customers

Promote to a master for easy migration

Choose cross-region snapshot copy for even greater

durability, ease of migration

Copy a database snapshot

to a different AWS Region

Warm standby for disaster

recovery

Base for migration to a

different region

How do Amazon RDS backups work?

Automated backups

Restore your database to a point in

time

Enabled by default

Choose a retention period, up to 35

days

Manual snapshots

Build a new database instance from a

snapshot when needed

Initiated by you

Persist until you delete them

Stored in Amazon S3

Monthly

bill= +

Further details at http://aws.amazon.com/rds/pricing/

You pay for the resources that you use

Storage

consumed

Duration for which DB

instances were used

(Price depends on

type of storage)

(Price depends on

type of DB instance)

Free tier (for first 12 months)

• 750 micro DB instance hours

• 20 GB of DB storage

• 20 GB for backups

• 10 million I/O operations

GBN ×

Selected Amazon RDS customers

What is Amazon DynamoDB?

Amazon DynamoDB

NoSQL database

Fully managed

Single-digit millisecond latency

Massive and seamless scalability

Low costAmazon

DynamoDB

Amazon DynamoDB: a managed document and

key-value store

• Simple and fast to deploy, easy to scale

• Data is automatically replicated

• Fast, predictable performance

• Helps provide security and control

• Fine-grained access control

• No cost to get started

• Pay only for what you consume

Popular use cases

Ad tech IoT GamingMobile

& web

Ad serving,

retargeting, ID

lookup, user

profile

management,

session-

tracking, RTB

Tracking state,

metadata and

readings from

millions of

devices, real-

time

notifications

Recording

game details,

leaderboards,

session

information,

usage history,

and logs

Storing user

profiles,

session details,

personalization

settings, entity

specific

metadata

Writes

Replicated continuously to 3 AZs

Persisted to disk (custom SSD)

Reads

Strongly or eventually consistent

No latency trade-off

Automatic replication for rock-solid durability and

availability

Amazon DynamoDB: A schemaless database

Attributes

SchemalessSchema is defined per item

Items

Table

Item key

DynamoDB: What are capacity units?

One write capacity unit One read capacity unit

One strongly consistent

read per second up to 4KB

or

Two eventually consistent

reads per second

One write per

second up to 1KB

Simple app architecture with Amazon DynamoDB

Elastic Load

Balancing Amazon EC2

app instances

Clients

DynamoDB

Business logic

You pay for the resources that you use

Monthly

bill = GB +

Pricing varies by region. Further details at http://aws.amazon.com/dynamodb/pricing/

Storage

consumed

Write

capacity

units

(WCUs)

+

Read

capacity

units

(RCUs)

Free tier:

• Generous free tier of 25 GB, 25 WCUs, and 25 RCUs

• That is, you get over 60M read requests and 60M write request for free in a month

• The free tier is indefinite—you benefit from this every month

What is Amazon Redshift?

Amazon

Redshift

a lot faster

a lot cheaper

a whole lot simpler

Relational data warehouse

Massively parallel; petabyte scale

Fully managed

HDD and SSD platforms

$1,000/TB/year; starts at $0.25/hour

Popular use cases

10x cheaper

Easy to provision

Higher DBA productivity

Traditional

enterprises

10x faster

No programming

Easily leverage BI tools,

Hadoop, machine

learning, streaming

Companies

with big data

Analysis in-line with

process flows

Pay as you go, grow as

you need

Managed availability and

disaster recovery

SaaS

companies

Amazon Redshift architectureLeader node

• Simple SQL endpoint

• Stores metadata

• Optimizes query plan

• Coordinates query execution

Compute nodes

• Local columnar storage

• Parallel/distributed execution of all

queries, loads, backups, restores,

resizes

Start at just $0.25/hour, grow to 2 PB

(compressed)

• DC1: SSD; scale 160 GB–326 TB

• DS2: HDD; scale 2 TB–2 PB

10 GigE

(HPC)

IngestionBackupRestore

JDBC/ODBC

Fully managed, continuous/incremental backups

Multiple copies within cluster

Continuous and incremental backups

to Amazon S3

Continuous and incremental backups

across regions

Streaming restore

Amazon S3

Amazon S3

Region 1

Region 2

Amazon Redshift offers rock-solid fault tolerance

Amazon S3

Amazon S3

Region 1

Region 2

Disk failures

Node failures

Network failure

Availability Zone– or region-level

disasters

Security is built-in

• Load encrypted from S3

• SSL to secure data in transit

• Amazon VPC for network isolation

• Encryption to secure data at rest

• On-premises HSM and AWS

CloudHSM support

• SOC 1, 2, and 3; PCI-DSS;

FedRAMP; BAA

10 GigE

(HPC)

Ingestion

Backup

Restore

Customer VPC

Internal

VPC

JDBC/ODBC

You pay for what you use

Further details at https://aws.amazon.com/redshift/pricing/

Monthly

bill = N ×

Duration for which the

nodes were usedNumber of nodes

(Price depends on type

of node)

2 month free trial

Leader node is free

No upfront costs, pay as you go

Selected Amazon Redshift customers

What is Amazon ElastiCache?

In-memory key-value store

High-performance

Memcached and Redis

Fully managed; zero adminAmazon

ElastiCache

Popular use cases

Caching layer for

performance or cost

optimization

Databases

Ephemeral key-value

data

Storage

Leaderboards

In-memory lists

Session management

Event counters

High-performance

app patterns

• Fully managed

• Cache node auto-

discovery

• Multi-AZ node

placement

Key ElastiCache features

• Fully managed

• Multi-AZ with

auto-failover

• Persistence

• Read replicas

Amazon ElastiCache: simple app architecture

Elastic Load

Balancing Amazon EC2

app instances

Clients

Amazon RDSAmazon

ElastiCache

How ElastiCache billing works

Monthly

bill = N ×

Further details at http://aws.amazon.com/elasticache/pricing/

Duration for which the

nodes were usedNumber of nodes

(Price depends on type

of node)

Free tier (for first 12 months)—750 micro cache node hours

Selected ElastiCache customers

To sum up…

Benefits of AWS managed database services

Pay only for what

you use

No upfront cost

Fully managed

services

AWS handles

installs, patching,

restarts

Easy to scale

Grow as you need

Designed for use

with other AWS

services

AWS

Data PipelineAmazon

EC2

Amazon

S3

Amazon

CloudWatchAmazon

SNS

Amazon

VPC