ibm sistemlerinizdeki bilgi patlamasını yönetmenin kolay yolu

Alpay Özer

Veri Depolama Sistemleri Platform Lideri, IBM Türk

Sistemlerinizdeki Bilgi Patlamasını Yönetmenin

Kolay Yolu: IBM SAN Volume Controller

© 2011 IBM CorporationIBM System Storage SAN Volume Controller

Introduction

SAN Volume Controller Architecture

Storage Management Functions

SAN Volume Controller

Agenda


Block VirtualizationSNIA Shared Storage Model

Fixed Size

Bounded Performance

break (occassionally)

As big, small or as many as users need

As fast as users need

Can be very reliable or not

Can grow, shrink, or morph

Physical Disks

Logical Volumes

Block Aggregation


Block VirtualizationSNIA Shared Storage Model


Block Virtualization Value Proposition

Storage Virtualization Layer

VirtualDisk

VirtualDisk

VirtualDisk

VirtualDisk

HP

EMCDS4000

DS8000

HDS

Combine the capacity from

multiple arrays into a single

pool of storage

Apply common

function set across

the storage pool

Manage the

storage pool from a

central point

Make non-disruptive

changes to the physical

storage infrastructure

© 2011 IBM CorporationIBM System Storage SAN Volume Controller6

SVC Delivers Availability, Performance, and Scalability

We designed and built SVC with

the resiliency of a storage controller

SVC supports non-disruptive firmware

updates and hardware maintenance on

the disk arrays to further increase its

availability

SVC is a proven offering, having been

delivering benefits to customers for six

years

It’s resilient

and highly available

It has the fastest benchmark

of any controller

It scales to manage

large environments

SVC has the fastest SPC-1

benchmark EVER submitted

(380K IOPS)

SVC has the fastest SPC-2

benchmark EVER submitted

(7.080 GBPS)

Many references quote

significant performance

improvements

(up to 10X faster)

SVC scales from very

small configurations

(1TB) to large enterprises

(> 500TBs) and growing !

New SVC engines deliver

dramatically better

throughput, supporting

larger and more I/O

intensive environments


SAN Volume Controller Delivers Value

Supports data

movement without

interrupting

applications

Allocate more

storage to

applications

automatically

Simplify

infrastructureScales to meet

business needs

Improves

business

continuity

Improves

storage capacity

utilization

Combines storage

capacity into a single

resource – from

multiple vendors

Manage storage as a

business resource, not

as separate boxes

Automatic process of

storage capacity

provisioning

Manage a single

storage resource

from a central

point

Migrate data

without disruption

Optimizes

resources

Creates tiers of

storage

Enables multi-

vendor strategies

Proactively support

information growth

As client data and

applications grow,

the storage

infrastructure can

grow with them.

© 2011 IBM CorporationIBM System Storage SAN Volume Controller8 IBM Confidental

IBM SAN Volume Controller 6.1

Industry-leading storage virtualization offering

Best performing storage virtualization system in industry-standard benchmarks

First storage virtualization system with fully integrated SSD support

Integrated iSCSI server attachment support

Fully upgradable without disruption from smallest to largest configurations

“Future proof” with ability to replace current hardware with new hardware without

disruption

Network-based virtualization with SVC supports diverse server environments

including VMware, other virtualization, and non virtualized servers

To date, IBM has shipped almost 22,500 SVC engines running in more than

7,200 SVC systems

In 2008 & 2009 across this entire installed base, SVC has delivered better than

five nines (99.999%) availability

SAN Volume Controller is a proven offering that has been delivering benefits to

customers for over six years

SAN Volume Controller can virtualize IBM and non-IBM storage (over 120

systems from IBM, EMC, HP, HDS, Sun, Dell, NetApp, Fujitsu, NEC, Xiotech)


SAN

Volume Controller

SAN Volume Controller Version 6Supported Environments

8Gbps SAN fabric

HPMA, EMA

MSA 2000, XP EVA 6400, 8400

HitachiLightningThunder

TagmaStoreAMS 200, 500,1000, 2100, 2300, 2500

WMS, USP

EMCCLARiiON

CX4-960

Symmetrix

Microsoft

Windows

Hyper-V

IBM AIX

IBM i 6.1

Sun

Solaris

HP-UX 11i

Tru64

OpenVMS

Linux(Intel/Power/zLinux)

RHEL

SUSE 11

IBM

BladeCenter

SAN

SAN

Volume Controller

Continuous Copy

Metro/Global Mirror

Multiple Cluster Mirror

VMware

vSphere 4

Point-in-time CopyFull volume, Copy on write

256 targets, Incremental, Cascaded, ReverseSpace-Efficient, FlashCopy Mgr

Novell

NetWare

Sun

StorageTek

IBM

DSDS3400DS4000

DS5020, DS3950DS6000DS8000

IBM

ESS,

FAStT

1024

Hosts

IBM

N series

NetApp

FAS

SGI IRIX

IBM N series

Gateway

NetApp

V-Series

IBM TS7650G

Bull

StoreWay

Fujitsu

Eternus3000

8000 Models 2000 & 12004000 models 600 & 400

NEC

iStorage

For the most current, and more detailed, information please visit ibm.com/storage/svc and click on “Interoperability”.

Space-Efficient Virtual Disks

New

Entry Edition software

New

Apple

Mac OS

Pillar

Axiom

IBM

XIVDCS9550DCS9900

IBM

z/VSE

New

New

New

New

SSD

New

Native iSCSI

New

New

NewNew

New

Entry Edition

Software

Virtual Disk Mirroring


Introduction




Agenda


TotalStorage Storage Engine 336








SAN Volume Controller cluster

Storage Pool Storage Pool Storage Pool

consistent

Driver Stack

consistent

Driver Stackconsistent

Driver Stack

IBM SAN Volume Controller Architecture and Terminology

SVC Nodewith UPS (not depicted)

IO Group

Array LUNs

Managed Disk

vDISKhere: striped Mode


Virtual-Disk Types

Virtual Disks

MDG1

MDG2

MDG3

Image Mode:

Pass thru; Virtual Disk = Physical LUN

Sequential Mode:

Virtual Disk mapped sequentially

to a portion of a managed disk

Striped Mode:

Virtual Disk striped

across multiple managed

disks. Preferred mode

A

A

B

B

C

C

C






SVC Cluster

SAN Volume Controller – Topology

© 2011 IBM CorporationIBM System Storage SAN Volume Controller14

14

iSCSI Server Attachment

Each SVC Storage Engines have two 1Gbps Ethernet ports

– Until now, 1 port per cluster used for management interface another for service

SVC 5 enables use of these ports for iSCSI server connections

Storage attachment, intra-cluster communication and remote replication still use Fibre Channel

1 port per cluster still used for management interface but not dedicated to this function

Helps reduce cost of server attachment

– May be especially helpful for BladeCenter configurations● Eliminates need for HBA in blades

– Helps reduce number of FC switch ports required

All SVC function available to iSCSI-attached servers

Virtual disks may be shared betweeniSCSI and FC servers

SAN Storage Zones

LAN

Host servers

with iSCSI HBAs

Fibre-attached hosts

Fibre-attached

storage

SAN ZonesSAN Volume

Controller


SVC 2145-CF8 Storage Engine

Based on IBM System x3550M2 server

► Intel® Xeon® 5500 2.4GHz quad-core processor

► Triple cache size to 24GB (with future growth possibilities)

► Four 8Gbps FC ports (support Short-Wave & Long-Wave SFPs)

Up to 4 Solid State Drives

New engines may be intermixed in pairs with other engines in SVC clusters

► Mixing engine types in a cluster results in VDisk throughput characteristics of the engine

type in that I/O group

Supported only by SVC software Version 5

2145-8G4 was withdrawn December 11, 2009

SVC 2145-8A4 Storage Engine (for entry edition)

Based on IBM System x3250 server

► Intel® Xeon® E3110 3.0GHz dual-Core processor

► 8GB of cache (same as model 8G4)

► Four 4Gbps FC ports (same as model 8G4)

Throughput approximately twice that of Model 4F2 and about 60% the throughput

of Model 8G4

At about 60% the price of the Model 8G4

SVC 2145 Storage Engines


Constant development

Backward compatibility(64 bit not for 32 bit Hardware)

Non-disprutive Upgrade sincet

eight years

History

SVC 4F2 - 4GB cache, 2Gb SAN, 2006

SVC 8F2 - 8GB cache, 2Gb SAN (ROHS comp.)

SVC 8F4 - 8GB cache, 4Gb SAN 155.000 SPC-1 IOPS

SVC 8G4 - Dual-core Prozessor, 2008 278.000 SPC-1 IOPS

SVC CF8 - 24GB, Quad-core, 64bit 315.043 " 4-node

380.483 " 6-node

Re

lea

se

SAN Volume Controller R6.1 (CF8)

first Release

Continuous Product Evolution


Stable Scalability

Leading availability record:

99,999 ~ 99,9999%

Maximum SVC-induced latency

= “invisible" 60µs

SVC behaves completely deterministic even under maximimum load due to

the absence of Interrupts

Technology = State-Loop with Adapter Polling

60µs

60µs


SVC: Innovative Scale-Out SSD Implementation

Add SSDs to SVC engines for more capacity– SSDs may be added without disruption to engines

Add SVC engines for more capacity and throughput– Additional engines provide more processing power, more bandwidth, more SAN attachments

– SVC designed to deliver maximum I/O capability of SSDs

– Up to 50,000 read IOPS per SSD

– Up to 200,000 read IOPS per SVC I/O Group

– Up to 800,000 read IOPS per SVC cluster

Add SSDs to scale capacity

Add SVC I/O Groups to scale throughput and add capacity


Scale-Out SSD Support

Up to four 146GB SSDs per SVC engine

– Control costs: buy only as many SSDs as required● Minimum purchase: one SSD

Virtual disk mirroring used to protect SSD data

– Designed to protect against SSD or storage engine failure

– Up to 584GB mirrored capacity (1.2TB total) per I/O Group

– Up to 2.4TB mirrored capacity (4.8TB total) per SVC cluster

SSD fully integrated into SVC system

– Replication, data movement, management operate as for other storage

– Move data to/from SSD without disruption; make copies of SSD data onto HDD

– SSDs in one I/O Group (pair of Storage Engines) may be accessed through any I/O Group in SVC cluster


Innovative SVC SSD Protection Options

Mirroring between SSDs

in SVC Storage Engines

– Suitable for use with any workload

– Recommended general-use

protection option

Mirroring between SSDs and

magnetic disk

– Unique SVC protection option

– Maximizes available SSD capacity

– Suitable for workloads with

primarily read I/Os

● Write I/Os are cached but write

throughput ultimately limited by HDD

ability

– Should be used only with well-

understood workloads

Unmirrored SSDs also an option

– No protection against SSD or storage engine

failure

– Maximizes available SSD capacity

– Not recommended

– Should be used only for easily recreatable data


















SAN Volume Controller cluster

SAN Volume Controller Management Options

SVC GUI Completely redesigned

Browser based

Extremely easy to learn/use

fast

SVC CLI ssh

scripting

complete command set

Tivoli Productivity Center TPC, TPC-R

SMI-S 1.3

Embedded CIMOM

VDS VSS


Monitoraccess to all viewing actions

GUIcannot perform any actions that change the state of the cluster or the resources that the cluster manages. The user can access all the information-related panels and commands, back up configuration data, change his or her password.

Copy Operatorcan manage all existing FlashCopy, Metro Mirror, and Global Mirror relationships. In addition, the user can access all the functions available to the Monitor role.

Servicecan view the View Clusters panel, launch the management GUI, and view the progress of actions on clusters with the View Progress panel, begin disk discovery process, and discover and include disks. A user with this role can also access all the functions available to the Monitor role.

Administratorcan access all functions on the management GUI and issue any command-line interface (CLI) command, except those that deal with managing users, user groups, and authentication.

Security Administrator (SecurityAdmin role name)can access all functions on the management GUI and issue any CLI command. Users with this role can also manage users, user groups, and manage user authentication.

Role based security concept


Introduction




Agenda


SAN Volume Controller – Storage Management Functions

Thin Provisioning (SEV – Space Efficient vDISKS)

Easy Tiering

vDISK Mirroring

Non disruptive Data Migration

Insert and Remove SAN Volume Controller

QoS mit IO Governing

Flashcopy (Point in Time Copy Engine)

Remote Replication

SVC base license:

Separate License Features:


Thin Provisioning – Space Efficient vDisks

Space-Efficient Virtual Disks function is the SVC implementation of “thin provisioning”

Traditional (“fully allocated”) virtual disks use physical disk capacity for the entire capacity of a virtual disk even if it is not used

– Just like traditional disk systems

With SEV, SVC allocates and uses physical disk capacity when data is written

– Can significantly reduce amount of physical disk capacity needed

Available at no additional charge with SVC base virtualization license

Extremely efficient implementation

– Allocation grain size down to 32 KB

SEV will help save much of the “allocated but unused” space on virtual disks today

– Can be 50% or more of disk space, especially in Windows environments

– Storage administrators can focus on more strategic issues

Monitor total SVC capacity utilization, track trends, plan acquisitions

– No longer need to monitor and provision for individual disks


Easy Tier

Automatic storage hierarchy

– Hybrid storage pool with 2 tiers

• Solid-State Disks (SSD) & hard disks

I/O Monitor keeps access history for each virtualisation extent

– 16MB - 2GB per extent

– Every 5 minutes

Data Placement Adviser analyses history every 24 hours

Data Migration Planner invokes data migration

– Promote hot extents

– Demote inactive extentsSSD HDD

Host Volumes & Extents

Hybrid storage pool

Host Host Host

Automatic extent migration

SVC V6.1






SVC Cluster

Applications may

produce Hotspots on vDISKs

limit total system performance

Easy Tier (continuous, self

optimizing Process)

Recognize Hotspots on vDISKs

Replace Hotspots with SSD

Throughput of vDISK gets

dramatically improved

improved performance

use of cheaper hard drives

less spindels

optimal use of SSD capacities

SVC SSD Speicher *

*In Version 6.1 nur mit externem SSD Speicher möglich

SVC Easy Tier (cont.)


Magnetic Disk SSD

DPAIOM DMP DM

IO Monitor generates usage statistics and sends them to the Data Placement Advisor

Data Placement Advisor identifies hot spots, and outputs potential data migrations to the Data Migration Planner

Data Migration Planner decides which migrations to do based on the available storage and its characteristics

Data Migratory uses SVC data migration capabilities to seamlessly migrate the data to higher performing storage without any application interruption

A “hot spot” is formed when an application makes frequent use of the same area of a vdisk. Here, those extents are stored on magnetic disk

SVC Node

Do

min

o

DB

2

Exch

an

ge

vdisk

Easy Tier Management Code

Easy Tier Components


Easy Tier Process – published Benchmark

First ever Storage Performance Council (SPC-1) benchmark

submission with SATA and SSD technology

– System configuration: 2.3 TB SSD + 96 TB SATA

Easy Tier

SSD

HDD SATA

Logical volume

0

10000

20000

30000

40000

50000

60000

0:00 2:00 4:00 6:00 8:00 10:00 12:00 14:00 16:00 18:00

Time

Th

ro

ug

hp

ut (IO

/s)

330% IOPSImprovement

Increase of

330%!


High Availability …

VDISK Mirroring

SAN

Volume Controller

Virtual Disk

SVC Cluster





SVC stores two copies of a virtual disk, usually on separate disk systems

– SVC maintains both copies in sync and writes to both copies

If disk supporting one copy fails, SVC provides continuous data access by using other copy

– Copies are automatically resynchronized after repair

Intended to protect critical data against failure of a disk system or disk array

– A local high availability function, not a disaster recovery function

Copies can be split

– Either copy can continue as production copy

Either or both copies may be space-efficient


…and also Disaster Recovery

VDISK Mirroring

SAN

Volume Controller

Virtual Disk

SVC Cluster





Server Cluster


SVC Stretched Cluster



3rd Quorum

Third site or

separate power domain

SAN Volume Controller – stretched Cluster – Topology


SAN

Non disruptive Data Migration

Traditional SAN

1. Stop applications

2. Move data

3. Re-establish host connections

4. Restart applications


1. Select Virtual Disk to migrate

2. Select Migration Target

3. Initiate Migration

4. Done

SAN VOLUME CONTROLLER


Integration of SVC into existing environments

1

3

2

1 Storage subsystem LUNs assigned to server

2 Stop application

Assign storage subsystem LUN to SVC and create a VDISK on it

(Image Mode VDISK)

3 Assign SVC Image Mode VDISK to server.

Server accesses original data through SVC

Fast SVC integration

No need for time consuming

data migration

All subsequent data migrations

are completely non disruptive


Quality of Service – IO Governing


SVC FlashCopy® Function

Volume-level local replication function

Designed to create copies for backup, parallel processing, test, …

Copy available almost immediately for use

Background copy operation or “copy on write”

Up to 256 copies of a single source volume

Source and target volumes may be on any SVC supported disk systems

Up to 256

targets

Source

vdisk

FlashCopy

relationships


Incremental FlashCopy

FlashCopy capability where only changes from either source or target data since last FlashCopy operation are re-copied during a target refresh

Up to 256 incremental and non-incremental targets can exist for same source

Consistency groups can include both incremental and non-incremental FlashCopy targets

Helps increase efficiency of FlashCopy operations and can reduce time to refresh copies

Designed to allow completion of point-in-time online backups much more quickly, thus the impact of using FlashCopy is reduced

– May enable more frequent backups so enabling faster recovery

– More frequent backups could be used as a form of “near-CDP”

Start incremental FlashCopy

Data copied as normal

Some data changed by apps

Start incremental FlashCopy

Only changed data copied

by background copy

Later …


Cascaded FlashCopy

FlashCopy capability to create “copies of copies”

– Mappings can be incremental or non-incremental

Allows a vdisk to be both source and target in concurrent FlashCopy mappings

– See diagram: Map 2 can be defined and triggered while Map 1 relationship exists

Maximum number of targets dependent on a single source disk is 256. The example shows 4 targets from source disk 0

Enables backup of target disks to be made without having to disrupt existing FlashCopy relationships with original source

Helps reduce time to establish copies of targets, since there is no need to await copy complete of target disk before triggering cascaded copy

Designed to increase flexibility in use of FlashCopy

Disk0Source

Map 1 Map 2

Map 4

Disk1FlashCopy

target of Disk0

Disk2FlashCopytarget of Disk1

Disk4FlashCopytarget of Disk3

Disk3FlashCopy

target of Disk1


Reverse FlashCopy

FlashCopy capability to reverse relationships and enable rapid data recovery

Create disk backup copies of production data (up to 256)

If backup required because of damage to production data

– Unique capability to create copy of damaged data for diagnosis

– Reverse FlashCopy relationship and copy backup to recover production data

● No need to wait for physical data movement to complete

– Backup or other tasks using disk backup copies not affected

Designed to speed recovery from damaged data

Create disk backup copies

source

target

target

Later …

2. Reverse

FlashCopy

operation

OR

1. Preserve

damaged data

target

Backup to tape

can continue

unaffected

target

source

source


SAN Volume

Controller

SAN Volume

Controller

SAN Volume

Controller

SAN Volume

Controller

12:00

13:00

14:00

15:00

:

×256

Instant recovery. All

other flashcopies

stay intact

Virus

t0

Reverse FlashCopy (contd.)

http://images.google.com/imgres?imgurl=http://www.istockphoto.com/file_thumbview_approve/6873725/2/istockphoto_6873725-swine-flu-virus.jpg&imgrefurl=http://www.istockphoto.com/stock-illustration-6873725-swine-flu-virus.php&usg=__agOTDiAODKEDaAfB2YWZ22OQ8is=&h=359&w=380&sz=48&hl=en&start=26&tbnid=DyW4ci4ahL0c8M:&tbnh=116&tbnw=123&prev=/images%3Fq%3Dvirus%26imgsz%3Dm%26imgtbs%3Dtz%26imgtype%3Dclipart%26ndsp%3D20%26hl%3Den%26rls%3DEGLA,EGLA:2007-30,EGLA:en%26sa%3DN%26start%3D20

http://images.google.com/imgres?imgurl=http://www.istockphoto.com/file_thumbview_approve/6873725/2/istockphoto_6873725-swine-flu-virus.jpg&imgrefurl=http://www.istockphoto.com/stock-illustration-6873725-swine-flu-virus.php&usg=__agOTDiAODKEDaAfB2YWZ22OQ8is=&h=359&w=380&sz=48&hl=en&start=26&tbnid=DyW4ci4ahL0c8M:&tbnh=116&tbnw=123&prev=/images%3Fq%3Dvirus%26imgsz%3Dm%26imgtbs%3Dtz%26imgtype%3Dclipart%26ndsp%3D20%26hl%3Den%26rls%3DEGLA,EGLA:2007-30,EGLA:en%26sa%3DN%26start%3D20


Combination of using SEV and FlashCopy together

Helps dramatically reduce disk space when making copies

Two variations

– Space-efficient source and target with background copy

Copies only allocated space

– Space-efficient target with no background copy

Space used only for changes between source and target

Generally what people mean when they talk of “snapshots”

Space-efficient copies may be updated just like normal FlashCopy copies

SEFC may be used with multi-target, cascaded, and incremental FlashCopy

– Can intermix space-efficient and fully-allocated virtual disks as desired

Space-Efficient FlashCopy (SEFC)

© 2011 IBM CorporationIBM System Storage SAN Volume Controller42 IBM System Storage SAN Volume Controller42

Tivoli Storage FlashCopy Manager

IBM Tivoli Storage FlashCopy Manager provides replication integration between major server software and IBM disk systems and virtualized storage environments

Comparable with NetApp SnapManager and SMBR– Operates with any storage supported by SVC

FlashCopy Create instant application copies for backup

or application testing

Many replication options including

incremental (only changed blocks) or

space-efficient copies (“snapshots”)

DS8000

FlashCopy Manager* Integrated, instant copy for critical

applications

Virtually eliminate backup windows

Rapidly create clones for application testing

View inventory of application copies and

instantly restore

XIV DS3/4/5 SVC

FlashCopy features differ between devices

* Planned availability 4Q09


Task Completion

Type of Data Protection

Activity

Historical Managed Capacity

Amount of Data Protection

Activity

FCM – Integrated as MMC InterfaceDashboard


Scheduled Backups

Schedule List

Output for

activity selected

above

Activity for

schedule

selected above

Scheduling

Wizard


SVC Metro Mirror Function “Metropolitan” distance synchronous remote mirroring function

Up to 300km between sites for business continuity

– As with any synchronous remote replication, performance requirements may limit usable distance

Host I/O completed only when data stored at both locations

Designed to maintain fully synchronized copies at both sites

– Once initial copy has completed

Metro and Global Mirror delivered as single feature

– Offers great implementation flexibility

Operates between SVC clusters at each site

– Local and remote volumes may be on any SVC supported disk systems

SVC Global Mirror Function Long distance asynchronous remote mirroring function

Up to 8000km distance between sites for business continuity

Does not wait for secondary I/O before completing host I/O

– Helps reduce performance impact to applications

Designed to maintain consistent secondary copy at all times

– Once initial copy has completed

Built on Metro Mirror code base

Metro and Global Mirror delivered as single feature

– Offers great implementation flexibility

Operates between SVC clusters at each site

– Local and remote volumes may be on any SVC supported disk systems


Remote Replication – SVC Multiple Cluster Mirror

Enables Metro and Global Mirror relationships between up to four SVC clusters

– Any virtual disk is in only one MM/GM relationship

One possible scenario: consolidated DR site

– Up to three locations supported by one DR site

– Other scenarios possible

Max MM/GM relationships increased to 8192

Designed to support more flexible DR strategies

Helps reduce cost of DR

MM or GM

RelationshipConsolidated

DR SiteMM or GM

Relationship

MM or GM

Relationship


SAN

Volume Controller

DS8000 – User Data

SVC

Cluster Quorum

Virtual Disk

Windows /

VMWare

Servers

no LVM






3rd SITE REMOTE




Virtual Disk

SVC Metro/Global Mirror

SVC 3 Site Solution

Thank You!

Alpay Özer

Veri Depolama Sistemleri Platform Lideri

IBM Türk

[email protected]

ibm sistemlerinizdeki bilgi patlamasını yönetmenin kolay yolu

Technology

virtual disk

management gui

remote volumes

8gb cache

initial copy

proven offering

frequent backups

000 read iops