conceitos de capacity planning e sysplex por fernando ferreira

© 2009 IBM Corporation

CMG 2014Fernando Ferreira IBM ATS System z - zChampion – IBM Academy

15 Maio 2014

Conceitos e desafios dePlanejamento de capacidade em ambiente Parallel Sysplex

©201

3 I

BM

Corp

ora

tion

CMG 2014

Index

• Introdução

• z/OS

• Coupling Facility

• Conectividade

• Referencias

2

©201

3 I

BM

Corp

ora

tion

CMG 2014

Introdução

3

©201

3 I

BM

Corp

ora

tion

CMG 2014

Fatores de Performance

4

CF

CEC

� Velocidade de processador

� Tipo de request (sinc/assinc)

� Conectividade (CHPID,Subcanal )

Coupling facility

� Velocidade de processador

� Configuraçào (ded/shared)

� Carga

� Memória

Link

� Tipo deCF link

� Banda

� PATH Busy

Miscelaneous

� Duplexing

� Estruturas

� Distancia

©201

3 I

BM

Corp

ora

tion

CMG 2014

Coupling Facility

5

CF

Componentes

� Quantidade de CFs

� Tipo/Modelo CEC

� Numero/tipo de processadores

� Configuração (ded/shared)

� Memória

� Canais

� FlashExpress

� CBU

Fatores

� Numero de requests

� Tipos de estrutura

� Tipo de workload

� Configuração do CEC (CF)

� Nivel CFCC

� Configuração do CEC (z/OS)

� Topologia

� Duplexing

� Necessidade de recursos “spare”

©201

3 I

BM

Corp

ora

tion

CMG 2014

z/OS CEC

6

CF

Distancia

Componentes

� Capacidade

� Numero/tipo de processadores

� Memória

� Canais

Fatores

� Numero de requests

� Tipos de estrutura

� Tipo de workload

� Performance CF

� Distancia

� Topologia

� Tipo de lInks

� Duplexing

©201

3 I

BM

Corp

ora

tion

CMG 2014

Coupling Facility

7

©201

3 I

BM

Corp

ora

tion

CMG 2014

Topologia

CF 1CF 2

Sys B

Site ASite B

Sys 2

5k m

0k m

Sys 1

CF 3

©201

3 I

BM

Corp

ora

tion

CMG 2014

CF Duplexing

9

CF 1CF 2

Sys B

Site ASite B

Sys A

5k m

0k m

©201

3 I

BM

Corp

ora

tion

CMG 2014

Configuracão

©201

3 I

BM

Corp

ora

tion

CMG 2014

Arquitetura

©201

3 I

BM

Corp

ora

tion

CMG 2014

z/OS

12

©201

3 I

BM

Corp

ora

tion

CMG 2014

CPU x Service Time

0

5

10

15

20

25

30

35

40

45

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39

Service Time

CP

U T

ime

Async

Sync

Sincrono x Assincrono - z/OS Heuristic Algoritm

13

Note 1 ; Escale used is only a comparison example

+10µ +33µX +21µX +??µ

©201

3 I

BM

Corp

ora

tion

CMG 2014

Sincrono x Assincrono – Nova opção (SYNCASYNC)

14

� z/OS V2.1, V1.13, V1.12

PARMLIB COPLEXX

SYNCASYNC SIMPLEX(DEFAULT) DUPLEX(32)

SYNCASYNC LOCKSIMPLEX (DEFAULT) LOCKDUPLEX(38)

or

SETXCF MODIFY,SYNCASYNC,LOCKSIMPLEX=38

CPU x Service Time - Sync/Async Threshold

0

10

20

30

40

50

60

70

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

Service Time

CP

U T

ime

Async

Sync

CPU x Service Time - Sync/Async Threshold

0

10

20

30

40

50

60

70

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

Service Time

CP

U T

ime Async

Sync

Threshold

D XCF,C

IXC357I 10.26.53 DISPLAY XCF 470

SYSTEM FERNAFE DATA

INTERVAL OPNOTIFY MAXMSG CLEANUP RETRY CLASSLEN

370 200 1000 10 10 835

SSUM ACTION SSUM INTERVAL SSUM LIMIT WEIGHT MEMSTALLTIME

ISOLATE 0 500 70 300

CFSTRHANGTIME

900

...

SYNC/ASYNC CONVERSION THRESHOLD -SOURCE- DEFAULT

SIMPLEX 26 PARMLIB IN USE

DUPLEX 30 PARMLIB 26

LOCK SIMPLEX 38 SETXCF IN USE

LOCK DUPLEX 26 SYSTEM IN USE

©201

3 I

BM

Corp

ora

tion

CMG 2014

Sincrono x Assincrono - RMF

STRUCTURE NAME = FNFLOCK TYPE = LOCK STATUS = ACTIVE

# REQ -------------- REQUESTS ------------- -------------- DELAYED REQUESTS -------------

SYSTEM TOTAL # % OF -SERV TIME(MIC)- REASON # % OF ---- AVG TIME(MIC) ----- EXTERNAL REQUEST

NAME AVG/SEC REQ ALL AVG STD_DEV REQ REQ /DEL STD_DEV /ALL CONTENTIONS

------------------------------------------------------------------------------------------------------------------------------

TOTAL 900M SYNC 5500K 100 5.0 5.0 NO SCH 250K 0.0 333.9 73.4 0.0 REQ TOTAL 43M

11349 ASYNC 0 0.0 85.0 11.2 PR WT 0 0.0 0.0 0.0 0.0 REQ DEFERRED 90K

CHNGD 250K 0.0 PR CMP 0 0.0 0.0 0.0 0.0 -CONT 90K

-FALSE CONT 39K

15

STRUCTURE NAME = FNFLOCK TYPE = LOCK STATUS = ACTIVE

# REQ -------------- REQUESTS ------------- -------------- DELAYED REQUESTS -------------

SYSTEM TOTAL # % OF -SERV TIME(MIC)- REASON # % OF ---- AVG TIME(MIC) ----- EXTERNAL REQUEST

NAME AVG/SEC REQ ALL AVG STD_DEV REQ REQ /DEL STD_DEV /ALL CONTENTIONS

------------------------------------------------------------------------------------------------------------------------------

TOTAL 900M SYNC 5500K 100 15.0 15.0 NO SCH 250K 0.0 333.9 73.4 0.0 REQ TOTAL 43M

11349 ASYNC 0 0.0 85.0 11.2 PR WT 0 0.0 0.0 0.0 0.0 REQ DEFERRED 90K

CHNGD 250K 0.0 PR CMP 0 0.0 0.0 0.0 0.0 -CONT 90K

-FALSE CONT 39K

Overhead (rough) = (Num Req * # service time / Interval RMF) * MIPS GCP (individual)

©201

3 I

BM

Corp

ora

tion

CMG 2014

16

12x InfiniBand

HCA2-O**

HCA2-C

I/O Drawer

ISC-3

ISC-3

ISC-3

ISC-3

zEC12, zBC12, z196, z114, z10

EC, z10 BC

IFB-MP

zBC12

ISC-3**

HCA2-O LR**

Up to 150 meters

Up to 10/100 km

.... ....

1x InfiniBand

Up to 10/100KM

Fanouts

HCA3-O* HCA3-O LR*

.... ....

12x InfiniBand

Up to 150 meters1x InfiniBand

Up to 10/100KM

* Not supported on z10**Carry forward only on zEC12/zBC12

zBC12/zEC12 Coupling Links

� Fanout, not I/O slot, used for

InfiniBand

� ICB-4 – No longer supported

� ETR – No longer supported

� All coupling links support STP

� Sysplex Coexistence – zEC12,

z196, z114, z10 EC and BC only

zEC12

©201

3 I

BM

Corp

ora

tion

CMG 2014

Type Throughput Distance Fanout Cabling

12x InfiniBand 6 GBps 150 metersHCA2-OHCA3-O

50µ MM (OM3) fiber

1x InfiniBand 5 or 2.5 Gbps 10 kmHCA2-O LR*HCA3-O LR

9µ SM fiber

InfiniBand coupling links

HCA3-O LR fanout for 1x InfiniBand coupling links

� CHPID type – CIB

– Four ports per feature

– Fiber optic cabling

– Link sharing between multiple Sysplexes

– Up to 10 km without repeaters, RPQ 8P2263 or 8P2340 is required for 20 km support

– Up to 100 km are also possible using Dense Wavelength Division Multiplexors (DWDMs), going over 100 km requires RPQ 8P2263 or 8P2340

– Supports connectivity to HCA2-O LR

– Link data rate server-to-server 5 Gbps

– Link data rate with DWDM; 2.5 or 5 Gbps

CHPID / Subchannel Options

– 7 subchannels per CHPID (default)

– Option to define 32 or 7 subchannels

– Default changed from 32 to 7 for zEC12

HCA3-O fanout for 12x InfiniBand coupling links

• CHPID type – CIB

– Two ports per feature

– Fiber optic cabling – 150 meters

– Supports connectivity to HCA2-O

– Link data rate of 6 GBps

Two protocols (IFB & IFB3)

1. 12x IFB = HCA3-O to HCA2-O

2. 12x IFB3 = HCA3-O to HCA3-O (see below)

• 12x IFB3 service times designed to be 40% faster than 12x IFB

12x IFB3 protocol activation requirements

– Maximum of four CHPIDs per HCA3-O port

• If more than four CHIPDs are defined per port, links will run at normal 12x IFB service times

• IFB3 protocol activated as long as 4 CHPIDs or less are

defined. No configuration settings required.

©201

3 I

BM

Corp

ora

tion

CMG 2014

Coupling Links Subchannel

� Best practice �� CFSU < 30%

( #Requests Sync x Service TimeSync) + (#Requests Sync x Service TimeSync) CFSU = --------------------------------------------------------------------------------------------------------------

#Subcanais

CF 1

Sys A

12x InfiniBand

10µ

CFSU = (0,1 * 10) / 7 � 14,3%

100k req/sCF 1

Sys A

10µ + 60µ (6 km)

CFSU = (0,1 * 70) / 7 � 100%

100k req/s

1x InfiniBand

CFSU = (0,1 * 70) / 32 � 21,9%

©201

3 I

BM

Corp

ora

tion

CMG 2014

Relatório RMF subcanais e PATH Busy

19

1 C O U P L I N G F A C I L I T Y A C T I V I T Y

PAGE 41

z/OS V1R12 SYSPLEX SYSPLEXF START 08/03/2014-13.00.00 INTERVAL 001.00.00

RPT VERSION V1R12 RMF END 08/03/2014-14.00.00 CYCLE 05.000 SECONDS

------------------------------------------------------------------------------------------------------------------------------

COUPLING FACILITY NAME = CF01

------------------------------------------------------------------------------------------------------------------------------

SUBCHANNEL ACTIVITY

------------------------------------------------------------------------------------------------------------------------------

# REQ ----------- REQUESTS ----------- ------------------ DELAYED REQUESTS --------------

SYSTEM TOTAL -- CF LINKS -- PTH # -SERVICE TIME(MIC)- # % OF ------ AVG TIME(MIC) ------

NAME AVG/SEC TYPE GEN USE BUSY REQ AVG STD_DEV REQ REQ /DEL STD_DEV /ALL

MVSA 3247K CIB 8 8 310K SYNC 2689K 12.6 2.2 LIST/CACHE 0 0.0 0.0 0.0 0.0

963.7 SUBCH 56 56 ASYNC 527803 175.8 1463 LOCK 0 0.0 0.0 0.0 0.0

CHANGED 0 INCLUDED IN ASYNC TOTAL 0 0.0

UNSUCC 0 0.0 0.0

MVSY 160030K CIB 6 6 30M SYNC 138591K 15.4 4.4 LIST/CACHE 0 0.0 0.0 0.0 0.0

46442 SUBCH 42 32 ASYNC 6462K 38.2 90.0 LOCK 0 0.0 0.0 0.0 0.0


UNSUCC 0 0.0 0.0

MVSW 8070K CIB 6 6 16M SYNC 5447K 11.6 2.4 LIST/CACHE 0 0.0 0.0 0.0 0.0

1848.6 SUBCH 42 12 ASYNC 1171K 78.0 1163 LOCK 0 0.0 0.0 0.0 0.0


UNSUCC 0 0.0 0.0

©201

3 I

BM

Corp

ora

tion

CMG 2014

CF Duplexing – System Managed

22

CF 1CF 2

Sys B

Site ASite B

Sys A

5k m

0k m

©201

3 I

BM

Corp

ora

tion

CMG 2014

CF Duplexing – User Managed

23

CF 1CF 2

Sys B

Site ASite B

Sys A

5k m

0k m

©201

3 I

BM

Corp

ora

tion

CMG 2014

References

• ITSO Redbooks

� http://www.redbooks.ibm.com/

– SG24-8047 zEnterprise End-to-End Extended Distance Connectivity Guide

– SG24-7263 Considerations for Multisite Sysplex Data Sharing

– SG24-7539 Implementing and Managing InfiniBand Coupling Links on System z

– SG24-8049 zEC12 IBM zEnterprise EC12 Technical Guide

– ITSO Workshops “Parallel Sysplex and High Availability” – Frank Kyne

• 2009, 2010, 2011, 2012, 2013

• Other manuals

– SA22-7625 MVS Setting Up a Sysplex

24

Atualizar referencias

conceitos de capacity planning e sysplex por fernando ferreira

Technology