iis datastage_8.0.ppt

7/25/2019 IIS DataStage_8.0.ppt

1/126

IBM information server

Whats New in Datastage 8.0?

1


2/126

Course Contents

Module 01 : Introduction

Module 02: Deployment

Module 03 : Administering DataStage

Module 04 : DataStage Designer

Module 05 : Repository unctions

Module 0! : DataStage "tilities

2


3/126

#$at%s &e' in DataStage ()*0+

Mod 01 : Introduction

3


4/126

Unit objectives

A,ter completing t$is unit-you s$ould .e a.le to:

Descri.e in,ormation ser/er

ist '$at%s t$e same in Datastage /ersion )

ist '$at%s t$e di,,erent in Datastage /ersion )

4


5/126

IBM information server

Suit of applications inclu!ing DataStage that "

S$ares a common repository D2- .y de,ault

S$ares a common set o, application ser/ices and ,unctionality

ro/ided .y Metadata ser/er components $osted .y an application

ser/er

IM #e.sp$ere Application ser/er

#rovi!e! services inclu!e!"

Security

Repository

ogging and reporting Metadata management

Manage! using we$ console clients

Administration console

Reporting console

5


6/126

IBM Information Server


7/126

Information Server Backbone

#e.Sp$ere #e.Sp$ere #e.Sp$ere #e.Sp$ere #e.Sp$ere #e.Sp$ere

In,ormationser/icedirector

usinesslossary

In,ormationAnaly6er

DataStage 7ualityStage

ederationSer/er

Metadata AccessSer/ices

Metadata AnalysisSer/ices

Metadata Ser/er

In,ormation Ser/er8onsole


8/126

#$at%s Di,,erent+

)


9/126

Whats the Same

DataStage Designer an! Director wor% ver& much the same

#$at you could do .e,ore you can still do

Minor c$anges to menus and "I

Same 'o$ t&pes are supporte!

arallel 9o.s

Ser/er 9o.s

Main,rame 9o.s

o. se;uences (ll stages that e)iste! in DataStage *.+) are still supporte!

#revious Datastage functionalit& is still supporte!

ds=?

&o' occurs in designer

Import Meta!ata

Se;uential ,iles

Data.ase

8@@ ,ile de,initions

o. compile- e=ecution -runtime log are t$e same


10/126

Whats Dierent Part I

;ualityStage is no' em.eded 'it$in a DataStage designer

DataStage 7uality stage>a*B*a DataStage? are no' $osted .y

Metadata ser/er

C$ere is a layer o, administrtion -logging- reporting- security t$at

occurs at Metadata ser/er le/el>outside o, DataStage?

Managed .y t$e administration and reporting console

Repository is no' managed .y t$e Metadata ser/er and its ser/ices

&o longer a uni/erse data.ase

Repository model $as .een completely recogni6ed

Installation and deployment are no' more ,le=i.le >comple=?

More deployment option

Metadata ser/er- repository- DataStage engines can .e on di,,erent

mec$ines and plat,orms

10


11/126

Whats new or dierent Part II

DataStage manager is gone

All manager ,unctionality $as .een mo/ed into Designer

DataStage

ermissions are implemented di,,erently

"I : ne' icons- menu arrangements- etc*

&e' stages

slo'ly c$anging dimensions >S8D? stage

Surrogate Bey management

8onnector stages

Stage en$ancements

ooBup stage no' supports range looBups

8omple= ,lat ,ile>8? stage no' supports multiple record ,ormat

S7 .uilders accessi.le in connector stages

11


12/126

Whats !ew or Dierent Part III

DataStage repositor& enhancements

le=i.le ,older organi6ation Repository searc$


13/126

Information Server "dministrationconso#e

13


14/126

Datasta$e "dministrator

14


15/126

DataSta$e Desi$ner

15


16/126

DataSta$e Director

1!


17/126

Unit Summar%

,aving complete! this unit &oushoul! $e a$le to"

Descri.e in,ormation serer

ist '$at%s t$e same in DataStage (ersion ) ist '$at%s t$e di,,erent in DataStage (ersion )

1


18/1261)

#$at%s &e' In DataStage () + Mod 02: Deployment


19/126

Unit objectives

(fter completing this unit &oushoul! $e a$le to"

Identi,y t$e components o, in,ormation ser/er

t$at need to .e installed Descri.e '$at a deployment domain consists o,

Descri.e di,,erent domain deployment option

Descri.e t$e installation process

Start t$e in,ormation ser/er

1


20/126

What &ets De'#o%ed

An in,ormation ser/er domain- consisting o, t$e ,ollo'ing:

Metadata ser/er- $osted .y an IM #e.sp$ere Application ser/er instance

-ne or more DataStage servers

DataStage ser/er includes .ot$ t$e parallel and ser/er engines

-ne DB /DB instance containing the repositor& !ata$ase

Information server clients

administration console

reporting console Datastage clients

administrator

Designer

Director

(!!itional information server applications

in,ormation analy6er

usiness glossary

Rotational data arc$itect

In,ormation ser/ices Director

ederation Ser/er

20


21/126

21

De'#o%ment ( )ver%thin$ on onemachine

ere 'e $a/e a single domain#it$ t$e $osted applications all onone mac$ine

Additional client 'orBstations8an connect to t$is mac$ine

using C8EI

8lientsD2 Instance #it$repository

Metadata Ser/er

acB.one

8lients

DataStage Ser/er


22/126

De'#o%ment ( DataSta$e onse'arate machine

22

ere t$e domain is splitet'een t'o mac$ines

Datastage ser/er Metadata ser/er and D2

repository

Metadata Ser/er acB.one

D2 instance

#it$ repository

Datastage Ser/er

8lients


23/126

Metadata server and DB* onse'arate machines

23

ere t$e domain is split

.et'een t$reemac$inesDatastage ser/erMetaData Ser/er D2 repository

DataStage ser/erD2 Instances#it$ repository

8lients

Metadata Ser/eracB.one


24/126

24

In,ormation Ser/er Installation


25/126

Insta##ation con+$uration #a%er

8on,iguration layers include:

1I2N3 Datastage and in,ormation ser/er clients

2ngine

Datastage and ot$er application engines

Domain

Metadata ser/er and $osted metadata ser/er components

Installed products domain components

4epositor&

Repository data.ase ser/er and data.ase

5 Documentation

Selected layers are installed on t$e mac$ine local to t$e installation

Already e=isting components can .e con,igured and used


26/126

Information server Start,u'

Start t$e Metadata Ser/er

rom 'indo's start menu- clicB FStart t$e ser/erG a,ter t$e pro,ile to .e used>e*g* de,ault?

rom t$e command line- open t$e pro,ile .in directory


27/126

Startin$ the Metadata ServerBackbone

2


28/126

Startin$ the "SB "$ent

2)


29/126

-estin$ the Insta##ation

ou can partially test t$e installation .y logging on to t$e in,ormation

ser/er #e. 8onsole

2


30/126

Check'oint

1* #$at application components maBe up a domain +

2* 8an a domain contain multiple Datastage ser/ers +

3* Does t$e D2 instance and t$e repository data.ase

need to .e on t$e same mac$ine as t$e application

ser/er +

4* Suppose Datastage is on t$e separate mac$ine ,rom

t$e Application ser/er* #$at t'o components need to

.e running .e,ore you log onto DataStage +

30


31/126

Check 'oint so#utions

1* Metadata ser/er $osted .y t$e application ser/er* @ne or more

DataStage ser/ers* @ne D2E"D instance containing t$e suitrepository data.ase

2* es* C$e DataStage ser/ers must .e on separate mac$ines* C$ey

can .e on di,,erent plat,orms e*g* one ser/er running on #indo's

and anot$er running on inu=

3* &o* t$e D2 instance 'it$ t$e repository can reside on a separatemac$ineE plat,orm t$an t$e Application ser/er*

4* C$e Application ser/er and t$e AS agent

31


32/126

Unit Summar%

a/ing completed t$is unit- you s$ould .e a.le to :

Identi,y t$e components o, in,ormation ser/er t$at need to

.e installed

Descri.e '$at a Deployment domain consist o,

Descri.e di,,erent domain deployment options

Descri.e t$e installation process

Start t$e in,ormation ser/er

32


33/126

33

Whats New in DataStage 68 ?

Module 03: AdministeringDataStage


34/126

Unit objectives

A,ter completing t$is unit- you s$ould .e a.le to:

@pen t$e administrati/e console

8reate ne' user and groups

Assign suite roles and product roles to users and groups

i/e user DataStage credentials

og on to DataStage Administrator Add a DataStage administrator

Add a DataStage user on t$e permissions ta. and speci,y t$e user%s

role

34

Information server administrator


35/126

Information server administratorconso#e

#e. application ,or administering in,ormation

ser/er

"sed ,or :

Domain management

Session management

Management o, users and groups

ogging management

Sc$eduling management

35

.'enin$ the "dministrator Web


36/126

.'enin$ the "dministrator WebConso#e

3!


37/126

3

"sers and roup Management

U d M


38/126

User and $rou' Mana$ement

Suite aut$ori6ation can .e pro/ided to users or group

users t$at are mem.ers o, t$e group ac;uire t$e aut$ori6ation o, t$e group

Aut$ori6ations are pro/ided in t$e ,orm o, roles C'o types o, roles

Suit roles"Apply to t$e suite

Suite components roles "Apply to a speci,ic product or components o, in,ormation ser/er- e*g*

DataStage*

Suite roles

(!ministrator

er,orm user and group management tasBs

Includes all t$e pri/ileges o, t$e Suite user role

/ser

8reate /ie's o, sc$eduled tasBs and logged messages

8reate and run reports

Suite components roles

DataStage user

ermissions are assigned 'it$in DataStage

H De/eloper- @perator- Super @perator- roductions Manager

DataStage a!ministrator

ull permission to 'orB in DataStage Administrator- Designer and Director

And so on ,or all products in suite

3)

C ti D t St ID


39/126

Creatin$ a DataSta$e user ID

3

" i i D t St / #


40/126

"ssi$nin$ DataSta$e /o#es

40

D t St C d ti # M i


41/126

DataSta$e Credentia# Ma''in$

"sers gi/en DataStage Administrator or DataStage user

product roles in t$e suite administrator console do notautomatically recei/e DataStage credentials

"sers 'it$ DataStage Administrator roles need to .e

mapped to a /alid user on t$e DataStage ser/er

mac$ine C$is DataStage users must $a/e ,ile access permission to

t$e DataStage engineEro9ect ,iles or Administrator rig$ts

on t$e operating system

"sers 'it$ DataStage user roles need to .e mapped to a/alid user on t$e DataStage ser/er mac$ine and need

additional DataStage assigned permissions >de/eloper

or operatorJ?

41

D t St d ti # i


42/126

DataSta$e credentia# ma''in$

42


43/126

43

DataStage Administrator

0 i t "d i i t t


44/126

0o$$in$ on to "dministrator

44

ost name-port num.er o,application ser/er

DataStageadministrator ID andass'ord

&ame or I address o,DataStage ser/ermac$ine

Permission -ab


45/126

Permission -ab

45

"ddin$ users and &rou's


46/126

"ddin$ users and &rou's

4!

S'ecif% DataSta$e /o#e


47/126

S'ecif% DataSta$e /o#e

4

Check 'oint


48/126

Check 'oint

1*Aut$ori6ation can .e assigned to '$at t'o

items+

2*#$at t'o types o, aut$ori6ation roles can .e

assigned to a user or group+

4)



49/126


1*"sers and groups* Mem.er o, a group ac;uire

t$e aut$ori6ation o, t$e group*

2*Suite roles and product roles*

4

Unit Summar%


50/126

Unit Summar%


@pen t$e administrati/e console

8reate ne' user and groups

Assign suite roles and product roles to users and groups

i/e user DataStage credentials og on to DataStage Administrator

Add a DataStage administrator

Add a DataStage user on t$e permissions ta. and

speci,y t$e user%s role

50


51/126

51

#$at%s &e' in DataStage ()+

Mod 04: DataStage Designer

Unit .bjectives


52/126

Unit .bjectives

A,ter completing t$is unit- you s$ould .e a.le to .e a.le:

og on to DataStage

&a/igate around DataStage designer

8reate a parameter Set

uild a range looBup 9o.

Import and e=port DataStage o.9ects to a ,ile

52

Whats new in DataSta$e desi$ner


53/126

What s new in DataSta$e desi$ner

Some c$anges to logging on

Manager ,unctionality no' in Designer

Manager is one

7uality stage ,unctionality no' em.edded in DataStage

&e' data ;uality ,older palette 'it$ $al,do6en ne' stages

"I

&e' tool .ar icon

Menu organi6ation c$anges

Repository en$ancements

le=i.le ,older organi6ation

Repository searc$

ds=?

Impact analysis

o. and ta.le de,inition di,,erences

arameter sets

Data connection @.9ects &e' Stages

S8D stage

8onnector Stage


54/126

0o$$in$ on to DataSta$e Desi$ner

54

Desi$ner Work "rea


55/126

Desi$ner Work "rea

55


56/126

5!

arameter Sets

Parameter Sets


57/126

Parameter Sets

Store a collection o, parameters in a named o.9ect

@ne more /alues ,ile can .e named and speci,ied A /alue ,ile stores /alues ,or speci,ied parameters

/alues are picBed up at runtime

arameter sets can .e added to t$e 9o. parameters speci,ied on t$e

parameters ta. in t$e 9o. properties

5

Creatin$ a new 'arameter set


58/126

Creatin$ a new 'arameter set

5)

Parameters -ab


59/126

Parameters -ab

5

1a#ues -ab


60/126

1a#ues -ab

!0

"ddin$ a 'arameter set to job


61/126

$ ' j'ro'erties

!1

Usin$ 'arameter Set 'arameters


62/126

Usin$ 'arameter Set 'arameters

!2


63/126

!3

Designing a Range ooBup o.

/an$e #ooku' 2ob


64/126

/an$e #ooku' 2ob

!4

/an$e on /eference 0ink


65/126

/an$e on /eference 0ink

!5

Se#ectin$ the Stream Co#umn


66/126

Se#ectin$ the Stream Co#umn

!!

/an$e )3'ression )ditor


67/126


!

/an$e on Stream 0ink


68/126

a $e o S ea

!)

S'ecif%in$ the /an$e 0ooku'


69/126

' % $ $ '

!



70/126

$ '

0


71/126

1

Importing and


72/126

' %

2

)3'ort Window


73/126

'

3

Im'ort .'tions


74/126

' '

4

Check'oint


75/126

'

C$e directory to '$ic$ you e=port is on t$e DataStage client

mac$ine- not on t$e DataStage Ser/er mac$ine*

5

Check'oint So#ution


76/126

'

1*Crue

!

Unit Summar%


77/126

a/ing completed t$is unit- you s$ould .e a.le to:

og on to DataStage

&a/igate around DataStage Designer

8reate a arameter Set

uild a Range ooBup 9o.

Import and


78/126

)

#$at%s &e' in DataStage () +

Mod 05 : Repository unctions

Unit .bjectives


79/126

A,ter completing t$is "nit- you s$ould .e a.le to:

er,orm a simple ind

er,orm an impact analysis

8ompare t$e di,,erence .et'een t'o ta.le

de,initions 8ompare t$e di,,erences .et'een t'o 9o.s


80/126

)0

Searc$ing t$e Repository

4uick 5ind


81/126

)1

5ound /esu#ts


82/126

)2

"dvanced 5ind Window


83/126

)3

"dvanced 5ind 5i#terin$ .'tions


84/126

Cype : type o, o.9ect

9o.- ta.le de,inition etc* 8reation : range o, dates


85/126

)5


86/126

)!

Impact Analysis

Performin$ an Im'ort ana#%sis


87/126

ind '$ere ta.le de,initions are used

Rig$t clicB o/er a stage or ta.le de,inition select F ind '$ere t$e ta.le de,inition "sedG or

select F ind '$ere t$e ta.le de,inition "sed>deep?G

Deep includes additional @.9ect types

Displays t$e list o, t$e o.9ects using t$e ta.le de,inition

ind o.9ect dependencies Select Find dependencies F or

Select Find dependencies >deep?F

Displays list o, @.9ect dependent on t$e one selected

rap$ical unctionality

Displays Dependencies at$ 8ollapse selected @.9ects

Mo/e t$e grap$ical @.9ect

FirdeyeG /ie'

)

Initiatin$ an im'act ana#%sis froma sta$e


88/126

a sta$e

))

Dis'#a%in$ the De'endencies&ra'hica##%


89/126

&ra'hica##%

)

Dis'#a%in$ the de'endenc% Path


90/126

0

&eneratin$ an 6-M0 /e'ort


91/126

1


92/126

2

o. and Ca.le di,,erence

Reports

5indin$ the Dierence Between-wo 2obs


93/126

-wo 2obs


94/126

4

Com'arison /esu#ts


95/126

5

Savin$ to an 6-M0 5i#e


96/126

!

Com'arin$ -ab#e De+nitions


97/126

Same procedure as '$en comparing 9o.s

Check'oint


98/126

1* ou can compare t$e di,,erence .et'een '$at t'o Binds

o, o.9ects+2* #$at F#ild 8ardG c$aracters can .e used in a ind+

3* ou $a/e a 9o. '$ose name .egins 'it$ Fa.cG* ou can%t

remem.er t$e rest o, t$e name or '$ere t$e 9o. is

located '$at 'ould .e t$e ,astest 'ay to e=port t$e 9o.to a ,ile +

4* &ame t$ree ilters you can use in a Ad/ance ind +

)

Check'oint So#utions


99/126

1* o.s* Ca.le de,inition

2*AsterisB>K?* It stands ,or any 6ero or more c$aracters*3* Do a ind ,or o.9ects matc$ing Fa.cG* ilter .y type 9o.*

ocate t$e 9o. in t$e result set* 8licB t$e rig$t mouse

.utton o/er it- and t$en clicB F


100/126

a/ing completed t$is "nit- you s$ould .e a.le to :

er,orm a simple ,ind

er,orm an Ad/ance ind

er,orm an impact analysis

8ompare t$e di,,erences .et'een t'o ta.lede,initions

8ompare t$e di,,erences .et'een t'o 9o.s

100


101/126

101

#$at%s &e' in DataStage ( )+

Module 0!: DataStage "tilities

Unit .bjectives


102/126

A,ter completing t$is unit- you s$ould .e a.le to :

Analy6e t$e per,ormance o, a 9o.


103/126

Sue t$e Director Monitor to 'atc$ t$e t$roug$put>ro'sEsec? during a

9o. run

8ompare 9o. run durations

Curn an ACLMLA


104/126

(isuali6ation tool t$at pro/ides deeper insig$t in to 9o. run time .e$a/ior

@,,ers se/eral categories o, /isuali6ations:

Record C$roug$put>ro'sEsec?

8" utili6ation

o. Ciming

o. memory utili6ation

$ysical mac$ine utili6ation er,ormance data to .e /isuali6ed can .e :

iltered in selected 'ays- including

ide startup processes

ide license operators

ide inserted operators Isolated to selected stages >operators ? - partitions- and p$ases

8$arts can .e sa/ed and printed

104

)nab#in$ Performance Data/ecrdin$


105/126

/ecrdin$

@pen t$e 9o. in designer

Select record 9o.per,ormance Data in o.

properties

Run your o.

per,ormance collection

$as little impact on o/erall9o. per,ormance

Co /ie' t$e results- clicB

t$e per,ormance analysis

icon in Designer

105

)3am'#e 2ob


106/126

10!

2ob -ime#ine Chart


107/126

10

)3'andin$ the 2ob -ime#ine Chart


108/126

10)

"nother 2ob -ime#ine Chart


109/126

10

/ecord -hrou$h'ut Chart


110/126

110

Dis'#a%in$ Se#ected Sta$es


111/126

111

CPU Uti#i7ation -ota#s Chart


112/126

112

Machine Uti#i7ation , CPU


113/126

113

5i#ters


114/126

114


115/126

115

Resource


116/126

Co start :

open o.

8licB t$e Resource


117/126

11

/esource )stimation Window


118/126

11)

Mode# -ab


119/126

11

Mode# )stimates b% Sta$e


120/126

120

Com'arin$ Mode# )stimates


121/126

121

Projection -ab


122/126

122

Projection )stimates


123/126

123

Check'oint


124/126

1* #$at are t$e ,i/e types o, /isuali6ation t$at can .e

created .y t$e er,ormance Analy6er +

2* o' do you ena.le t$e collection o, per,ormance data+

3* Descri.e t$e t'o types o, models t$at can .e generated

.y t$e Resource


125/126

1* Record C$roug$put>ro'sEsec?*8" utili6ation* o.

timing* o. memory utili6ation2* 8licB on t$e


126/126


Analy6e t$e per,ormance o, a 9o.

iis datastage_8.0.ppt

Documents