120787345-informaticanotes.pdf

Upload: bhaskar-reddy

Post on 28-Feb-2018

219 views

Category:

Documents


0 download

TRANSCRIPT

  • 7/25/2019 120787345-Informaticanotes.pdf

    1/34

    Steps Involved in building an ETL process

    1. Create Source Definition

    2. Create Target Definition

    3. Design Mapping with or without Transformation Rule

    4. Create Session for each Mapping

    5. Create Worflow

    !. "#ecute Worflow

    Prerequisites:

    1. Creation of User ccounts

    Process

    1. Create $ser in %racle &'t can (e an) *ata(ase+

    a+ Start,rogram%racle-pplication DeelopmentS/0,0$S

    (+ 0ogin with

    $sername s)stem ,asswor* manager

    ost String %RC0

    S/0 CR"-T" $S"R -TC6 'D"7T'8'"D 9 target:

    S/0 ;R-7T D- T% -TC6:

    "M,

    D",T

    %7$S

    "mp

    $sername (atch6,asswor* target

    $sername scott,asswor tiger

    Target DSource D

  • 7/25/2019 120787345-Informaticanotes.pdf

    2/34

    S/0 C%77"CT -TC6

  • 7/25/2019 120787345-Informaticanotes.pdf

    3/34

  • 7/25/2019 120787345-Informaticanotes.pdf

    4/34

    Repositor) menuSae

    7ow )our Source Definition has (een create* an* sae* in repositor).

    Step !: Create Target $efinition

    Target Definition can (e create* using Target Designer Tool in the Designer clientComponent.

    Procedure

    1. Tool menuTarget Designer

    2. Source menu'mport from *ata(ase

    Connect to the *ata(ase with following *etails

    %DC *ata source

    $sername

    ,asswor*

    ClicConnect

    Select Ta(les%?

    Repositor) menuSae

    Step&: $esign a )apping *it"out Transfor)ation +ule

    - mapping without Transformation Rule calle* Simple ,ass Mapping.

    - Mapping is create* using mapping *esigner tool. "er) mapping is uniIuel) i*entifie*() name.

    Procedure

    1. Tools menuMapping Designer

    2. Mapping MenuCreate

    3. "nter the Mapping 7ame%?

    4. 8rom repositor) naigator pane *rag the source &"M,+ an* Target &Dim>"mp+ta(le *efinition: *rop on mapping *esigner wor space.

    5. 8rom Source>/ualifier &S/>"M,+ connect column to the correspon*ing columnsin the target ta(le *efinition () Lust *ragging. &9ou can also use auto connect+

    !. Repositor) menuSae

    ,ote: "er) source ta(le *efinition () *efault associates with source Iualifiertransformation.

  • 7/25/2019 120787345-Informaticanotes.pdf

    5/34

    The source Iualifier transformation prepares an S/0 statement which is use* fore#traction () integration serice.

  • 7/25/2019 120787345-Informaticanotes.pdf

    6/34

    Step ': Creation of Session

    Process

    1. %pen the client worflow manager

    2. ConnectRepositor)

    3. Select8ol*er&)our fol*er from Repositor) pane+Tool menuTas Deeloper

    4. Tas MenuCreate

    5. SelectTas t)pe session"nter the nameClicCreate

    !. SelectMapping%?

    6. Clic Done

    Creation of Source ConnectionF &This connection is reIuire* for e#traction an*loa*ing of actual *ata. "arlier connection %DC which )ou ma*e is onl) for e#tracting

    the structure of the ta(le.+Connection menuRelational

    8romlist%racle7ew"nter the Details

    7ameF-TC6,M>SRC

    $sernameF scott

    ,asswor*Ftiger

    Connect StringF%RC0

    Similarl) create target connection following the a(oe state* process.

    J. Dou(le ClicSession&S>simplepass+Mapping ta(

    H. 8rom left paneS/>"M,Set Connection with the alue which )ou haecreate* for the "#tractionE connection name

    1B. Repeat the processDim>emplo)eeSet Connection

    11. 8rom propertiesset Target loa* t)pe 7ormalE-ppl)%?

    12. Repositor)Sae

    Step -: Creation of or/flo*

    Process

    1. Tool menuWorflow Designer

    2. Worflow menuCreate

    3. "nter the Worflow name &W?8>simplepass+

  • 7/25/2019 120787345-Informaticanotes.pdf

    7/34

    4. 8rom repositor) 7aigator win*ow e#pan*Session su( fol*erDrag thesession@ *rop (esi*e the worflow

    5. 8rom Tas menu0in tasDrag the lin from worflow@ *rop on session

    !. Repositor) menuSae

    Step 0: Eecuting or/flo*

    Process

    1. Worflow menuStart Worflow

    7ow Start the Worflow Monitor to iew )our worflow status.

    There is an option in the 'nformatica ,owerCenter in which )ou can create the target*efinition manuall) to the Target Data(ase.

    Target $efinition 2anual pproac"

    Process

    1. Tools menuTarget Designer

    2. Target menuCreate

    3. "nter the Target Ta(le nameselect Data(ase t)pe &%racle+CreateDone

    4. Dou(le ClicTarget DefinitionColumn Ta( from tool(ar-** new column

    The column Structure will loo lie thisG

    Column name Data T)pe ,recision Scale 7ot 7ull ?e) T)pe

    D",T7% 7um(er&p@s+ 2 B ,rimar) e)

    D7-M" Aarchar2 1B B 7ot - e)

    S$MS-0 7um(er&p@s+ 6 2 7ot - e)

    5. Clic %Done

    !. Target menu;enerate

  • 7/25/2019 120787345-Informaticanotes.pdf

    8/34

    H. SelectCreate Ta(le;enerate

  • 7/25/2019 120787345-Informaticanotes.pdf

    9/34

    Transfor)ation

    1. 3(ilter4 +an/4 Epression5

    $($

    14 Rows 14 Rows 14 &'+ !&%+ !&'+ 3&%+ 3&'+ 3&%+

    usiness 0ogic Calculate the Ta# for top 3 emplo)ees of *epartment num(er 3B

    -ns 8irst we use the 8ilter transformation to filter the *ata of *epartment num(er 3Bonl)@ then Ran transformation to tae the top 3 emplo)ees from *epartment num(er 3Ban* at last "#pression transformation to calculate the Ta# for each emplo)ee.

    Procedure

    1. Create the Source Definition"mp

    2. Source -nal)KerCreate Target Definition"mp>ta#>cal

    3. Create Mapping7ame M>ta#>calDrop source target *efinition onto themapping *esigner worspace.

    4. Transformation MenuCreateSelect Transformation t)pe 8ilter"nter thenameCreate*one

    FF Repeat the same process to a** Ran "#pression Transformation.

    5. 8rom S/>"mpCop) the reIuire* ports to the filter transformation.

    !. Dou(le clic8ilter Transformation,roperties ta(Set

    8ilter Con*itionD",T N 3B

    6. Clic-ppl)%

    J. 8rom 8ilter Transformation cop) the port to a Ran Transformation.

    H. Dou(le clicRan Transformation,ort ta(Set

    8or a port name S-0Ran ,ort

    1B. Select,roperties Ta(Set

    Top"mp

  • 7/25/2019 120787345-Informaticanotes.pdf

    10/34

    Data T)peNDecimal

    ,recisionN6

    ScaleN2

    $nchec'nput ,ort &'+

    "#pressionS-0 B.15

    14. Clic -ppl)%

    15. 8rom "#pression Transformation connect the ports to the Target Definition.

    1!. Repeat the process of creation of worflow an* e#ecute the worflow.

    !. Sorter4 ggregator4 Loo/up

    $($Dept Ta(leFDeptnoFDeptnameF0ocation

    F"mp FSal FDeptno FDeptnoF"name FDeptno &?e)+ FSal &'+ FDname

    FSal FSumsal &%+ FSumsalFDeptno Fsum&Sal+

    usiness 0ogic Calculate the total Salar) ,ai* for each *epartment

    -ns Sorter transformation is use* for (etter performance of -ggregator transformation@an* grouping the *ata *epartment wise@ aggregator transformation aggregate the salar)&Sum+ *epartment wise. There is Dname port is in the target ta(le (ut Dname is not in the"mp ta(le so@ we use* the 0ooup Transformation to get the Dname from Departmentta(le. &"mp.*eptnoNDept.*eptno+

    Procedure

    1. Create the Source an* Target Definition

    2. Create the mapping with name M>0?,

    3. Drop the Source Target Definitions

    4. Create the Transformation t)pe Sorter an* -ggregator.

    5. 8rom S/>"M, cop) the port &Dept@ Sal+ to Sorter Transformation

    "mp S/>"M, Sorter T

  • 7/25/2019 120787345-Informaticanotes.pdf

    11/34

    !. Dou(le clicSelect ,ort ta(for port name Deptno chec@ e)chec(o#appl)o

    6. 8rom Sorter Transformation cop) ports to aggregator transformation

    J. Dou(le clic on aggregator transformationSelect port ta(for a port name

    *eptno

    chec group () chec(o#H. 8rom a port name S-0 unchec output port &%+

    1B. 8rom tool(ar a** new port

    ,ort name DataT)pe , S ' % A "#pression

    Sumsal *ecimal 6 2 sum&sal+

    11. Select the properties ta( select a sorte* inputclic appl)%?

    12. 8rom aggregator connects the port to the target *efinition.

    13. Transformation menuCreatelooup transformation7ame0?,>SRCCreate

    14. Select the ta( Sourceselect the source ta(le Dept *efinitiono15. 8rom aggregator transformation cop) the port Deptno to the looup

    transformation *ou(le clic on looup transformation

    1!. Select the con*ition ta( from a tool(ar clic on a** a new con*ition.

    0ooup ta(le column %perator Transformation ,ort

    Deptno N Deptno1

    16. Clicappl)%?

    1J. 8rom looup transformation connect the Dname port to the target.

    1H. ClicRepositor) menusae

    2B. Repeat the process of creation of session an* worflow an* run the worflow.

    ,ote: 6 0ooup Transformation supports (oth "IuiFOoin an* 7onF"IuiLoin.

    &. 7oiner Transfor)ation

    $($

    F"mpnoF"name

    FOo(FSalFDeptno

    FDeptnoFDnameF0ocation

    OoinerTransformation

    "mp

    "mp>Dept

    Dept

    F"mpnoF"nameFOo(FSalFDeptnoFDnameF0ocation

  • 7/25/2019 120787345-Informaticanotes.pdf

    12/34

    usiness 0ogic Merge the ta(le "mp an* Dept

    -ns $se Ooiner transformation cop) the ports from the (oth "mp an* Dept ta(le toLoiner transformation. Set the con*ition on the port which is aaila(le in (oth ta(les

    Lust lie eIuiFLoin &*eptno+.Procedure

    1. Create Source an* Target *efinition

    2. Create Mapping7ameM>D-T->O%'7

    3. Drop source an* Target Definition

    4. Create the transformation t)pe Loiner

    5. 8rom S/>"M, cop) the following ports to the Loiner transformation &"mpno@ename Lo(@ sal@ *eptno+

    !. 8rom S/>D",T cop) the following ports to Loiner transformation &Deptno@

    Dname@ 0ocation+6. Dou(le clic on Loiner transformationCon*ition ta(8rom tool(ar-** new

    con*ition

    Master %perator Detail

    Deptno1 N Deptno

    J. Clic appl)o

    H. 8rom Loiner transformation connect to the port to target *efinition.

    1B. Repeat the process for creating session worflow an* run the worflow

    +outer Transfor)ation

    +outer Transfor)ation

    'nputStateNRStateND0StateN?-

    Default

    usiness 0ogic Dii*e the "mp ta(le recor*s Department wise.

    -ns 8or this we will use Router Transformation (ecause this taes one input an*proi*es multiple outputs. Connect the target ta(le through the eer) *istinct *epartmentgroups of output port in the Router transformation.

    Procedure

    Sales Sales>S/

    State R

    State D0

    State ?-

    Default

  • 7/25/2019 120787345-Informaticanotes.pdf

    13/34

    1. Create Source an* Target Definition

    2. Create mapping with name M>Router

    3. Drag an* *rop the source an* target *efinition on to the mapping *esigner worspace.

    4. Create Router Transformation from transformation menu.5. Cop) all the port from Source /ualifier to Router transformation

    !. Dou(le clic Router Transformation;roup ta(-** new ;roup from tool(ar

    ;roup 7ame ;roup 8ilter Con*ition

    Dept 1B DeptnoN1B

    Dept 2B DeptnoN2B

    Dept 3B DeptnoN3B

    6. Clic -ppl)%

    J. Cop) ports from Dept 1B ;roup to "mp>*ept 1B Target. &Repeat the process forDept 2B an* Dept 3B group+

    H. Clic Repositor) menuSae

    1B. Repeat the process for creating session an* worflow an* run the worflow.

    Union Transfor)ation

    7ote -ll the sources shoul* hae the same structure.

    usiness 0ogic Merge two ta(le "mp an* "mplo)ees ta(le into one ta(le "mp>$nion

    -ns 8or this we will use $nion Transformation 't taes multiple inputs an* proi*es oneoutput. ut the arious sources shoul* hae the same structure. Connect the target ta(lethrough single output port of the $nion transformation.

    Procedure

    1. 'mport meta*ata of "mp an* "mplo)ees from source *ata(ase using Source-nal)Ker.

    "mp

    "mplo)ees

    S/>"mp

    "mplo)ees>S/

    %utput

    ;roup 2

    ;roup 1"mp>$nion

  • 7/25/2019 120787345-Informaticanotes.pdf

    14/34

    2. Create Target ta(le "mp>$nion

    3. Create a mapping with the name M>$nion

    4. Drag an* Drop the Source an* Target Definition on the mapping *esignerworspace.

    5. Create $nion Transformation with name "mp>$nion!. Dou(le Clic on $nion Transformation;roup ta(-** new group7ame the

    group "mp an* "mplo)ees

    6. ;roup port ta(-** new port

    7ame Datat)pe ,recision Scale

    "mpno *ecimal 2 B

    "name String 1B B

    Oo( String 1B B

    J. Cop) ports S/>"mp to "mp ;roupH. Cop) ports "mplo)ees>S/ to "mplo)ees group

    1B. Cop) the ports from output group to target &"mp>$nion+

    11. Repeat the ,rocess of creating Session an* worflow an* Run the worflow.

    Stored Procedure Transfor)ation

    Create the following store* proce*ure in the *ata(ase.

    Create proce*ure -nnual>ta#

    &Sal 'n 7um(er@

    Ta# %ut 7um(er+

    'S

    egin

    Ta# N SalB.15:

    "n*:

    usiness 0ogic Calculate the -nnual Salar) of the emplo)ee for the new column ta# inthe target ta(le.

    -ns 8or calculating the annual ta# this time we will use store* proce*ure transformation.ecause () this the oerhea*s of the 'ntegration serice will (e re*uce* an* theperformance will (e increase*.

    Procedure

    1. Create Source an* Target Definition

    2. Create the mapping with the name M>Store*,

  • 7/25/2019 120787345-Informaticanotes.pdf

    15/34

    3. Drop the source an* target *efinition on to the Mapping *esigner Worspace.

    4. Create the transformation t)pe store* proce*ure

    5. ;ie the %DC Connection to run the store* proce*ure accor*ing to itPs placemeans whether it is in Source *ata(ase or Target *ata(ase.

    'f the Store* proce*ure is in the target *ata(ase@ then nothing to configurea**itional settings otherwise *o the a**itional settings as follows

    !. Dou(le ClicStore* proce*ure,roperties Ta(Set the Connection'nformation-s per )our Relational connection name for source.

    6. While Configuring the mapping in the session for connection set the connectionfor transformation also-s per )our Relational Connection name for source.

    J. 8rom S/>"mp Connect the S-0 port to the store* proce*ure transformation.

    H. 8rom store* proce*ure connect the T-Q port to the target *efinition.

    1B. 8rom S/>"mp connect the remaining ports to target *efinition.

    11. Clic Repositor) menuSae

    12. Repeat the process for session Worflow an* Run the worflow.

    Source 8ualifier Transfor)ation

    'n this transformation we generall) *o the changing in the S/0 co*e of the Source/ualifier.

    usiness 0ogic 0oa* the *ata of emplo)ees in the target those (elongs to onl)*epartment num(er 2B an* 3B an* recor*s shoul* (e sorte* () their salar) in ascen*ing

    or*er.-ns "arlier we *i* this () the filter transformation (ut now we will *o this () sourceIualifier transformation. 't will certainl) increase the efficienc) of the 'ntegrationSerice.

    Procedure

    1. Create Source an* Target Definition

    2. Create Mapping with a name M>Source>filter

    3. Drop the source an* target *efinition on the mapping *esigner win*ow.

    4. 8rom S/>"mp connect the reIuire* port to the Target ta(le Lust lie simple pass.

    5. Dou(le clic S/>"mp,roperties ta(Set the alue for 7um(er of sorte*portsN1ESet the alue for sIl Iuer)E as S"0"CT "M,."M,7%@"M,."7-M"@ "M,.S-0@ "M,.D",T7%8R%M "M,W"R" D",T7% '7 &2B@ 3B+%RD"R 9 "M,.S-0clic ;enerate S/0Clic-ppl)%

  • 7/25/2019 120787345-Informaticanotes.pdf

    16/34

    ere )ou can also set properties for )ou Iuer) such as Distinct () chec thechec(o# of Distinct.

    ) *efault the or*er () clause will (e impose* on empno (ecause )ou ha* set aluefor num(er of sorte* port N1 the integration serice tae it seIuentiall) from empno if)ou woul* choose alue 2 then it will tae to port empno an* ename so )ou must *o

    changes in the S/0 Iuer) accor*ing to )our reIuirements.7ote 'f )ou will set the alue for sIl Iuer) without connecting to target port )ou will geterror message@ so connect to the target port from S/>"mp first.

    !. Repeat the process for creating session an* worflow an* Run the worflow.

    $ser Define Ooin in Source /ualifier Transformation

    $ser *efine* Loins possi(le in the source Iualifier onl) when the two sources are (elongsto same *ata(ase user account or schema.

    usiness 0ogic Ooin two ta(les "mp an* Dept to get the Department name an* 0ocation

    from Dept ta(le for each emplo)ee in the "mp ta(le.-ns 'nstea* of using Loiner transformation we will use $ser Define* Ooin option insource /ualifier (ecause (oth ta(le are in the same schema of scott. 't will certainl)increase the performance measure also.

    Procedure

    1. Create the source an* target *efinition

    2. Create a mapping with the name M>Source>Loin

    3. Drag an* Drop the source an* Target *efinition on to the mapping *esignerworspace.

    4. 8rom source Iualifier connects the port to the target *efinition.

    5. Dou(le clic on source Iualifier ,roperties Ta( Set the alue for $ser*efine* LoinE "mp.DeptnoNDept.Deptno

    !. Clic -ppl)%

    6. Repositor) menuSae

    J. Repeat the process for creating session an* worflow an* run the worflow.

    2applet

    - mapplet is reusa(le meta*ata o(Lect create* with (usiness logic using set oftransformation.

    Procedure

    1. Tool menuMapplet Designer

    2. Mapplet menuCreate;ie the name of the mapplet

  • 7/25/2019 120787345-Informaticanotes.pdf

    17/34

    3. Transformation menuCreateMapplet 'nput"nter the propernameCreateDone

    4. Transformation menuCreateMapplet 'nput"nter the propernameCreateDone

    5. Create the 8ilter Transformation an* "#pression Transformation.!. Dou(le ClicMapplet 'nput Transformation,ort ta(Create *esire*

    ports%

    8or "#ercise &"mpno@ "name@ Oo(@ Sal@ Deptno+

    6. 8rom Mapplet 'nput Cop) the port to 8ilter TransformationChange the *atat)pe@ precision@ Scale for the reIuire* portDefine filter con*itionDeptnoN2Bor DeptnoN3B

    J. 8rom 8ilter Transformation cop) the port to e#pression transformation.

    H. Create an output port with the name T-Q@ $nchec the input port chec(o# fromproperties *eelop the e#pression with the following s)nta#

    '88&S-02BBB@ S-015@ S-02B+

    1B. 8rom "#pression Transformation cop) the ports to mapplet output transformation.

    11. Repositor) menuSae

    $esign a 2apping *it" 2applet

    usiness logic Create a mapping for e#traction an* loa*ing the *ata from ta(le emp forthose emplo)ee whose (elongs to *epartment num(er 2B or 3B an* also calculate theirannual ta#.

    -ns We will use mapplet that we hae Lust create* in the a(oe e#ercise (ecause wehae alrea*) implemente* this (usiness logic into creating mapplet.

    Procedure

    1. Create Source an* Target Definition

    2. Create a mapping with name M>Mapplet

    3. Drop the source an* target *efinition onto the mapping *esigner worspace.

    4. 8rom mapplet su(fol*er *rag the mapplet *rop (esi*e the source Iualifier.

    5. 8rom S/>"mp connect the ports to mapplet input an* from mapplet outputconnect the ports to target *efinition.

    !. Repositor) menuSae

    6. Repeat the process for creating the worflow an* Run the worflow.

    Constraint %ased Load #rdering

  • 7/25/2019 120787345-Informaticanotes.pdf

    18/34

    - C0 is specifie* when )ou want to loa* the *ata into snowflae *imension@ which arehaing primar) an* foreign e) relationship.

    "#ercise $sing C0 loa* the *ata into *imension name* D",T an* "M, in which*eptno is primar) e) in the D",T ta(le an* 8oreign e) in the "M, ta(le.

    Procedure1. Create Source an* Target Definition

    2. Create Mapping with the name M>C0

    3. Drag an* Drop the source an* target *efinition on to the mapping woring space

    4. 8rom S/>"mp>*ept connect the port to the target *efinition.

    5. Create a session with name S>C0

    !. Dou(le clicSessionConfig o(Lect ta(Chec Constraint ase* 0oa* or*ering

    6. SelectMapping ta(Set the source an* each target connection relation

    t)peappl)%J. Repeat the process for creating worflow an* Run the worflow.

    Sc"eduling or/flo*

    - sche*ule specifies the *ata an* time to run the worflow.

    Procedure

    1. 8rom the worflow managerTool menuWorflow DesignerCreateWorflow

    2. Select sche*uler ta(Select Reusa(le Ra*io (uttonSet the alues for sche*uler8or Run %ption

    Run on 'ntegration serice 'nitialiKation

    Sche*ule optionSelect Run "er)*a)

    Select "n* %ption8oreer

    Set the start *ate an* time

    3. Clic -ppl)%

    4. Repeat the Rest of the process of creating worflow.

    or/ing *it" (lat files

    Procedure

    Step 1Creation of Source Definition

    i+ Tool menuSource -nal)KerSources menu'mport from file

  • 7/25/2019 120787345-Informaticanotes.pdf

    19/34

    ii+ rowse the location of flat fileSelect the file%

    iii+ 'n the popFup win*ow *o these settings

    a+ Select 8lat 8ile T)peDelimite*

    (+ Select &Chec+ 'mport fiel* name from the first lineClic7e#t

    c+ Select *elimiter t)pe7e#t

    *+ 'f reIuire* alter the *ata t)pe for source *efinition8inish

    i+ Repositor) menuSae

    Step 2Create the target *efinition in the target *ata(ase an* repeat the process fortarget *efinition

    Step 3Create Mapping;ie proper name8rom Source /ualifier connect theports to the target *efinition.

    Step 4Create a session;ie the proper name

    Step 5Dou(le clic sessionMapping ta(Select S/>Customer from leftpaneSet the attri(ute as follows

    -ttri(utes Aalues

    Source 8ile Director) D8latfiles

    Source 8ile 7ame Customer.t#t

    Source 8ile T)pe Direct

    Step !Set the target setting for loa*ing as usual with relational connection.

    Step 6

    Repeat the process for creating worflow an* run the worflow.

    Direct an* 'n*irect Communication of 'ntegration Serice with Source 8ile t)pe

    'ntegration Serice 'ntegration Serice

    Direct 'n*irect

    C8latfileCustomer.t#t 0ist of files,athD8ilesCust.t#t

    (ile ,a)e: Cust.tt

    C8latfilesCustomer.t#tDCustomerCust1.t#tDSalesCustomer.t#t

  • 7/25/2019 120787345-Informaticanotes.pdf

    20/34

  • 7/25/2019 120787345-Informaticanotes.pdf

    21/34

    or/ing *it" (ile List

    - 8ile list is a list of flat files with the same *ata *efinition@ which nee*s to (emerge* with source file t)pe as in*irect.

    7ote - file list wors onl) when the entire flat files haing the same *ata *efinition.

    Procedure

    1. The all processes are same e#cept )ou hae to set the session attri(ute alue forSource 8ile T)peE as 'n*irect.

    92L Source 8ualifier Transfor)ation

    We use QM0 Source /ualifier Transformation to rea* the *ata from QM0 files.

    "er) QM0 Source *efinition () *efault associates with QM0 Source /ualifierTransformation.

    Procedure1. Create source *efinition "mp.#ml

    2. Tool menuSource -nal)KerSource menu'mport #ml *efinition

    3. rowse the location for #ml fileselect file%pen%

    4. - win*ow will popFup for settingsClic7e#tSelect %ption

    i. ierarch) Relationship

    ii. DenormaliKe* #ml iews8insih

    5. Repositor) menuSae

    !. Create target *efinition"mp>#ml

    6. Create mapping with giing proper name.

    J. Drag an* Drop the source an* target *efinition to the mapping worspace.

    H. 8rom QM0>S/ connect the ports to the target *efinition.

    1B. Create SessionS>QM0

    11. Dou(le clic sessionMapping ta(from left pane select QM0 sourceIualifier'n properties section set the following attri(utes.

    Source 8ile Director)DQM0 8iles

    Source 8ile 7ame"mp.#ml

    Source 8ile T)peDirect12. Repeat the process for target relational connection@ an* creating worflow

    an* run the worflow.

    ,or)alier Transfor)ation

    7ormaliKer transformation functions lie a source Iualifier while rea*ing the *ata fromC%%0 sources.

  • 7/25/2019 120787345-Informaticanotes.pdf

    22/34

    $se normaliKer transformation to conert a single input recor* from source into multipleoutput *ata recor*s. &This process is nown as *ata pioting+

    Process

    1. Create Source an* Target *efinition

    2. Create a mapping with name

    M>,iot3. Drop the source an* target *efinition to the mapping woring space.

    4. Create transformation t)pe 7ormaliKer

    5. *ou(le clic7ormaliKer Transformation7ormaliKer ta(-** new column

    Column 7ame 0eel %ccurs Datat)pe , S

    9ear B B 7um(er 4 B

    -ccount B B String 1B B

    -mount B 3 7um(er 6 2

    !. Clic -ppl)%

    6. 8rom Source /ualifier connect the port to normaliKer transformationJ. 8rom 7ormaliKer transformation connect to target *efinition &;C'DMonth+

    H. Repositor) menusae

    1B. Repeat the process for session worflow an* run the worflow.

    ;CI$ ;enerate* Column 'D < ;lo(al Column 'D

    Transaction Control Transfor)ation

    T)pe of actie transformation which allow to control the transaction () set of commit an*roll(ac con*ition.

    usiness 0ogic Commit onl) those emplo)ees information whose (elongs to *epartmentnum(er 2B.

    -nsF $se Transaction control transformation an* gie the con*ition.

    '88&D",TN2B TC>C%MM'T>-8T"R@ TC>R%00-C?>-8T"R+

    Process

    1. Create Source an* Target *efinition

    2. Create the mapping with nameM>TCT

    3. Drag Drop the source an* target *efinition at mapping *esigner worspace.4. Create transformation t)peTransaction control

    5. Cop) ports from S/>"mp to Transaction Control Transformation

    !. Cop) the ports from Transaction Control Transformation to Target ta(le

    6. Dou(le ClicTransaction Control TransformationSelect Transaction ControlTransformation Con*ition;ie the con*ition

  • 7/25/2019 120787345-Informaticanotes.pdf

    23/34

    '88&D",TN2B TC>C%MM'T>-8T"R@ TC>R%00-C?>-8T"R+

    To select pre*efine* aria(leClic on aria(le (uilt in fol*er.

    Slo*l< C"anging $i)ension6tt)pe2+ &"mpe)@ "mpno@ "name@ Sal@ Aersion+

    3. Drag an* Drop the source an* target *efinition on mapping *esigner worspace.

    7ote Drop the Target Definition twice on the mapping *esigner worspace

    4. Create a looup transformation to perform a looup on target ta(le.

    5. 8rom S/>"mp cop) the port "mpno to the looup transformation an* mae itport t)pe input onl).

    !. Dou(le clic on the looup transformationSelect the con*ition ta(a** newcon*itionSet con*ition as follows

    0ooup ta(le con*ition %perator Transformation ,ort

    "mpno N "mpno1

    6. Select the properties ta(Set the following properties

    Transformation -ttri(ute Aalue

    0ooup polic) on multiple match $se last alue

    J. Create "#pression TransformationH. 8rom S/>"mp cop) &empno@ ename@ sal+ ports to e#pression transformation

    1B. 8rom looup transformation cop) &empe)@ sal1@ ersion+ ports to e#pressiontransformation

    11. Rename the ports which are copies from looup transformation for (etterun*erstan*ing as &TR;>"M,?"9@ TR;>S-0@ TR;>A"RS'%7+

    12. 'n e#pression transformationCreate two output ports with name7"W>R"C%RD an* $,D-T">R"C%RD an* *eelop the following e#pression

    7"W>R"C%RD'S7$00&TR;>"M,?"9+

    $,D-T">R"C%RD7%T 'S7$00&TR;>"M,?"9+ -7D &S-0NTR;>S-0+

    13. Clic-ppl)%

    Defining 7ew Recor* *ata flow

    14. Create transformation t)pe 8ilter@ SeIuence ;enerator@ "#pression an* $p*ateStrateg).

  • 7/25/2019 120787345-Informaticanotes.pdf

    24/34

    15. 8rom e#pression transformation cop) &"mpno@ "name@ Sal@ 7ew>Recor*+ ports to8ilter transformation.

    1!. Dou(le clic8ilter Transformation,roperties Ta(

    Transformation -ttri(ute Aalue

    8ilter Con*ition 7ew>Recor*

    16. 8rom filter transformation cop) the &"mpno@ "name@ Sal+ ports to e#pressiontransformation

    1J. 8rom SeIuence ;enerator transformation cop) the 7e#t>Aal port to e#pressiontransformation

    1H. Dou(le clic"#pression Transformation,ort Ta(8or port 7e#t>Aal selectonl) input port-** new port

    ,ort 7ame Datat)pe ,recision Scale % "#pression

    S>e) Decimal ! B 7e#t>Aal 1BB

    Aersion Decimal 5 B B

    2B. Clic-ppl)%

    21. 8rom "#pression Transformation cop) the &S>e)@ "mpno@ "name@ Sal@ Aersion+ports to an up*ate strateg) transformation

    22. Dou(le Clic$p*ate Strateg) transformation,roperties ta(

    Transformation -ttri(ute Aalue$p*ate Strateg) "#pression DD>'7S"RT

    23. 8rom $p*ate Strateg) connect the ports to the first target *efinition

    Defining $p*ate Recor* Data 8low

    24. Create the transformation t)pe 8ilter@ "#pression@ $p*ate Strateg)

    25. 8rom "#pression Transformation cop) &"mpno@ "name@ Sal@ TR;>"mpe)@TR;>Aersion@ $p*ate>Recor*+ ports to 8ilter Transformation

    2!. Dou(le Clic,roperties ta(

    Transformation -ttri(ute Aalue

    8ilter Con*ition $p*ate>Recor*

    26. 8rom 8ilter Transformation cop) &"mpno@ "name@ Sal@ TR;>"mpe)@TR;>Aersion+ ports to the "#pression Transformation

    2J. Dou(le Clic"#pression Transformation,ort Ta($nchec the output portsfor a port name i. TR;>"mp ii. TR;>Aersion

  • 7/25/2019 120787345-Informaticanotes.pdf

    25/34

    2H. Tool(ar-** new port

    ,ort 7ame Datat)pe ,recision Scale % "#pression

    Dime) Decimal ! B TR;>"mpe) 1

    Aersion Decimal 5 B TR;>Aersion 1

    3B. Clic -ppl)%

    31. 8rom "#pression TransformationCop) &Dime)@ "mpno@ "name@ Sal@ Aersion+ports to $p*ate Strateg) Transformation

    32. Dou(le Clic$p*ate Strateg) transformation,roperties ta(

    Transformation -ttri(ute Aalue

    $p*ate Strateg) "#pression DD>'7S"RT

    33. 8rom $p*ate Strateg) Transformation connect the ports to Secon* target

    *efinition.

    34. Repositor) MenuSae

    35. Repeat the process for Creating Session an* Worflow an* "#ecute theWorflow.

    Lin/ Condition

    'n SeIuential (atch processing the session can (e e#ecute* seIuentiall) an* con*itionall)using lin con*itions.

    Define the lin con*ition using a pre*efine* aria(le calle* ,reTasStatus

    Process

    1. Create three Mappings.

    2. Create three Sessions S1B@ S2B@ S3B

    3. Create worflow an* assign the session in a seIuential fashion.

    4. Dou(le Clic on the lin (etween S1B an* S2B session,re*efine* Ta(Dou(leClic on ,reTasStatusT)pe S$CC""D"D

    US1B.,reTasStatusNS$CC""D"D

    5. Repeat the process for S2B an* S3B

    !. Repositor) menuSae

    6. Repeat the process for creating worflow an* e#ecute the worflow.

    or/let

  • 7/25/2019 120787345-Informaticanotes.pdf

    26/34

    - Worlet is *efine* as group of tas. There are two t)pes of Worlet.

    i. Reusa(le Worlets

    ii. 7onFreusa(le Worlets

  • 7/25/2019 120787345-Informaticanotes.pdf

    27/34

    Process

    1. Reusa(le Worlet

    1. Tool menuWorlet Designer

    2. Worlet menuCreate;ie the proper name

    3. Drag an* Drop the sessions in parallel fashion an* lin the sessions.4. Create WorflowDrop the Worlet0in the worflow an* Worlet

    5. Run the Worflow

    2. 7onFReusa(le Worlet

    1. Tool menuWorflow DesignerWorflow menuCreate"nter thename%

    2. Tas menuCreateTas t)pe WorletE"nter the name

    3. 0in Worflow an* 7onFReusa(le Worlet

    4. Select 7onFReusa(le WorletRight Clic%pen WorletDrag an*Drop the sessions in ,arallel 8ashion

    5. Select Worflow *esigner toolRepositor) menuSae

    !. Run the Worflow.

    Conersion from 7onFReusa(le to Reusa(le Worlet

    1. Select 7onFReusa(le worlet

    2. Right Clic"*it

    3. Chec the Chec o# of Mae Reusa(le

    4. Clic -ppl)%

    Co))and Tas/

    9ou can specif) one or more Shell comman* for $7'Q or Dos Comman* for Win*owsto run *uring worflow with the comman* tas.

    9ou specif) the shell comman*s in the comman* tas to *elete@ reLect an* cop) a file etc.

    $se* the comman* tas in the following wa)s

    1. Stan*alone Comman* TasF $se a comman* tas an)where in the worflow orworlet to run the shell comman*s.

    2. ,reFpost session shell comman*F 9ou can call the comman* tas as the preFpostsession shell comman* for a session tas.

    9ou can use an) ali* $ni# comman*s for $ni# serer an* an) ali* *os comman* forWin*ows serer.

  • 7/25/2019 120787345-Informaticanotes.pdf

    28/34

    Control (lo*

    ,rereIuisite

    1. Create three session

    2. Create two fol*er in *rie C name* Success an* 8aile*

    3. Create a (lan t#t file name* test.t#t

    Procedure

    1. Tool menuTas DeeloperTas menuCreate2. Select Tas t)pe Comman*E"nter the 7ameCreateDone

    3. Dou(le clicCm* TasComman* ta(-** a new cm*

    7ame cm*

    %n>Success cop) Ctest.t#t CSuccess

    4. Clic -ppl)o

    5. Select Tas t)pe Comman*E"nter the 7ameCreateDone

    !. Dou(le clicCm* TasComman* ta(-** a new cm*

    7ame cm*%n>8aile* cop) Ctest.t#t C8aile*

    6. Dou(le clic on the session S1BSelect the Components ta(

    Tas T)pe Aalue

    ,ost Session Success Comman* Reusa(le %n>Success

    ,ost Session 8ailure Comman* Reusa(le %n>8aile*

    W?8 S 1B

    CMDT-S? S 2B

    CMDT-S? S 2B

    "entFWait8ail

    "entFWait

    SuccessCop) Ctest.t#t CSuccess

    Cop) Ctest.t#t C8ail

  • 7/25/2019 120787345-Informaticanotes.pdf

    29/34

    J. Clic -ppl)%

    H. Tas menuCreate"ent Wait"nter the nameCreateDone

    1B. Dou(le clicSuccess "ent WaitE TasSelect "ents ta(Select the preF*efine* eent

    "nter the name of the file to watchCSuccesstest.t#t

    11. Select properties ta(Select *elete file watch file

    12. Clic-ppl)o

    13. Mae a lin (etween tassDefine the lin con*ition on the lin (etween sessionS1B an* Comman* tas for success an* failure as follows

    US1B.,reTasStatusNS$CC""D"D

    US1B.,reTasStatusN8-'0"D

    14. Repositor) menuSae"#ecute Worflow

    User $efined Events

    "ent Tas

    "ent Raise "ent Wait

    $ser Define* "ents ,reFDefine* "entsV8ile Watch "ents

    W?8

    S 1B

    S 2B

    S 3B

    "ent Wait

    "ent Raise

    S 4B

    S1B S3BComplete

    "ent to (e raise*

    Wait for S1B S3Bto (e complete*

  • 7/25/2019 120787345-Informaticanotes.pdf

    30/34

    Procedure

    1. Create four Sessions.

    2. Tool MenuWorflow DesignerWorflow menuCreate

    3. "nter the Worflow name"ents ta(Create new "ents"nter the "entnameClic %

    4. Create Worflow as shown a(oe figureTas menuCreateSelect Tas"ent RaiseE an* "ent WaitECreateDone

    5. Maes the lins (etween tass.

    !. Dou(le clic"ent Raise TasSelect ,roperties ta(

    -ttri(ute Aalue

    $ser Define* Aalue S1B S3B Complete

    6. Dou(le Clic"ent Wait Tas"ent ta(

    J. Select %ption $ser Define*E Clic on rowse "ents to Choose an"entSelect the "entClic %

    H. Repositor) menuSae

    1B. "#ecute Worflow

    or/flo* *it" $ecision Tas/

    9ou can enter a con*ition that *etermines the e#ecution of the worflow with *ecisiontas@ similar to the lin con*ition.

    $se *ecision tas instea* of multiple lin con*ition in the worflow.

    Procedure

    1. Create four Sessions.

    2. Tool MenuWorflow DesignerWorflow menuCreate

    3. "nter the Worflow name"ents ta(Create new "ents"nter the "entnameClic %

    W?8

    S1B

    S2BB

    S3BB

    DecisionTas

    Comman*Tas

    "ent WaitTas

    S4BB

    Decision Con*ition

  • 7/25/2019 120787345-Informaticanotes.pdf

    31/34

    4. Create Worflow as shown a(oe figureTas menuCreateSelect TasDecisionE@ Comman*E an* "ent WaitECreateDone

    5. Mae a lin (etween tassDou(le Clic on Decision TasE Select the,roperties ta(

    -ttri(ute Aalue

    Decision 7ame U S1B.StatusNSuccee*e* -7DUS2B.StatusNSuccee*e* -7DU S3B.StatusNSuccee*e*

    !. Clic %

    6. Dou(le Clic0in 'nput to Comman* TasE,roperties ta(Create the"#pression

    "#pression UDecision .con*itionNTrue

    J. Dou(le ClicComman* TasComman* ta(

    7ame Comman*

    Success cop) DCMDT-S?R"S$0T.t#t DSuccess

    H. Dou(le Clic"ent Wait tasE,re*efine* "ent"nter the file name

    DSuccessR"S$0T.t#t

    7ote 'f )ou want to *elete the watch file after complete the tas. 9ou can select theoption Delete Watch 8ileE 8rom properties ta( of "ent wait tas.

    1B. Repositor) menuSae

    Ti)er Tas/

    9ou can specif) the perio* of time to wait (efore integration serice runs the ne#t tas inthe worflow with the timer tas.

    Procedure

    1. Create timer tas from tas menu of worflow *esigner.

    2. Dou(le clicTimer tasTimer ta(

    3. Select a(solute timespecif) *ate an* time-ppl)%

    Design a worflow with multiple lin con*ition &-lternatie to *ecision tas+

    W?8Comman*

    Tas

    US1B.StatusNSuccee*e*

    US2B.StatusNSuccee*e*

  • 7/25/2019 120787345-Informaticanotes.pdf

    32/34

    Procedure

    1. Design the worflow as shown in a(oe figure.

    2. Dou(le clicComman* Tas;eneral ta(Treat 'nput 0in as -7D %R

    3. Comman* Ta(;ie the comman*

    4. Repositor) menuSae

    ssign)ent Tas/

    9ou can assign a alue to user *efine* worflow aria(le with the assignment tas.

    To use an assignment tas in the worflow first create an* a** an assignment tas to theworflow then configure the assignment tas to assign alue or e#pression to user

    *efine* aria(le.

    Weel) an* Dail) 0oa*ing

    Procedure

    1. Create three sessions.

    2. 8rom Tools menuSelect worflow *esigner8rom worflow menuSelectCreate

    3. "nter the worflow nameSelect Aaria(le ta(8rom tool(arClic -** newAaria(le

    7ame Datat)pe ,ersistentUUW?8>R$7S 'nteger

    "nter the *efault alue B

    4. 8rom Repositor) naigator win*owDrag an* *rop the session S1B *rop (esi*ethe start tas.

    5. Create the tas t)pe DecisionE an* -ssignmentE

    !. Drag an* Drop the session S2B@ S3B

    6. Mae the lin (etween tassDou(le clic on lin (etween S1B an* -ssignmenttasDeelop the following e#pression

    US1B.StatusNSuccee*e*

    J. Dou(le clic-ssignment tasE"#pression ta(8rom tool(ar clic on a** anew "#pression

    $ser Define* Aaria(le %perator "#pression

    UUW?8>R$7S N UUW?8>R$7S 1

  • 7/25/2019 120787345-Informaticanotes.pdf

    33/34

    H. Dou(le clic0in (etween -ssignment tas an* Decision tasDeelop thefollowing e#pression

    U-ssign>alue.StatusNSuccee*e*

    1B. Dou(le clicDecision Tas,roperties ta(

    -ttri(ute AalueDecision 7ame M%D&UUW?8>R$7S@ 6+ N B

    11. Dou(le clic0in (etween *ecision tas an* session S2BDeelop the lincon*ition

    UDecision .Con*itionNTrue

    12. Dou(le clic0in (etween *ecision tas an* session S3BDeelop the lincon*ition

    UDecision . Con*itionN8alse

    13. Repositor) MenuSae

    E6)ail Tas/

    $se* to sen* an eFmail within a worflow.

    Procedure

    1. Deelop a worflow with eFmail tas.

    2. Dou(le clic"mail tas,roperties ta(Set the following -ttri(ute

    "mail $ser 7amepan*e).*ipu=in.com

    "mail Su(LectDail) 0oa* Complete*

    "mail Te#tSuccess

    3. Clic %

    4. Repositor) menuSae

    User $efined (unction

    't lets )ou to create customiKe* function or user specific function to meet the specific(usiness tas that is not possi(le with (uilt in functions.

    The user *efine* functions can (e priate or pu(lic.

    Procedure1. 8rom repositor) naigator win*ow in Designer Client Select $ser Define*

    8unctionE su( fol*er

    2. Tool menu$ser *efine* functions7ew

    3. "nter the name an* t)pe

    4. -** new -rgument

    mailto:[email protected]:[email protected]
  • 7/25/2019 120787345-Informaticanotes.pdf

    34/34

    7ame Datat)pe ,recision Scale

    -rg 1 String 12 B

    5. To *efine the e#pression clic on 0aunch "*itorE

    0TR'M &RTR'M &-R;1++