120787345-informaticanotes.pdf
TRANSCRIPT
-
7/25/2019 120787345-Informaticanotes.pdf
1/34
Steps Involved in building an ETL process
1. Create Source Definition
2. Create Target Definition
3. Design Mapping with or without Transformation Rule
4. Create Session for each Mapping
5. Create Worflow
!. "#ecute Worflow
Prerequisites:
1. Creation of User ccounts
Process
1. Create $ser in %racle &'t can (e an) *ata(ase+
a+ Start,rogram%racle-pplication DeelopmentS/0,0$S
(+ 0ogin with
$sername s)stem ,asswor* manager
ost String %RC0
S/0 CR"-T" $S"R -TC6 'D"7T'8'"D 9 target:
S/0 ;R-7T D- T% -TC6:
"M,
D",T
%7$S
"mp
$sername (atch6,asswor* target
$sername scott,asswor tiger
Target DSource D
-
7/25/2019 120787345-Informaticanotes.pdf
2/34
S/0 C%77"CT -TC6
-
7/25/2019 120787345-Informaticanotes.pdf
3/34
-
7/25/2019 120787345-Informaticanotes.pdf
4/34
Repositor) menuSae
7ow )our Source Definition has (een create* an* sae* in repositor).
Step !: Create Target $efinition
Target Definition can (e create* using Target Designer Tool in the Designer clientComponent.
Procedure
1. Tool menuTarget Designer
2. Source menu'mport from *ata(ase
Connect to the *ata(ase with following *etails
%DC *ata source
$sername
,asswor*
ClicConnect
Select Ta(les%?
Repositor) menuSae
Step&: $esign a )apping *it"out Transfor)ation +ule
- mapping without Transformation Rule calle* Simple ,ass Mapping.
- Mapping is create* using mapping *esigner tool. "er) mapping is uniIuel) i*entifie*() name.
Procedure
1. Tools menuMapping Designer
2. Mapping MenuCreate
3. "nter the Mapping 7ame%?
4. 8rom repositor) naigator pane *rag the source &"M,+ an* Target &Dim>"mp+ta(le *efinition: *rop on mapping *esigner wor space.
5. 8rom Source>/ualifier &S/>"M,+ connect column to the correspon*ing columnsin the target ta(le *efinition () Lust *ragging. &9ou can also use auto connect+
!. Repositor) menuSae
,ote: "er) source ta(le *efinition () *efault associates with source Iualifiertransformation.
-
7/25/2019 120787345-Informaticanotes.pdf
5/34
The source Iualifier transformation prepares an S/0 statement which is use* fore#traction () integration serice.
-
7/25/2019 120787345-Informaticanotes.pdf
6/34
Step ': Creation of Session
Process
1. %pen the client worflow manager
2. ConnectRepositor)
3. Select8ol*er&)our fol*er from Repositor) pane+Tool menuTas Deeloper
4. Tas MenuCreate
5. SelectTas t)pe session"nter the nameClicCreate
!. SelectMapping%?
6. Clic Done
Creation of Source ConnectionF &This connection is reIuire* for e#traction an*loa*ing of actual *ata. "arlier connection %DC which )ou ma*e is onl) for e#tracting
the structure of the ta(le.+Connection menuRelational
8romlist%racle7ew"nter the Details
7ameF-TC6,M>SRC
$sernameF scott
,asswor*Ftiger
Connect StringF%RC0
Similarl) create target connection following the a(oe state* process.
J. Dou(le ClicSession&S>simplepass+Mapping ta(
H. 8rom left paneS/>"M,Set Connection with the alue which )ou haecreate* for the "#tractionE connection name
1B. Repeat the processDim>emplo)eeSet Connection
11. 8rom propertiesset Target loa* t)pe 7ormalE-ppl)%?
12. Repositor)Sae
Step -: Creation of or/flo*
Process
1. Tool menuWorflow Designer
2. Worflow menuCreate
3. "nter the Worflow name &W?8>simplepass+
-
7/25/2019 120787345-Informaticanotes.pdf
7/34
4. 8rom repositor) 7aigator win*ow e#pan*Session su( fol*erDrag thesession@ *rop (esi*e the worflow
5. 8rom Tas menu0in tasDrag the lin from worflow@ *rop on session
!. Repositor) menuSae
Step 0: Eecuting or/flo*
Process
1. Worflow menuStart Worflow
7ow Start the Worflow Monitor to iew )our worflow status.
There is an option in the 'nformatica ,owerCenter in which )ou can create the target*efinition manuall) to the Target Data(ase.
Target $efinition 2anual pproac"
Process
1. Tools menuTarget Designer
2. Target menuCreate
3. "nter the Target Ta(le nameselect Data(ase t)pe &%racle+CreateDone
4. Dou(le ClicTarget DefinitionColumn Ta( from tool(ar-** new column
The column Structure will loo lie thisG
Column name Data T)pe ,recision Scale 7ot 7ull ?e) T)pe
D",T7% 7um(er&p@s+ 2 B ,rimar) e)
D7-M" Aarchar2 1B B 7ot - e)
S$MS-0 7um(er&p@s+ 6 2 7ot - e)
5. Clic %Done
!. Target menu;enerate
-
7/25/2019 120787345-Informaticanotes.pdf
8/34
H. SelectCreate Ta(le;enerate
-
7/25/2019 120787345-Informaticanotes.pdf
9/34
Transfor)ation
1. 3(ilter4 +an/4 Epression5
$($
14 Rows 14 Rows 14 &'+ !&%+ !&'+ 3&%+ 3&'+ 3&%+
usiness 0ogic Calculate the Ta# for top 3 emplo)ees of *epartment num(er 3B
-ns 8irst we use the 8ilter transformation to filter the *ata of *epartment num(er 3Bonl)@ then Ran transformation to tae the top 3 emplo)ees from *epartment num(er 3Ban* at last "#pression transformation to calculate the Ta# for each emplo)ee.
Procedure
1. Create the Source Definition"mp
2. Source -nal)KerCreate Target Definition"mp>ta#>cal
3. Create Mapping7ame M>ta#>calDrop source target *efinition onto themapping *esigner worspace.
4. Transformation MenuCreateSelect Transformation t)pe 8ilter"nter thenameCreate*one
FF Repeat the same process to a** Ran "#pression Transformation.
5. 8rom S/>"mpCop) the reIuire* ports to the filter transformation.
!. Dou(le clic8ilter Transformation,roperties ta(Set
8ilter Con*itionD",T N 3B
6. Clic-ppl)%
J. 8rom 8ilter Transformation cop) the port to a Ran Transformation.
H. Dou(le clicRan Transformation,ort ta(Set
8or a port name S-0Ran ,ort
1B. Select,roperties Ta(Set
Top"mp
-
7/25/2019 120787345-Informaticanotes.pdf
10/34
Data T)peNDecimal
,recisionN6
ScaleN2
$nchec'nput ,ort &'+
"#pressionS-0 B.15
14. Clic -ppl)%
15. 8rom "#pression Transformation connect the ports to the Target Definition.
1!. Repeat the process of creation of worflow an* e#ecute the worflow.
!. Sorter4 ggregator4 Loo/up
$($Dept Ta(leFDeptnoFDeptnameF0ocation
F"mp FSal FDeptno FDeptnoF"name FDeptno &?e)+ FSal &'+ FDname
FSal FSumsal &%+ FSumsalFDeptno Fsum&Sal+
usiness 0ogic Calculate the total Salar) ,ai* for each *epartment
-ns Sorter transformation is use* for (etter performance of -ggregator transformation@an* grouping the *ata *epartment wise@ aggregator transformation aggregate the salar)&Sum+ *epartment wise. There is Dname port is in the target ta(le (ut Dname is not in the"mp ta(le so@ we use* the 0ooup Transformation to get the Dname from Departmentta(le. &"mp.*eptnoNDept.*eptno+
Procedure
1. Create the Source an* Target Definition
2. Create the mapping with name M>0?,
3. Drop the Source Target Definitions
4. Create the Transformation t)pe Sorter an* -ggregator.
5. 8rom S/>"M, cop) the port &Dept@ Sal+ to Sorter Transformation
"mp S/>"M, Sorter T
-
7/25/2019 120787345-Informaticanotes.pdf
11/34
!. Dou(le clicSelect ,ort ta(for port name Deptno chec@ e)chec(o#appl)o
6. 8rom Sorter Transformation cop) ports to aggregator transformation
J. Dou(le clic on aggregator transformationSelect port ta(for a port name
*eptno
chec group () chec(o#H. 8rom a port name S-0 unchec output port &%+
1B. 8rom tool(ar a** new port
,ort name DataT)pe , S ' % A "#pression
Sumsal *ecimal 6 2 sum&sal+
11. Select the properties ta( select a sorte* inputclic appl)%?
12. 8rom aggregator connects the port to the target *efinition.
13. Transformation menuCreatelooup transformation7ame0?,>SRCCreate
14. Select the ta( Sourceselect the source ta(le Dept *efinitiono15. 8rom aggregator transformation cop) the port Deptno to the looup
transformation *ou(le clic on looup transformation
1!. Select the con*ition ta( from a tool(ar clic on a** a new con*ition.
0ooup ta(le column %perator Transformation ,ort
Deptno N Deptno1
16. Clicappl)%?
1J. 8rom looup transformation connect the Dname port to the target.
1H. ClicRepositor) menusae
2B. Repeat the process of creation of session an* worflow an* run the worflow.
,ote: 6 0ooup Transformation supports (oth "IuiFOoin an* 7onF"IuiLoin.
&. 7oiner Transfor)ation
$($
F"mpnoF"name
FOo(FSalFDeptno
FDeptnoFDnameF0ocation
OoinerTransformation
"mp
"mp>Dept
Dept
F"mpnoF"nameFOo(FSalFDeptnoFDnameF0ocation
-
7/25/2019 120787345-Informaticanotes.pdf
12/34
usiness 0ogic Merge the ta(le "mp an* Dept
-ns $se Ooiner transformation cop) the ports from the (oth "mp an* Dept ta(le toLoiner transformation. Set the con*ition on the port which is aaila(le in (oth ta(les
Lust lie eIuiFLoin &*eptno+.Procedure
1. Create Source an* Target *efinition
2. Create Mapping7ameM>D-T->O%'7
3. Drop source an* Target Definition
4. Create the transformation t)pe Loiner
5. 8rom S/>"M, cop) the following ports to the Loiner transformation &"mpno@ename Lo(@ sal@ *eptno+
!. 8rom S/>D",T cop) the following ports to Loiner transformation &Deptno@
Dname@ 0ocation+6. Dou(le clic on Loiner transformationCon*ition ta(8rom tool(ar-** new
con*ition
Master %perator Detail
Deptno1 N Deptno
J. Clic appl)o
H. 8rom Loiner transformation connect to the port to target *efinition.
1B. Repeat the process for creating session worflow an* run the worflow
+outer Transfor)ation
+outer Transfor)ation
'nputStateNRStateND0StateN?-
Default
usiness 0ogic Dii*e the "mp ta(le recor*s Department wise.
-ns 8or this we will use Router Transformation (ecause this taes one input an*proi*es multiple outputs. Connect the target ta(le through the eer) *istinct *epartmentgroups of output port in the Router transformation.
Procedure
Sales Sales>S/
State R
State D0
State ?-
Default
-
7/25/2019 120787345-Informaticanotes.pdf
13/34
1. Create Source an* Target Definition
2. Create mapping with name M>Router
3. Drag an* *rop the source an* target *efinition on to the mapping *esigner worspace.
4. Create Router Transformation from transformation menu.5. Cop) all the port from Source /ualifier to Router transformation
!. Dou(le clic Router Transformation;roup ta(-** new ;roup from tool(ar
;roup 7ame ;roup 8ilter Con*ition
Dept 1B DeptnoN1B
Dept 2B DeptnoN2B
Dept 3B DeptnoN3B
6. Clic -ppl)%
J. Cop) ports from Dept 1B ;roup to "mp>*ept 1B Target. &Repeat the process forDept 2B an* Dept 3B group+
H. Clic Repositor) menuSae
1B. Repeat the process for creating session an* worflow an* run the worflow.
Union Transfor)ation
7ote -ll the sources shoul* hae the same structure.
usiness 0ogic Merge two ta(le "mp an* "mplo)ees ta(le into one ta(le "mp>$nion
-ns 8or this we will use $nion Transformation 't taes multiple inputs an* proi*es oneoutput. ut the arious sources shoul* hae the same structure. Connect the target ta(lethrough single output port of the $nion transformation.
Procedure
1. 'mport meta*ata of "mp an* "mplo)ees from source *ata(ase using Source-nal)Ker.
"mp
"mplo)ees
S/>"mp
"mplo)ees>S/
%utput
;roup 2
;roup 1"mp>$nion
-
7/25/2019 120787345-Informaticanotes.pdf
14/34
2. Create Target ta(le "mp>$nion
3. Create a mapping with the name M>$nion
4. Drag an* Drop the Source an* Target Definition on the mapping *esignerworspace.
5. Create $nion Transformation with name "mp>$nion!. Dou(le Clic on $nion Transformation;roup ta(-** new group7ame the
group "mp an* "mplo)ees
6. ;roup port ta(-** new port
7ame Datat)pe ,recision Scale
"mpno *ecimal 2 B
"name String 1B B
Oo( String 1B B
J. Cop) ports S/>"mp to "mp ;roupH. Cop) ports "mplo)ees>S/ to "mplo)ees group
1B. Cop) the ports from output group to target &"mp>$nion+
11. Repeat the ,rocess of creating Session an* worflow an* Run the worflow.
Stored Procedure Transfor)ation
Create the following store* proce*ure in the *ata(ase.
Create proce*ure -nnual>ta#
&Sal 'n 7um(er@
Ta# %ut 7um(er+
'S
egin
Ta# N SalB.15:
"n*:
usiness 0ogic Calculate the -nnual Salar) of the emplo)ee for the new column ta# inthe target ta(le.
-ns 8or calculating the annual ta# this time we will use store* proce*ure transformation.ecause () this the oerhea*s of the 'ntegration serice will (e re*uce* an* theperformance will (e increase*.
Procedure
1. Create Source an* Target Definition
2. Create the mapping with the name M>Store*,
-
7/25/2019 120787345-Informaticanotes.pdf
15/34
3. Drop the source an* target *efinition on to the Mapping *esigner Worspace.
4. Create the transformation t)pe store* proce*ure
5. ;ie the %DC Connection to run the store* proce*ure accor*ing to itPs placemeans whether it is in Source *ata(ase or Target *ata(ase.
'f the Store* proce*ure is in the target *ata(ase@ then nothing to configurea**itional settings otherwise *o the a**itional settings as follows
!. Dou(le ClicStore* proce*ure,roperties Ta(Set the Connection'nformation-s per )our Relational connection name for source.
6. While Configuring the mapping in the session for connection set the connectionfor transformation also-s per )our Relational Connection name for source.
J. 8rom S/>"mp Connect the S-0 port to the store* proce*ure transformation.
H. 8rom store* proce*ure connect the T-Q port to the target *efinition.
1B. 8rom S/>"mp connect the remaining ports to target *efinition.
11. Clic Repositor) menuSae
12. Repeat the process for session Worflow an* Run the worflow.
Source 8ualifier Transfor)ation
'n this transformation we generall) *o the changing in the S/0 co*e of the Source/ualifier.
usiness 0ogic 0oa* the *ata of emplo)ees in the target those (elongs to onl)*epartment num(er 2B an* 3B an* recor*s shoul* (e sorte* () their salar) in ascen*ing
or*er.-ns "arlier we *i* this () the filter transformation (ut now we will *o this () sourceIualifier transformation. 't will certainl) increase the efficienc) of the 'ntegrationSerice.
Procedure
1. Create Source an* Target Definition
2. Create Mapping with a name M>Source>filter
3. Drop the source an* target *efinition on the mapping *esigner win*ow.
4. 8rom S/>"mp connect the reIuire* port to the Target ta(le Lust lie simple pass.
5. Dou(le clic S/>"mp,roperties ta(Set the alue for 7um(er of sorte*portsN1ESet the alue for sIl Iuer)E as S"0"CT "M,."M,7%@"M,."7-M"@ "M,.S-0@ "M,.D",T7%8R%M "M,W"R" D",T7% '7 &2B@ 3B+%RD"R 9 "M,.S-0clic ;enerate S/0Clic-ppl)%
-
7/25/2019 120787345-Informaticanotes.pdf
16/34
ere )ou can also set properties for )ou Iuer) such as Distinct () chec thechec(o# of Distinct.
) *efault the or*er () clause will (e impose* on empno (ecause )ou ha* set aluefor num(er of sorte* port N1 the integration serice tae it seIuentiall) from empno if)ou woul* choose alue 2 then it will tae to port empno an* ename so )ou must *o
changes in the S/0 Iuer) accor*ing to )our reIuirements.7ote 'f )ou will set the alue for sIl Iuer) without connecting to target port )ou will geterror message@ so connect to the target port from S/>"mp first.
!. Repeat the process for creating session an* worflow an* Run the worflow.
$ser Define Ooin in Source /ualifier Transformation
$ser *efine* Loins possi(le in the source Iualifier onl) when the two sources are (elongsto same *ata(ase user account or schema.
usiness 0ogic Ooin two ta(les "mp an* Dept to get the Department name an* 0ocation
from Dept ta(le for each emplo)ee in the "mp ta(le.-ns 'nstea* of using Loiner transformation we will use $ser Define* Ooin option insource /ualifier (ecause (oth ta(le are in the same schema of scott. 't will certainl)increase the performance measure also.
Procedure
1. Create the source an* target *efinition
2. Create a mapping with the name M>Source>Loin
3. Drag an* Drop the source an* Target *efinition on to the mapping *esignerworspace.
4. 8rom source Iualifier connects the port to the target *efinition.
5. Dou(le clic on source Iualifier ,roperties Ta( Set the alue for $ser*efine* LoinE "mp.DeptnoNDept.Deptno
!. Clic -ppl)%
6. Repositor) menuSae
J. Repeat the process for creating session an* worflow an* run the worflow.
2applet
- mapplet is reusa(le meta*ata o(Lect create* with (usiness logic using set oftransformation.
Procedure
1. Tool menuMapplet Designer
2. Mapplet menuCreate;ie the name of the mapplet
-
7/25/2019 120787345-Informaticanotes.pdf
17/34
3. Transformation menuCreateMapplet 'nput"nter the propernameCreateDone
4. Transformation menuCreateMapplet 'nput"nter the propernameCreateDone
5. Create the 8ilter Transformation an* "#pression Transformation.!. Dou(le ClicMapplet 'nput Transformation,ort ta(Create *esire*
ports%
8or "#ercise &"mpno@ "name@ Oo(@ Sal@ Deptno+
6. 8rom Mapplet 'nput Cop) the port to 8ilter TransformationChange the *atat)pe@ precision@ Scale for the reIuire* portDefine filter con*itionDeptnoN2Bor DeptnoN3B
J. 8rom 8ilter Transformation cop) the port to e#pression transformation.
H. Create an output port with the name T-Q@ $nchec the input port chec(o# fromproperties *eelop the e#pression with the following s)nta#
'88&S-02BBB@ S-015@ S-02B+
1B. 8rom "#pression Transformation cop) the ports to mapplet output transformation.
11. Repositor) menuSae
$esign a 2apping *it" 2applet
usiness logic Create a mapping for e#traction an* loa*ing the *ata from ta(le emp forthose emplo)ee whose (elongs to *epartment num(er 2B or 3B an* also calculate theirannual ta#.
-ns We will use mapplet that we hae Lust create* in the a(oe e#ercise (ecause wehae alrea*) implemente* this (usiness logic into creating mapplet.
Procedure
1. Create Source an* Target Definition
2. Create a mapping with name M>Mapplet
3. Drop the source an* target *efinition onto the mapping *esigner worspace.
4. 8rom mapplet su(fol*er *rag the mapplet *rop (esi*e the source Iualifier.
5. 8rom S/>"mp connect the ports to mapplet input an* from mapplet outputconnect the ports to target *efinition.
!. Repositor) menuSae
6. Repeat the process for creating the worflow an* Run the worflow.
Constraint %ased Load #rdering
-
7/25/2019 120787345-Informaticanotes.pdf
18/34
- C0 is specifie* when )ou want to loa* the *ata into snowflae *imension@ which arehaing primar) an* foreign e) relationship.
"#ercise $sing C0 loa* the *ata into *imension name* D",T an* "M, in which*eptno is primar) e) in the D",T ta(le an* 8oreign e) in the "M, ta(le.
Procedure1. Create Source an* Target Definition
2. Create Mapping with the name M>C0
3. Drag an* Drop the source an* target *efinition on to the mapping woring space
4. 8rom S/>"mp>*ept connect the port to the target *efinition.
5. Create a session with name S>C0
!. Dou(le clicSessionConfig o(Lect ta(Chec Constraint ase* 0oa* or*ering
6. SelectMapping ta(Set the source an* each target connection relation
t)peappl)%J. Repeat the process for creating worflow an* Run the worflow.
Sc"eduling or/flo*
- sche*ule specifies the *ata an* time to run the worflow.
Procedure
1. 8rom the worflow managerTool menuWorflow DesignerCreateWorflow
2. Select sche*uler ta(Select Reusa(le Ra*io (uttonSet the alues for sche*uler8or Run %ption
Run on 'ntegration serice 'nitialiKation
Sche*ule optionSelect Run "er)*a)
Select "n* %ption8oreer
Set the start *ate an* time
3. Clic -ppl)%
4. Repeat the Rest of the process of creating worflow.
or/ing *it" (lat files
Procedure
Step 1Creation of Source Definition
i+ Tool menuSource -nal)KerSources menu'mport from file
-
7/25/2019 120787345-Informaticanotes.pdf
19/34
ii+ rowse the location of flat fileSelect the file%
iii+ 'n the popFup win*ow *o these settings
a+ Select 8lat 8ile T)peDelimite*
(+ Select &Chec+ 'mport fiel* name from the first lineClic7e#t
c+ Select *elimiter t)pe7e#t
*+ 'f reIuire* alter the *ata t)pe for source *efinition8inish
i+ Repositor) menuSae
Step 2Create the target *efinition in the target *ata(ase an* repeat the process fortarget *efinition
Step 3Create Mapping;ie proper name8rom Source /ualifier connect theports to the target *efinition.
Step 4Create a session;ie the proper name
Step 5Dou(le clic sessionMapping ta(Select S/>Customer from leftpaneSet the attri(ute as follows
-ttri(utes Aalues
Source 8ile Director) D8latfiles
Source 8ile 7ame Customer.t#t
Source 8ile T)pe Direct
Step !Set the target setting for loa*ing as usual with relational connection.
Step 6
Repeat the process for creating worflow an* run the worflow.
Direct an* 'n*irect Communication of 'ntegration Serice with Source 8ile t)pe
'ntegration Serice 'ntegration Serice
Direct 'n*irect
C8latfileCustomer.t#t 0ist of files,athD8ilesCust.t#t
(ile ,a)e: Cust.tt
C8latfilesCustomer.t#tDCustomerCust1.t#tDSalesCustomer.t#t
-
7/25/2019 120787345-Informaticanotes.pdf
20/34
-
7/25/2019 120787345-Informaticanotes.pdf
21/34
or/ing *it" (ile List
- 8ile list is a list of flat files with the same *ata *efinition@ which nee*s to (emerge* with source file t)pe as in*irect.
7ote - file list wors onl) when the entire flat files haing the same *ata *efinition.
Procedure
1. The all processes are same e#cept )ou hae to set the session attri(ute alue forSource 8ile T)peE as 'n*irect.
92L Source 8ualifier Transfor)ation
We use QM0 Source /ualifier Transformation to rea* the *ata from QM0 files.
"er) QM0 Source *efinition () *efault associates with QM0 Source /ualifierTransformation.
Procedure1. Create source *efinition "mp.#ml
2. Tool menuSource -nal)KerSource menu'mport #ml *efinition
3. rowse the location for #ml fileselect file%pen%
4. - win*ow will popFup for settingsClic7e#tSelect %ption
i. ierarch) Relationship
ii. DenormaliKe* #ml iews8insih
5. Repositor) menuSae
!. Create target *efinition"mp>#ml
6. Create mapping with giing proper name.
J. Drag an* Drop the source an* target *efinition to the mapping worspace.
H. 8rom QM0>S/ connect the ports to the target *efinition.
1B. Create SessionS>QM0
11. Dou(le clic sessionMapping ta(from left pane select QM0 sourceIualifier'n properties section set the following attri(utes.
Source 8ile Director)DQM0 8iles
Source 8ile 7ame"mp.#ml
Source 8ile T)peDirect12. Repeat the process for target relational connection@ an* creating worflow
an* run the worflow.
,or)alier Transfor)ation
7ormaliKer transformation functions lie a source Iualifier while rea*ing the *ata fromC%%0 sources.
-
7/25/2019 120787345-Informaticanotes.pdf
22/34
$se normaliKer transformation to conert a single input recor* from source into multipleoutput *ata recor*s. &This process is nown as *ata pioting+
Process
1. Create Source an* Target *efinition
2. Create a mapping with name
M>,iot3. Drop the source an* target *efinition to the mapping woring space.
4. Create transformation t)pe 7ormaliKer
5. *ou(le clic7ormaliKer Transformation7ormaliKer ta(-** new column
Column 7ame 0eel %ccurs Datat)pe , S
9ear B B 7um(er 4 B
-ccount B B String 1B B
-mount B 3 7um(er 6 2
!. Clic -ppl)%
6. 8rom Source /ualifier connect the port to normaliKer transformationJ. 8rom 7ormaliKer transformation connect to target *efinition &;C'DMonth+
H. Repositor) menusae
1B. Repeat the process for session worflow an* run the worflow.
;CI$ ;enerate* Column 'D < ;lo(al Column 'D
Transaction Control Transfor)ation
T)pe of actie transformation which allow to control the transaction () set of commit an*roll(ac con*ition.
usiness 0ogic Commit onl) those emplo)ees information whose (elongs to *epartmentnum(er 2B.
-nsF $se Transaction control transformation an* gie the con*ition.
'88&D",TN2B TC>C%MM'T>-8T"R@ TC>R%00-C?>-8T"R+
Process
1. Create Source an* Target *efinition
2. Create the mapping with nameM>TCT
3. Drag Drop the source an* target *efinition at mapping *esigner worspace.4. Create transformation t)peTransaction control
5. Cop) ports from S/>"mp to Transaction Control Transformation
!. Cop) the ports from Transaction Control Transformation to Target ta(le
6. Dou(le ClicTransaction Control TransformationSelect Transaction ControlTransformation Con*ition;ie the con*ition
-
7/25/2019 120787345-Informaticanotes.pdf
23/34
'88&D",TN2B TC>C%MM'T>-8T"R@ TC>R%00-C?>-8T"R+
To select pre*efine* aria(leClic on aria(le (uilt in fol*er.
Slo*l< C"anging $i)ension6tt)pe2+ &"mpe)@ "mpno@ "name@ Sal@ Aersion+
3. Drag an* Drop the source an* target *efinition on mapping *esigner worspace.
7ote Drop the Target Definition twice on the mapping *esigner worspace
4. Create a looup transformation to perform a looup on target ta(le.
5. 8rom S/>"mp cop) the port "mpno to the looup transformation an* mae itport t)pe input onl).
!. Dou(le clic on the looup transformationSelect the con*ition ta(a** newcon*itionSet con*ition as follows
0ooup ta(le con*ition %perator Transformation ,ort
"mpno N "mpno1
6. Select the properties ta(Set the following properties
Transformation -ttri(ute Aalue
0ooup polic) on multiple match $se last alue
J. Create "#pression TransformationH. 8rom S/>"mp cop) &empno@ ename@ sal+ ports to e#pression transformation
1B. 8rom looup transformation cop) &empe)@ sal1@ ersion+ ports to e#pressiontransformation
11. Rename the ports which are copies from looup transformation for (etterun*erstan*ing as &TR;>"M,?"9@ TR;>S-0@ TR;>A"RS'%7+
12. 'n e#pression transformationCreate two output ports with name7"W>R"C%RD an* $,D-T">R"C%RD an* *eelop the following e#pression
7"W>R"C%RD'S7$00&TR;>"M,?"9+
$,D-T">R"C%RD7%T 'S7$00&TR;>"M,?"9+ -7D &S-0NTR;>S-0+
13. Clic-ppl)%
Defining 7ew Recor* *ata flow
14. Create transformation t)pe 8ilter@ SeIuence ;enerator@ "#pression an* $p*ateStrateg).
-
7/25/2019 120787345-Informaticanotes.pdf
24/34
15. 8rom e#pression transformation cop) &"mpno@ "name@ Sal@ 7ew>Recor*+ ports to8ilter transformation.
1!. Dou(le clic8ilter Transformation,roperties Ta(
Transformation -ttri(ute Aalue
8ilter Con*ition 7ew>Recor*
16. 8rom filter transformation cop) the &"mpno@ "name@ Sal+ ports to e#pressiontransformation
1J. 8rom SeIuence ;enerator transformation cop) the 7e#t>Aal port to e#pressiontransformation
1H. Dou(le clic"#pression Transformation,ort Ta(8or port 7e#t>Aal selectonl) input port-** new port
,ort 7ame Datat)pe ,recision Scale % "#pression
S>e) Decimal ! B 7e#t>Aal 1BB
Aersion Decimal 5 B B
2B. Clic-ppl)%
21. 8rom "#pression Transformation cop) the &S>e)@ "mpno@ "name@ Sal@ Aersion+ports to an up*ate strateg) transformation
22. Dou(le Clic$p*ate Strateg) transformation,roperties ta(
Transformation -ttri(ute Aalue$p*ate Strateg) "#pression DD>'7S"RT
23. 8rom $p*ate Strateg) connect the ports to the first target *efinition
Defining $p*ate Recor* Data 8low
24. Create the transformation t)pe 8ilter@ "#pression@ $p*ate Strateg)
25. 8rom "#pression Transformation cop) &"mpno@ "name@ Sal@ TR;>"mpe)@TR;>Aersion@ $p*ate>Recor*+ ports to 8ilter Transformation
2!. Dou(le Clic,roperties ta(
Transformation -ttri(ute Aalue
8ilter Con*ition $p*ate>Recor*
26. 8rom 8ilter Transformation cop) &"mpno@ "name@ Sal@ TR;>"mpe)@TR;>Aersion+ ports to the "#pression Transformation
2J. Dou(le Clic"#pression Transformation,ort Ta($nchec the output portsfor a port name i. TR;>"mp ii. TR;>Aersion
-
7/25/2019 120787345-Informaticanotes.pdf
25/34
2H. Tool(ar-** new port
,ort 7ame Datat)pe ,recision Scale % "#pression
Dime) Decimal ! B TR;>"mpe) 1
Aersion Decimal 5 B TR;>Aersion 1
3B. Clic -ppl)%
31. 8rom "#pression TransformationCop) &Dime)@ "mpno@ "name@ Sal@ Aersion+ports to $p*ate Strateg) Transformation
32. Dou(le Clic$p*ate Strateg) transformation,roperties ta(
Transformation -ttri(ute Aalue
$p*ate Strateg) "#pression DD>'7S"RT
33. 8rom $p*ate Strateg) Transformation connect the ports to Secon* target
*efinition.
34. Repositor) MenuSae
35. Repeat the process for Creating Session an* Worflow an* "#ecute theWorflow.
Lin/ Condition
'n SeIuential (atch processing the session can (e e#ecute* seIuentiall) an* con*itionall)using lin con*itions.
Define the lin con*ition using a pre*efine* aria(le calle* ,reTasStatus
Process
1. Create three Mappings.
2. Create three Sessions S1B@ S2B@ S3B
3. Create worflow an* assign the session in a seIuential fashion.
4. Dou(le Clic on the lin (etween S1B an* S2B session,re*efine* Ta(Dou(leClic on ,reTasStatusT)pe S$CC""D"D
US1B.,reTasStatusNS$CC""D"D
5. Repeat the process for S2B an* S3B
!. Repositor) menuSae
6. Repeat the process for creating worflow an* e#ecute the worflow.
or/let
-
7/25/2019 120787345-Informaticanotes.pdf
26/34
- Worlet is *efine* as group of tas. There are two t)pes of Worlet.
i. Reusa(le Worlets
ii. 7onFreusa(le Worlets
-
7/25/2019 120787345-Informaticanotes.pdf
27/34
Process
1. Reusa(le Worlet
1. Tool menuWorlet Designer
2. Worlet menuCreate;ie the proper name
3. Drag an* Drop the sessions in parallel fashion an* lin the sessions.4. Create WorflowDrop the Worlet0in the worflow an* Worlet
5. Run the Worflow
2. 7onFReusa(le Worlet
1. Tool menuWorflow DesignerWorflow menuCreate"nter thename%
2. Tas menuCreateTas t)pe WorletE"nter the name
3. 0in Worflow an* 7onFReusa(le Worlet
4. Select 7onFReusa(le WorletRight Clic%pen WorletDrag an*Drop the sessions in ,arallel 8ashion
5. Select Worflow *esigner toolRepositor) menuSae
!. Run the Worflow.
Conersion from 7onFReusa(le to Reusa(le Worlet
1. Select 7onFReusa(le worlet
2. Right Clic"*it
3. Chec the Chec o# of Mae Reusa(le
4. Clic -ppl)%
Co))and Tas/
9ou can specif) one or more Shell comman* for $7'Q or Dos Comman* for Win*owsto run *uring worflow with the comman* tas.
9ou specif) the shell comman*s in the comman* tas to *elete@ reLect an* cop) a file etc.
$se* the comman* tas in the following wa)s
1. Stan*alone Comman* TasF $se a comman* tas an)where in the worflow orworlet to run the shell comman*s.
2. ,reFpost session shell comman*F 9ou can call the comman* tas as the preFpostsession shell comman* for a session tas.
9ou can use an) ali* $ni# comman*s for $ni# serer an* an) ali* *os comman* forWin*ows serer.
-
7/25/2019 120787345-Informaticanotes.pdf
28/34
Control (lo*
,rereIuisite
1. Create three session
2. Create two fol*er in *rie C name* Success an* 8aile*
3. Create a (lan t#t file name* test.t#t
Procedure
1. Tool menuTas DeeloperTas menuCreate2. Select Tas t)pe Comman*E"nter the 7ameCreateDone
3. Dou(le clicCm* TasComman* ta(-** a new cm*
7ame cm*
%n>Success cop) Ctest.t#t CSuccess
4. Clic -ppl)o
5. Select Tas t)pe Comman*E"nter the 7ameCreateDone
!. Dou(le clicCm* TasComman* ta(-** a new cm*
7ame cm*%n>8aile* cop) Ctest.t#t C8aile*
6. Dou(le clic on the session S1BSelect the Components ta(
Tas T)pe Aalue
,ost Session Success Comman* Reusa(le %n>Success
,ost Session 8ailure Comman* Reusa(le %n>8aile*
W?8 S 1B
CMDT-S? S 2B
CMDT-S? S 2B
"entFWait8ail
"entFWait
SuccessCop) Ctest.t#t CSuccess
Cop) Ctest.t#t C8ail
-
7/25/2019 120787345-Informaticanotes.pdf
29/34
J. Clic -ppl)%
H. Tas menuCreate"ent Wait"nter the nameCreateDone
1B. Dou(le clicSuccess "ent WaitE TasSelect "ents ta(Select the preF*efine* eent
"nter the name of the file to watchCSuccesstest.t#t
11. Select properties ta(Select *elete file watch file
12. Clic-ppl)o
13. Mae a lin (etween tassDefine the lin con*ition on the lin (etween sessionS1B an* Comman* tas for success an* failure as follows
US1B.,reTasStatusNS$CC""D"D
US1B.,reTasStatusN8-'0"D
14. Repositor) menuSae"#ecute Worflow
User $efined Events
"ent Tas
"ent Raise "ent Wait
$ser Define* "ents ,reFDefine* "entsV8ile Watch "ents
W?8
S 1B
S 2B
S 3B
"ent Wait
"ent Raise
S 4B
S1B S3BComplete
"ent to (e raise*
Wait for S1B S3Bto (e complete*
-
7/25/2019 120787345-Informaticanotes.pdf
30/34
Procedure
1. Create four Sessions.
2. Tool MenuWorflow DesignerWorflow menuCreate
3. "nter the Worflow name"ents ta(Create new "ents"nter the "entnameClic %
4. Create Worflow as shown a(oe figureTas menuCreateSelect Tas"ent RaiseE an* "ent WaitECreateDone
5. Maes the lins (etween tass.
!. Dou(le clic"ent Raise TasSelect ,roperties ta(
-ttri(ute Aalue
$ser Define* Aalue S1B S3B Complete
6. Dou(le Clic"ent Wait Tas"ent ta(
J. Select %ption $ser Define*E Clic on rowse "ents to Choose an"entSelect the "entClic %
H. Repositor) menuSae
1B. "#ecute Worflow
or/flo* *it" $ecision Tas/
9ou can enter a con*ition that *etermines the e#ecution of the worflow with *ecisiontas@ similar to the lin con*ition.
$se *ecision tas instea* of multiple lin con*ition in the worflow.
Procedure
1. Create four Sessions.
2. Tool MenuWorflow DesignerWorflow menuCreate
3. "nter the Worflow name"ents ta(Create new "ents"nter the "entnameClic %
W?8
S1B
S2BB
S3BB
DecisionTas
Comman*Tas
"ent WaitTas
S4BB
Decision Con*ition
-
7/25/2019 120787345-Informaticanotes.pdf
31/34
4. Create Worflow as shown a(oe figureTas menuCreateSelect TasDecisionE@ Comman*E an* "ent WaitECreateDone
5. Mae a lin (etween tassDou(le Clic on Decision TasE Select the,roperties ta(
-ttri(ute Aalue
Decision 7ame U S1B.StatusNSuccee*e* -7DUS2B.StatusNSuccee*e* -7DU S3B.StatusNSuccee*e*
!. Clic %
6. Dou(le Clic0in 'nput to Comman* TasE,roperties ta(Create the"#pression
"#pression UDecision .con*itionNTrue
J. Dou(le ClicComman* TasComman* ta(
7ame Comman*
Success cop) DCMDT-S?R"S$0T.t#t DSuccess
H. Dou(le Clic"ent Wait tasE,re*efine* "ent"nter the file name
DSuccessR"S$0T.t#t
7ote 'f )ou want to *elete the watch file after complete the tas. 9ou can select theoption Delete Watch 8ileE 8rom properties ta( of "ent wait tas.
1B. Repositor) menuSae
Ti)er Tas/
9ou can specif) the perio* of time to wait (efore integration serice runs the ne#t tas inthe worflow with the timer tas.
Procedure
1. Create timer tas from tas menu of worflow *esigner.
2. Dou(le clicTimer tasTimer ta(
3. Select a(solute timespecif) *ate an* time-ppl)%
Design a worflow with multiple lin con*ition &-lternatie to *ecision tas+
W?8Comman*
Tas
US1B.StatusNSuccee*e*
US2B.StatusNSuccee*e*
-
7/25/2019 120787345-Informaticanotes.pdf
32/34
Procedure
1. Design the worflow as shown in a(oe figure.
2. Dou(le clicComman* Tas;eneral ta(Treat 'nput 0in as -7D %R
3. Comman* Ta(;ie the comman*
4. Repositor) menuSae
ssign)ent Tas/
9ou can assign a alue to user *efine* worflow aria(le with the assignment tas.
To use an assignment tas in the worflow first create an* a** an assignment tas to theworflow then configure the assignment tas to assign alue or e#pression to user
*efine* aria(le.
Weel) an* Dail) 0oa*ing
Procedure
1. Create three sessions.
2. 8rom Tools menuSelect worflow *esigner8rom worflow menuSelectCreate
3. "nter the worflow nameSelect Aaria(le ta(8rom tool(arClic -** newAaria(le
7ame Datat)pe ,ersistentUUW?8>R$7S 'nteger
"nter the *efault alue B
4. 8rom Repositor) naigator win*owDrag an* *rop the session S1B *rop (esi*ethe start tas.
5. Create the tas t)pe DecisionE an* -ssignmentE
!. Drag an* Drop the session S2B@ S3B
6. Mae the lin (etween tassDou(le clic on lin (etween S1B an* -ssignmenttasDeelop the following e#pression
US1B.StatusNSuccee*e*
J. Dou(le clic-ssignment tasE"#pression ta(8rom tool(ar clic on a** anew "#pression
$ser Define* Aaria(le %perator "#pression
UUW?8>R$7S N UUW?8>R$7S 1
-
7/25/2019 120787345-Informaticanotes.pdf
33/34
H. Dou(le clic0in (etween -ssignment tas an* Decision tasDeelop thefollowing e#pression
U-ssign>alue.StatusNSuccee*e*
1B. Dou(le clicDecision Tas,roperties ta(
-ttri(ute AalueDecision 7ame M%D&UUW?8>R$7S@ 6+ N B
11. Dou(le clic0in (etween *ecision tas an* session S2BDeelop the lincon*ition
UDecision .Con*itionNTrue
12. Dou(le clic0in (etween *ecision tas an* session S3BDeelop the lincon*ition
UDecision . Con*itionN8alse
13. Repositor) MenuSae
E6)ail Tas/
$se* to sen* an eFmail within a worflow.
Procedure
1. Deelop a worflow with eFmail tas.
2. Dou(le clic"mail tas,roperties ta(Set the following -ttri(ute
"mail $ser 7amepan*e).*ipu=in.com
"mail Su(LectDail) 0oa* Complete*
"mail Te#tSuccess
3. Clic %
4. Repositor) menuSae
User $efined (unction
't lets )ou to create customiKe* function or user specific function to meet the specific(usiness tas that is not possi(le with (uilt in functions.
The user *efine* functions can (e priate or pu(lic.
Procedure1. 8rom repositor) naigator win*ow in Designer Client Select $ser Define*
8unctionE su( fol*er
2. Tool menu$ser *efine* functions7ew
3. "nter the name an* t)pe
4. -** new -rgument
mailto:[email protected]:[email protected] -
7/25/2019 120787345-Informaticanotes.pdf
34/34
7ame Datat)pe ,recision Scale
-rg 1 String 12 B
5. To *efine the e#pression clic on 0aunch "*itorE
0TR'M &RTR'M &-R;1++