1. How to remove duplicate rows?
We have various ways to do the same.
ServerJobs
-Using Hash File.
-Using Stage variable
Detailed description as below. we have to define two stage variable for example stgV1 and stgV2.
Derivation...............Stage Variable
-----------------------------------------
stgV1......................stgV2
IputKeyColm(Id).....stgV1
We have to write a constraint like as below
if stgV1<>stgV2 ------------->this stream is to produce unique records
if stgV1=stgV2 ------------->this stream is to produce duplicate...