Wave Generator Stage
Posted: Wed Jul 18, 2012 6:30 am
Hi All,
Kindly help me in understanding the concept of the wave generator stage.
Requirement:
========
Need to abort the job after inserting 'n' number of records into the reject table.
Design:
=====
1.Filtered the records based on the reject criteria and threshold and inserted into the reject table using the combination of constraints and stage variables in the transformer.
2.Flagged the success or failure criteria of the rejects as 1 or 0 in another stage variable and passed it on to a newly added column[ColA] in the output of the transformer.This is to indicate the row status[if it is rejected or not.]
3.Created another output link in the transformer and hard coded "1" in the derivation of a newly created column[ColB].
4.Used the step2 output link as primary and step3 output link as reference and compared the values using ColA and ColB and assigned the lookup failure as "Fail".
Result:
====
The job got aborted but whichever rows passed the lookup condition got inserted into the target table.
I placed the Wave generator stage between the lookup stage and target table.
I used the "Columname[ColA] /Columnvalue[passed the value as 0] " property then the records were not getting inserted.
Testing
=====
I tested 3 records with the following testcases
1.All records got inserted when there are no rejects and the job was success.
2.No records got inserted even on 1 reject and the job got aborted.
Just before deep diving into further testing, wish to know the concept of wave generator stage.
Apologies for detailed explanation and any inputs would be most appreciated.
Thanks in advance.
Regards,
Bala.
Kindly help me in understanding the concept of the wave generator stage.
Requirement:
========
Need to abort the job after inserting 'n' number of records into the reject table.
Design:
=====
1.Filtered the records based on the reject criteria and threshold and inserted into the reject table using the combination of constraints and stage variables in the transformer.
2.Flagged the success or failure criteria of the rejects as 1 or 0 in another stage variable and passed it on to a newly added column[ColA] in the output of the transformer.This is to indicate the row status[if it is rejected or not.]
3.Created another output link in the transformer and hard coded "1" in the derivation of a newly created column[ColB].
4.Used the step2 output link as primary and step3 output link as reference and compared the values using ColA and ColB and assigned the lookup failure as "Fail".
Result:
====
The job got aborted but whichever rows passed the lookup condition got inserted into the target table.
I placed the Wave generator stage between the lookup stage and target table.
I used the "Columname[ColA] /Columnvalue[passed the value as 0] " property then the records were not getting inserted.
Testing
=====
I tested 3 records with the following testcases
1.All records got inserted when there are no rejects and the job was success.
2.No records got inserted even on 1 reject and the job got aborted.
Just before deep diving into further testing, wish to know the concept of wave generator stage.
Apologies for detailed explanation and any inputs would be most appreciated.
Thanks in advance.
Regards,
Bala.