Page 1 of 1
Input 236615 records but output need 50000 records
Posted: Mon Oct 26, 2009 2:31 pm
by kkumardatastage
Hi
Please can any one help me in this issue, input is a dataset which gets 236615 records and the target should be 50000 records and i am using a transformer stage with @INROWNUM to count the Input records, but what will be the next step to get the 50k records in target.
Thanks
Posted: Mon Oct 26, 2009 3:09 pm
by chulett
Run the job with the Stop stages after Limit tab option set to 50000 rows. Or add a constraint of @OUTROWNUM <= 50000 to the output link.
Posted: Mon Oct 26, 2009 3:35 pm
by kkumardatastage
Hi
Thanks for your reply, i tried constraint @OUTROWNUM <= 50000 to the output link in transformer stage but the result still show me the same output 236615 reocrds in target and second one - Run the job with the Stop stages after Limit tab option set to 50000 rows, Stop stages after limit tab was disabled and i am not able to use it. please can u give me any other way to get me the 50k output.
Thanks
Posted: Mon Oct 26, 2009 5:26 pm
by Kryt0n
How many nodes are you using?
Run the job on a single node with the OUTROWNUM <= 50000 option
Posted: Mon Oct 26, 2009 5:45 pm
by chulett
psssttt... Server job, no nodes.
Posted: Mon Oct 26, 2009 5:49 pm
by chulett
Check again, the Limit tab is never disabled. Did you select the proper radio button first? And that @OUTROWNUM constraint will work fine as well. Those are your two ways, period.
Posted: Mon Oct 26, 2009 6:05 pm
by ray.wurlod
The Limit tab should be disabled for parallel jobs. The only way you can enforce row limits in parallel jobs is to compile in trace mode, and this puts a Peek stage on every link in the job (so you really NEED a row limit). Parallel jobs are not intended to be limited in production.
Posted: Mon Oct 26, 2009 9:15 pm
by chulett
Well, if that's the case then we've been mislead.
Re: Input 236615 records but output need 50000 records
Posted: Thu Nov 19, 2009 9:14 pm
by pathipati.ds
Hi Guys,
use key generator stage and filter stage
Thanks,
Pathipati