Page 1 of 1

Input 236615 records but output need 50000 records

Posted: Mon Oct 26, 2009 2:31 pm
by kkumardatastage
Hi

Please can any one help me in this issue, input is a dataset which gets 236615 records and the target should be 50000 records and i am using a transformer stage with @INROWNUM to count the Input records, but what will be the next step to get the 50k records in target.

Thanks

Posted: Mon Oct 26, 2009 3:09 pm
by chulett
Run the job with the Stop stages after Limit tab option set to 50000 rows. Or add a constraint of @OUTROWNUM <= 50000 to the output link.

Posted: Mon Oct 26, 2009 3:35 pm
by kkumardatastage
Hi

Thanks for your reply, i tried constraint @OUTROWNUM <= 50000 to the output link in transformer stage but the result still show me the same output 236615 reocrds in target and second one - Run the job with the Stop stages after Limit tab option set to 50000 rows, Stop stages after limit tab was disabled and i am not able to use it. please can u give me any other way to get me the 50k output.

Thanks

Posted: Mon Oct 26, 2009 5:26 pm
by Kryt0n
How many nodes are you using?

Run the job on a single node with the OUTROWNUM <= 50000 option

Posted: Mon Oct 26, 2009 5:45 pm
by chulett
psssttt... Server job, no nodes.

Posted: Mon Oct 26, 2009 5:49 pm
by chulett
Check again, the Limit tab is never disabled. Did you select the proper radio button first? And that @OUTROWNUM constraint will work fine as well. Those are your two ways, period.

Posted: Mon Oct 26, 2009 6:05 pm
by ray.wurlod
The Limit tab should be disabled for parallel jobs. The only way you can enforce row limits in parallel jobs is to compile in trace mode, and this puts a Peek stage on every link in the job (so you really NEED a row limit). Parallel jobs are not intended to be limited in production.

Posted: Mon Oct 26, 2009 9:15 pm
by chulett
Well, if that's the case then we've been mislead.

Re: Input 236615 records but output need 50000 records

Posted: Thu Nov 19, 2009 9:14 pm
by pathipati.ds
Hi Guys,
use key generator stage and filter stage

Thanks,
Pathipati