Input 236615 records but output need 50000 records

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
kkumardatastage
Participant
Posts: 84
Joined: Sat Jul 19, 2008 8:50 am

Input 236615 records but output need 50000 records

Post by kkumardatastage »

Hi

Please can any one help me in this issue, input is a dataset which gets 236615 records and the target should be 50000 records and i am using a transformer stage with @INROWNUM to count the Input records, but what will be the next step to get the 50k records in target.

Thanks
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Run the job with the Stop stages after Limit tab option set to 50000 rows. Or add a constraint of @OUTROWNUM <= 50000 to the output link.
-craig

"You can never have too many knives" -- Logan Nine Fingers
kkumardatastage
Participant
Posts: 84
Joined: Sat Jul 19, 2008 8:50 am

Post by kkumardatastage »

Hi

Thanks for your reply, i tried constraint @OUTROWNUM <= 50000 to the output link in transformer stage but the result still show me the same output 236615 reocrds in target and second one - Run the job with the Stop stages after Limit tab option set to 50000 rows, Stop stages after limit tab was disabled and i am not able to use it. please can u give me any other way to get me the 50k output.

Thanks
Kryt0n
Participant
Posts: 584
Joined: Wed Jun 22, 2005 7:28 pm

Post by Kryt0n »

How many nodes are you using?

Run the job on a single node with the OUTROWNUM <= 50000 option
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

psssttt... Server job, no nodes.
-craig

"You can never have too many knives" -- Logan Nine Fingers
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Check again, the Limit tab is never disabled. Did you select the proper radio button first? And that @OUTROWNUM constraint will work fine as well. Those are your two ways, period.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The Limit tab should be disabled for parallel jobs. The only way you can enforce row limits in parallel jobs is to compile in trace mode, and this puts a Peek stage on every link in the job (so you really NEED a row limit). Parallel jobs are not intended to be limited in production.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Well, if that's the case then we've been mislead.
-craig

"You can never have too many knives" -- Logan Nine Fingers
pathipati.ds
Participant
Posts: 3
Joined: Thu Nov 19, 2009 2:50 am

Re: Input 236615 records but output need 50000 records

Post by pathipati.ds »

Hi Guys,
use key generator stage and filter stage

Thanks,
Pathipati
Post Reply