Page 1 of 1
Limiting rows in parallel job
Posted: Mon Apr 20, 2009 2:44 am
by swathi Singamareddygari
Hi all,
I am running a parallel job and i am getting around 22000 rows from source.For testing purpose i want to limit the rows for which the job has to run.
The row limit option ,while runing the job in director is applicable only for server jobs.
can any one please help me in this one.
Thanks &Regards
Swathi S
Posted: Mon Apr 20, 2009 3:15 am
by nani0907
In transformer we can give constraints @inrownum<=10 for testing and after remove the constaints once testing is completed.
Re: Limiting rows in parllel job
Posted: Mon Apr 20, 2009 3:28 am
by sharantheboss
Hi Swati,
If source is flat file then resctrict records by sampling the records using cat commond.If it is a table edit source query like Fetch first 10 records. we dont ahve any option for PX jobs!.
Regards
BOSS
Re: Limiting rows in parllel job
Posted: Mon Apr 20, 2009 4:05 am
by DSDexter
Please re-check. The row limit tab is present for PX jobs also.
Re: Limiting rows in parllel job
Posted: Mon Apr 20, 2009 6:38 am
by dsusr
Compile the Job in Trace Mode i.e. go to the Job Properties -- Execution Tab and enable the box Compile in Trace mode. Then you can limit the number of records per link for a partition.
Regards,
dsusr
use filter
Posted: Mon Apr 20, 2009 12:53 pm
by edison
awk -F',' '{if(NR>=9){print $0}}',if it a seq file filter the rows by using command