Limit the number of records

[vij]

Hi,

As i wanted to limit the number of records to be loaded in a job, i used this option - job properties -> exectuion -> force complie

here, i faced a problem, all the limited records which are read by the datastage, are being wriiten to the log and so it takes more time and occupies more server space too...

can anyone pls let me know is there any way i can avoid this or suggest other solution to limit the records to be loaded in the job.

Thanks,

[ajith]

Not clear what is your exact requirement
Is it to load less number of rows to the target?
in that case head or tail stage would do.
I am not getting what you did in force compile as it never gives any options to limit the rows

sorry that I am not getting your requirement, please clarify

[kumar_s]

Force compile to reduce records
Are you getting confused with DumpSore?
What is your job desing?
While running the job, you will have the limits like 'Stop stages after n rows' you can use that.

[ray.wurlod]

There are lots of ways to do this. What does your job design look like? The best way is not to extract rows in the first place. Another possibility is a Head or Tail or Sample stage. What precisely are your requirements?

[trobinson]

I would ask why the limited records are being written to the log. Could it be there is a Constraint on the link of Otherwise? Perhaps a Peek stage is capturing the rejected records in the Director logs? If it isn't needed, remove it and let the rejected records fall on the floor. Better yet write them to a Sequential file.