DSXchange

Hi Gurus

Im receiving records from 2 sources: oracle & flat file. Initially 1000 rows r there. but before loading into the target(oracle) it got increased to 15000 records. between source & target im using only one aggregator stage, none other stages r used. i had delay while loading datas in target. how to increase the performance.

Kindly let anyone enlighth me in this regard.

Sort your incoming data to match the aggregation method. Assert that sort order in the Aggregator using the Sort and Sort Order columns on the Inputs tab. Check the online help available from inside the stage via the Help button for details on the second step.

If you do those two things correctly, the Aggregator will not be a 'bottleneck' to processing and you'll get the best speed possible through the stage. Get it wrong, however, and it will either not work any differently than you are seeing now or blow up with a 'Row out of sequence' error.

Thanks Mr. Craig.

Let us know if you have any more questions once you try this out! First sign of success will be rows moving through the Aggregator at each 'sort break' rather than it absorbing all records, waiting, and only then starting to output records...

It is also possible to tune the memory allocation of the Aggregator stage on a per-job basis, but sorted input renders this unnecessary because memory can be freed as soon as any of the sorted values changes.