Getting error in a job using Aggregator

shaonli · Post by **shaonli** » Wed Apr 25, 2007 11:41 pm

Hi,

I am running a job in DS 7.5 with an aggregator.The volume of data is almost 14056919.The job is getting aborted when it is trying to aggregate the data after selecting from the source.

The error is "job1 Aggregator_9: |-100|"

The buffer memeory is 1024 kb.

Please suggest.

Thanks
Shaonli

chulett · Post by **chulett** » Wed Apr 25, 2007 11:57 pm

You need to presort your data to support your grouping keys and assert the sorted order in the Aggregator stage.

soumik · Post by **soumik** » Thu Apr 26, 2007 12:16 am

I feel you also need to change the INTER PROCESS BUFFER size for this job in order to make aggregation possible for huge data.

shaonli · Post by **shaonli** » Thu Apr 26, 2007 12:19 am

Soumik,

Can you tell me the size of the Inter Process Buffer Memory?

Thanks
Shaonli

ray.wurlod · Post by **ray.wurlod** » Thu Apr 26, 2007 12:44 am

With presorted data you won't need big buffers.

shaonli · Post by **shaonli** » Thu Apr 26, 2007 3:07 am

Hi,

Using sorter also the job is getting aborted with this error "Error in merging files
At row 1, link "INST_Cds1"
Call to output link returned numeric error code: -100"

Please suggest.

nick.bond · Post by **nick.bond** » Thu Apr 26, 2007 3:28 am

Can you provide your job design? What are all the stages you have?

shaonli · Post by **shaonli** » Thu Apr 26, 2007 4:30 am

source->transformer->sorter->aggregrator->target.

it is getting aborted after transformer.

nick.bond · Post by **nick.bond** » Thu Apr 26, 2007 5:18 am

Make a few copies of your job and break it up to determine what is causing the error. have a version with just the tfm, one with tfm and sort.