Internal Error - Aggregator Stage.

[bala_135]

Hi All,

Issue:-Below is the dump I received when I try to run the job in production.
It uses a dataset,aggregator,dataset stage.
I need to calculate the Maximum value of a date column group by a Column[No composite grouping keys].

I ran the same code with the same volume of data in Dev, the code is working fine.

I sorted the column based on the grouping column and have kept the method as Sort.
I have 3 times the volume of the data in Scratch and Resource directory.


main_program: Internal Error: (infld): groupby/sortgroup2.C: 402
Traceback: assert.APT_FatalPath::pureAssertion(const char*,const char*,int)() at 0x90000000536d9f8
APT_SortedGroup2Rep::processReducers()() at 0x90000000e7ea8c4
APT_SortedGroup2Operator::describeOperator()() at 0x90000000e7ee0f8
APT_OperatorRep::wrapDescribeOperator()() at 0x9000000055785a4
APT_OperatorRep::check1a()() at 0x900000005579c74
APT_StepRep::sequenceAndCheck1Operators(APT_ErrorLog&)() at 0x90000000576e058
APT_StepRep::check()() at 0x90000000576db80
step.APT_Step::check()() at 0x900000005763e58
APT_OSL::createAndCheckStep(APT_OSL_SIL_StepSpec*,APT_ErrorLog&)() at 0x90000000e2fb3b8
.() at 0x100006d50
APT_PMconductorMain(int(*)(int,char**))() at 0x900000005b67e60
APT_SharedMain(int,char**,int(*)(int,char**))() at 0x900000005b6647c
.() at 0x10000f1f4

Regards,
Bala.

[ray.wurlod]

Please advise the data types of the non-grouping columns, what set operations you're performing on them, and whether you are used either of both of the Preserve Type and Decimal Output properties.

[bala_135]

Hi Ray,

It's my mistake.I have not properly migrated the job that creates the dataset [this dataset has the column for aggregation] and moreover the developer has typed the column in the aggregator stage rather the selecting it from the listbox.I have corrected it and ran the job it worked fine.

I have normally seen this as a column missing when we run the job.This is the first time I am seeing this type of error.

Ray to answer your question:-Non Grouping column datatype is Timestamp and I am performing to fetch Maximum value of that column.
Yes I do have the Preserve Type =True.

Regards,
Bala.

[ray.wurlod]

Please mark this thread as Resolved.