DSXchange

Hi All,

Issue:-Below is the dump I received when I try to run the job in production.
It uses a dataset,aggregator,dataset stage.
I need to calculate the Maximum value of a date column group by a Column[No composite grouping keys].

I ran the same code with the same volume of data in Dev, the code is working fine.

I sorted the column based on the grouping column and have kept the method as Sort.
I have 3 times the volume of the data in Scratch and Resource directory.


main_program: Internal Error: (infld): groupby/sortgroup2.C: 402
Traceback: assert.APT_FatalPath::pureAssertion(const char*,const char*,int)() at 0x90000000536d9f8
APT_SortedGroup2Rep::processReducers()() at 0x90000000e7ea8c4
APT_SortedGroup2Operator::describeOperator()() at 0x90000000e7ee0f8
APT_OperatorRep::wrapDescribeOperator()() at 0x9000000055785a4
APT_OperatorRep::check1a()() at 0x900000005579c74
APT_StepRep::sequenceAndCheck1Operators(APT_ErrorLog&)() at 0x90000000576e058
APT_StepRep::check()() at 0x90000000576db80
step.APT_Step::check()() at 0x900000005763e58
APT_OSL::createAndCheckStep(APT_OSL_SIL_StepSpec*,APT_ErrorLog&)() at 0x90000000e2fb3b8
.() at 0x100006d50
APT_PMconductorMain(int(*)(int,char**))() at 0x900000005b67e60
APT_SharedMain(int,char**,int(*)(int,char**))() at 0x900000005b6647c
.() at 0x10000f1f4

Regards,
Bala.

Please advise the data types of the non-grouping columns, what set operations you're performing on them, and whether you are used either of both of the Preserve Type and Decimal Output properties.

Hi Ray,

It's my mistake.I have not properly migrated the job that creates the dataset [this dataset has the column for aggregation] and moreover the developer has typed the column in the aggregator stage rather the selecting it from the listbox.I have corrected it and ran the job it worked fine.

I have normally seen this as a column missing when we run the job.This is the first time I am seeing this type of error.

Ray to answer your question:-Non Grouping column datatype is Timestamp and I am performing to fetch Maximum value of that column.
Yes I do have the Preserve Type =True.

Regards,
Bala.

Please mark this thread as Resolved.