HI! All
Iam facing a problem with aggregator stage in my job,Ian selecting a records from source and doing a group by with two key fileds and aggrergatting with max() function with the rest of the fields.
The JOb is working fine when the record count is below 8 lakhs ,if the records count is more than 8 lakhs iam getting the following error
"Abnormal termination of stage EdwLocalListPricesJobNew..Agg_ProductIdCountryId detected"
This looks strange to us ,
waiting for your valuable suggestions
Regards
Tausif
Problem with aggregator Stage
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 38
- Joined: Mon Feb 27, 2006 10:34 pm
- Location: Chennai
- Contact:
-
- Participant
- Posts: 38
- Joined: Mon Feb 27, 2006 10:34 pm
- Location: Chennai
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The Aggregator stage does have memory limits. Sort the input by the grouping keys and assert on the Aggregator's input link that the input is sorted. This will mean that the Aggregator does not run out of memory, because it can free memory every time a grouping column value changes (because they are sorted, a change in value means that the previous value will never be seen again).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.