Problem with Aggretaor
Moderators: chulett, rschirm, roy
Problem with Aggretaor
Hi,
When i am using the transformer i am getting the follwing error in director
Abnormal termination of stage ABCD..Aggregator_11 detected
I am taking two columns col1 and col2 from the source and in aggregator
group by col1 and max(col2)
passing the same to u/p file
Please help me out.
When i am using the transformer i am getting the follwing error in director
Abnormal termination of stage ABCD..Aggregator_11 detected
I am taking two columns col1 and col2 from the source and in aggregator
group by col1 and max(col2)
passing the same to u/p file
Please help me out.
No other error messeges,Data Volume is 3 crores of rows.DSguru2B wrote:Do you have sorted input? Can you explain your job design a little bit more clearly. Do you have any more error messages? details man details.
From input informix stage ,I am using simpe simple SQL Stament
Select col1,col2
From tab1
Then pass to transformer
Apply some constrints for filtering
Then pass to aggrator
Doing group by on col1 and max on col 2
Then agin pass to tranformer to do look up then to target.
the aggregator ouput link it is showing green colour and showing 0 rws proceesed,in put link it is showing some rows but it is in red.
Some times the error messege is as follows
ABC..Aggregator_12: yxy
Please help me
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
We keep advising you to use sorted data. 30 million rows is not too many. Even a UNIX sort can manage this many. The Aggregator stage with unsorted input will almost always abort with this much data, but will not with sorted input.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Thanks for the information.ray.wurlod wrote:We keep advising you to use sorted data. 30 million rows is not too many. Even a UNIX sort can manage this many. The Aggregator stage with unsorted input will almost always abort with this much data, ...
Some of my tables contains 30 crores of rows.I have used the sort option in the input of aggrator stage on one column
I am getting the error
ABC..Aggregator_11: Row out of sequence
At row 89, link "DSLink14"
Row out of sequence
I have used the same order from tranformer which populate data to aggragatorchulett wrote:The error is pretty self-explanatory. You've told the Aggregator to expect rows in a certain order and it found a row 'out of sequence' - one that violated your alleged order. Correct it.
Transformer
col1
col2
Aggragator input
col name - sort - sort order
col1 -- 1 -- Ascending
col2 -- 2 -- Ascending
Aggragator output
col name-- group -- Derivation
col1 -- *[Grup by this col] -- --
col2 -- -- -- max(col2)
The above are the details,Please suggest.