Aggregator stage, IPC

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
Bala R
Participant
Posts: 66
Joined: Mon May 30, 2005 9:52 pm

Aggregator stage, IPC

Post by Bala R »

This is my job design

Code: Select all

                           Hashlookup
                              |
SourceOCI9i--> Agg--> IPC--> Xfm--> Agg--> IPC--> Xfm--> TargetOCI9i
 
When I thought i was going to increase some performance by increasing the buffer size in the IPC stage properties from 128 to 256, the second aggregator stage started aborting. The logged error message was ' Row out of sequence '. If this is about sort order, I had the data sorted when I select from the DB and had again set the same sort order in the aggregator inputs too. The two aggregators differ only by the grouping.
Somebody could point me what to understand from this, please.

Thanks for your time.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Ask this of Ascential/IBM. In particular ask whether rows are necessarily buffered in the order they are received.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Is the first Aggregator stage doing anything you couldn't do with a GROUP BY clause in the SELECT statement?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Bala R
Participant
Posts: 66
Joined: Mon May 30, 2005 9:52 pm

Post by Bala R »

ray.wurlod wrote:Is the first Aggregator stage doing anything you couldn't do with a GROUP BY clause in the SELECT statement?
The source OCI stage and the first aggregator together do a vertical pivot. I had used CASE expression to shift the column value and then sum the rows in the aggregator to pivot.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

That's cool 8)

It's just an obvious thing to ask.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply