Aggregator issue

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
har
Participant
Posts: 118
Joined: Tue Feb 17, 2004 6:23 pm
Location: cincinnati
Contact:

Aggregator issue

Post by har »

Folks,
i'm processing million records through sort and aggregator stage.
I did sort on 4 keys in ascending order in sort stage and Group by 4 keys and hash partitoned on 4 keys in Aggregator stage.
i'm using sort method in Aggregator.
If i ran job 4 times with same input dataset and i see 4 different amount of records are coming from aggregator.
Any idea ..?
Har
gateleys
Premium Member
Premium Member
Posts: 992
Joined: Mon Aug 08, 2005 5:08 pm
Location: USA

Re: Aggregator issue

Post by gateleys »

Hmmm!! Why don't you just try out with, may be 1,000 input rows to see if it leads you anywhere.

Or, is it that you are not providing us with other job details?

gateleys
thebird
Participant
Posts: 254
Joined: Thu Jan 06, 2005 12:11 am
Location: India
Contact:

Post by thebird »

Make sure that the order of the sortiung key, grouping keys and the hash partitioning keys are the same.

Do you get any warnings in the log?
gateleys
Premium Member
Premium Member
Posts: 992
Joined: Mon Aug 08, 2005 5:08 pm
Location: USA

Re: Aggregator issue

Post by gateleys »

Did you key in any parameter values during each run?
gateleys
har
Participant
Posts: 118
Joined: Tue Feb 17, 2004 6:23 pm
Location: cincinnati
Contact:

Post by har »

Sorting keys and Partitioning Keys are in same order only.
Say for ex if i ran for only specific key then i get excat records and countts also match.if i ran for a month(million records) then i see difference.
Har
Post Reply