How to capture rest of records other than the max

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Chuah
Participant
Posts: 46
Joined: Thu May 18, 2006 9:13 pm
Location: Melbourne

How to capture rest of records other than the max

Post by Chuah »

Hi,

I have a requirement to split a dataset into two sets, one set that has records with the max(effective_date) and the other are the rest of the records that are not ones with the max(effective_date).
With the Aggregator it is easy enough to get the first file but what is a good technique or stage to get the rest ?
Kind of like the opposite of Aggregating.

thanks.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The best way is to do it at source, when loading the Data Sets.

Otherwise you need to introduce a prior task (a server job?) to collect the current max value, and supply that as a parameter to the job that is splitting the Data Set.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply