Search found 3 matches

by JonJon
Tue Dec 11, 2007 1:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Interesting Problem: Join / Look up on partial keys
Replies: 1
Views: 1027

Interesting Problem: Join / Look up on partial keys

Hi there I have a Master data set with which I do comparisons with a Reference data set. The issue I'm having is that the Ref data set contains only substring info of the keys used in the Master Data set. Assuming that I'm only showing Key values for the two Data Sets: Master Data Set ------------ A...
by JonJon
Sun Dec 09, 2007 11:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Merge Sort, Unique. Replace RemoveDuplicates. Doesn't work?
Replies: 4
Views: 1915

But isn't the effect of applying a "Sort Merge" on the Sequential file taking multiple partitions and merging them into one single list before ordering that list? At the end of the "Sort Merge", I'd expect a sorted list (with possibly repeated rows). Does the Unique option on the...
by JonJon
Thu Dec 06, 2007 10:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Merge Sort, Unique. Replace RemoveDuplicates. Doesn't work?
Replies: 4
Views: 1915

Merge Sort, Unique. Replace RemoveDuplicates. Doesn't work?

Hi there Hope your day is going well. I've got a Sequential File with a column that I'm wanting to remove, and then get a Distinct across the remaining columns. i.e. Data looks like (4 columns, space is delimiter) ColA ColB ColC Prod 1001 A 1 Prod1 1001 A 1 Prod2 1001 A 1 Prod3 1001 A 1 Prod4 I'm wa...