Search found 3 matches

by chriscamp
Thu Jun 26, 2008 7:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Obtaining Last Non-Null Value Per Column
Replies: 6
Views: 2332

In parallel jobs the Remove Duplicates stage has a First or Last option, and does not "break parallelism". ... True, but as mentioned above, it accepts/rejects an entire record and does not examine each column to give a LAST NON-NULL value per column. I wish it did - would make life easie...
by chriscamp
Wed Jun 25, 2008 7:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Obtaining Last Non-Null Value Per Column
Replies: 6
Views: 2332

QualityStage might not be an option, but I'll look into it for sure. It looks like I'm stuck with the good ol' Transformer and stage variables as suspected. The Sort / Group Change trick should save some transformer logic. The Server version of Aggregator has a First and Last operator - not sure how...
by chriscamp
Tue Jun 24, 2008 1:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Obtaining Last Non-Null Value Per Column
Replies: 6
Views: 2332

Obtaining Last Non-Null Value Per Column

Hi All. I am trying to determine the best method for obtaining the last non-null value for each column within a key (or group of keys). Could not find anything by searching the forum. Here's a data scenario: <pre> ROW# C1 (KEY) C2 C3 C4 ---- -------- ------ ------ ------ 1 1000 ACME <NULL> 999 2 100...