Transformer output rows reduced!

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Teej
Participant
Posts: 677
Joined: Fri Aug 08, 2003 9:26 am
Location: USA

Post by Teej »

quote:Originally posted by dsproj2003
[br]Hi,

I have a transfomer stage which has 'x' # of rows in input stream.
There is no constraint on the transformer.

Even then, the output is 'y' # of rows where y < x.

There are no corresponding warnings/messages in the log file.


The transformer stage automatically drop any records that contains NULL values, and you do not properly handle those fields.

Ascential will address part of this by having the Transform Stage echo the 'drop' as a warning in Twister (7.0). For 6.x, the drop is silently done.

If you are attempting to change anything (even just the name), you MUST check for NULL on nullable columns. Do this:

If IsNull(field) Then SetNull() Else field

This is true for DataStage 6.* Parallel Extender.

-T.J.

* * *

... now if this can make breakfast, my life is complete.
dsproj2003
Participant
Posts: 21
Joined: Wed Oct 01, 2003 11:53 am

Post by dsproj2003 »

Thanks Teej, that certainly helped.

Thanks to all of you for those inputs.

Regards,
Nitin
Post Reply