Records Getting dropped

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
scorpion
Participant
Posts: 144
Joined: Thu May 12, 2005 4:19 am

Records Getting dropped

Post by scorpion »

Hi,

I am getting issue in one of my job,when i tried to run the job the some of the records are getting dropped from transformer stage before target stage.

message i am getting in log is:

Transformer_143,0: Field 'XXX' from input dataset '0' is NULL. Record dropped.

This message still getting even though handled nulls.

my derivation was to handle nulls:

If isNull(Link1.XXX) Then "" Else Trim(Link1.XXX)

Can any one help me on this?
Thanx&Regards
scorpion
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

Are you sure that you are not using the field anywhere?
scorpion
Participant
Posts: 144
Joined: Thu May 12, 2005 4:19 am

Post by scorpion »

Yes ,I am sure that I am not using the field anywhere?
Thanx&Regards
scorpion
Maveric
Participant
Posts: 388
Joined: Tue Mar 13, 2007 1:28 am

Post by Maveric »

Check your source meta data in transformer for this field. If the field is defined as Nullable no and a null comes in then datastage will drop the record.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

I've gotten this error before when I was certain that I'd dealt with nullability in all occurrences of the column in the transform stage... then I discovered that I'd used the column in a constraint. Perhaps you might have the same problem.
scorpion
Participant
Posts: 144
Joined: Thu May 12, 2005 4:19 am

Post by scorpion »

hi,

Thanks for the replys ,but i am not using any constraint in my transformer..

still i am getting the same issue.
Thanx&Regards
scorpion
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

If your are not using that column in a constraint or in a stage variable and you are certain that each use in a derivation is handled as you have described then you have discovered a bug.
scorpion
Participant
Posts: 144
Joined: Thu May 12, 2005 4:19 am

Post by scorpion »

Hi,

I am mapping this 'XXX'field to one of my out put field in a .ds file.

and the derivation i am using like:

If Len(DSLink139.XXX <9 Then "ZZZ" Else DSLink139.XXX[7,3]

this is wrking fine in the records,but some of the records are getting dropped..
Thanx&Regards
scorpion
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

That derivation is why you are getting dropped records. You need to handle nulls in that derivation as well as in the one you posted earlier. You need to add a IF IsNull... to that clause.
scorpion
Participant
Posts: 144
Joined: Thu May 12, 2005 4:19 am

Post by scorpion »

Thanks ArndW/All,

This is solved my problem...

Thanks a lot

cheers,
Thanx&Regards
scorpion
Post Reply