records dropped in transformer

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mab_arif16
Charter Member
Charter Member
Posts: 87
Joined: Sat Mar 18, 2006 11:45 pm

records dropped in transformer

Post by mab_arif16 »

Hi
In one of my job , a transformer which checks the following null condition
if ISNULL(RM_NULLS.COL1) And IsNotNull(RM_NULLS.COL2) then RM_NULLS.COL3= RM_NULLS.COL4 else RM_NULLS.COL3
for which I am getting warning
APT_CombinedOperatorController,0: Field 'COL1' from input dataset '0' is NULL. Record dropped.

I tried giving a reject link ,but it didnt work ,is there some way to get rid of this warning.
Thanks
Arif
kris007
Charter Member
Charter Member
Posts: 1102
Joined: Tue Jan 24, 2006 5:38 pm
Location: Riverside, RI

Re: records dropped in transformer

Post by kris007 »

mab_arif16 wrote:Hi
In one of my job , a transformer which checks the following null condition
if ISNULL(RM_NULLS.COL1) And IsNotNull(RM_NULLS.COL2) then RM_NULLS.COL3= RM_NULLS.COL4 else RM_NULLS.COL3
for which I am getting warning
APT_CombinedOperatorController,0: Field 'COL1' from input dataset '0' is NULL. Record dropped.

I tried giving a reject link ,but it didnt work ,is there some way to get rid of this warning.
Thanks
Arif
Make sure you perform ISNULL check on COL1 in all the references.
Kris

Where's the "Any" key?-Homer Simpson
pavankvk
Participant
Posts: 202
Joined: Thu Dec 04, 2003 7:54 am

Post by pavankvk »

I had a similar problem.

i used another transformer to check IsNull(column) Then set 'X' and in the actual transformer i checked for value of 'X'.
mab_arif16
Charter Member
Charter Member
Posts: 87
Joined: Sat Mar 18, 2006 11:45 pm

Re: records dropped in transformer

Post by mab_arif16 »

kris007 wrote:
mab_arif16 wrote:Hi
In one of my job , a transformer which checks the following null condition
if ISNULL(RM_NULLS.COL1) And IsNotNull(RM_NULLS.COL2) then RM_NULLS.COL3= RM_NULLS.COL4 else RM_NULLS.COL3
for which I am getting warning
APT_CombinedOperatorController,0: Field 'COL1' from input dataset '0' is NULL. Record dropped.

I tried giving a reject link ,but it didnt work ,is there some way to get rid of this warning.
Thanks
Arif
Make sure you perform ISNULL check on COL1 in all the references.
Thats the only palce where I am referencing column 1.
Thanks
Arif
kris007
Charter Member
Charter Member
Posts: 1102
Joined: Tue Jan 24, 2006 5:38 pm
Location: Riverside, RI

Post by kris007 »

Are you getting this error message in Transformer stage or in the input dataset stage?If input dataset make sure you are handling nulls for that column.
Kris

Where's the "Any" key?-Homer Simpson
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Is your COL1 column marked as NotNull?
If so handle null for that column.
Also try turning Combinabiltiy to false and rerun the job.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
ukyrvd
Premium Member
Premium Member
Posts: 73
Joined: Thu Feb 10, 2005 10:59 am

Post by ukyrvd »

I had similar problem. In my case, the isnull check and the transformation logic is in StageVariable derivation. If I move that to output column derivation, DS is happy!!
thank you
- prasad
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You don't do assignment in expressions. The original expression should be

Code: Select all

If ISNULL(RM_NULLS.COL1) And IsNotNull(RM_NULLS.COL2) Then  RM_NULLS.COL4 Else RM_NULLS.COL3 
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply