Records Dropped

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

G SHIVARANJANI
Participant
Posts: 137
Joined: Sun Jan 07, 2007 11:17 pm
Location: VISAKHAPATNAM

Records Dropped

Post by G SHIVARANJANI »

Hi
Why do we get the following warning, when i tried to move data from a table to a squential file.

APT_CombinedOperatorController,0: Field 'LAST_UPDATE_DATE' from input dataset '0' is NULL. Record dropped.


thanks,
Shivaranjani
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

You have not handled null in the field 'LAST_UPDATE_DATE'.

Set APT_DISABLE_COMBINATION environment variable to true to find out in which stage of the job the error occurs. If the stage is a transformer then you have lot of null handling functions available. Refer the manual for null handling functions.
G SHIVARANJANI
Participant
Posts: 137
Joined: Sun Jan 07, 2007 11:17 pm
Location: VISAKHAPATNAM

Post by G SHIVARANJANI »

Hi,

Its working fine when i tried to load this column of the table with summ value.

Please let me know how to use APT_DISABLE_COMBINATION environment variable .

the stage is a transformer but i dint move the column from tthe table to output of transformer. then where do i get the need to use null handling functions .

balajisr wrote:You have not handled null in the field 'LAST_UPDATE_DATE'.

Set APT_DISABLE_COMBINATION environment variable to true to find out in which stage of the job the error occurs. If the stage is a transformer then you have lot of null handling functions available. Refer the manual for null handling functions.
Shivaranjani
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

Are you using the field 'LAST_UPDATE_DATE' in the transformer?

If so, post the derivation in which you had used the above field.
G SHIVARANJANI
Participant
Posts: 137
Joined: Sun Jan 07, 2007 11:17 pm
Location: VISAKHAPATNAM

Post by G SHIVARANJANI »

i am not using. it any where.

i ll change the query.

balajisr wrote:Are you using the field 'LAST_UPDATE_DATE' in the transformer?

If so, post the derivation in which you had used the above field.
Shivaranjani
G SHIVARANJANI
Participant
Posts: 137
Joined: Sun Jan 07, 2007 11:17 pm
Location: VISAKHAPATNAM

do not understand why this problem occurs

Post by G SHIVARANJANI »

When theres null value in one of the column in a table. when that column value is used any transformer or any other stage.

the row which has null value in a column is being dropped.

please help
Shivaranjani
vikasjawa
Participant
Posts: 13
Joined: Tue Aug 29, 2006 3:20 am
Location: Gurgaon

Re: do not understand why this problem occurs

Post by vikasjawa »

Hi
Just try setting the nullable property of the cloumn to "Yes".Hope so this would work.
Vikas Jawa
G SHIVARANJANI
Participant
Posts: 137
Joined: Sun Jan 07, 2007 11:17 pm
Location: VISAKHAPATNAM

Re: do not understand why this problem occurs

Post by G SHIVARANJANI »

I have put up that as well


vikasjawa wrote:Hi
Just try setting the nullable property of the cloumn to "Yes".Hope so this would work.
Shivaranjani
Minhajuddin
Participant
Posts: 467
Joined: Tue Mar 20, 2007 6:36 am
Location: Chennai
Contact:

Post by Minhajuddin »

Can you give us the design of the job, It would make the task of fixing up this warning easier.

But, My guess is that you are using this column --> 'LAST_UPDATE_DATE' somewhere in your constraint or may be you have a column derivation which does not do the null handling or the nullable property set as No in one of the stages.

So, it would be easy to fix your warning if you could paste the exact constraint and the column derivation for this column.
Minhajuddin

<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
G SHIVARANJANI
Participant
Posts: 137
Joined: Sun Jan 07, 2007 11:17 pm
Location: VISAKHAPATNAM

Post by G SHIVARANJANI »

Hi,

It worked fine when gave the query as:

SELECT

NVL(TO_CHAR(TRUNC(LAST_UPDATE_DATE),'YYYYMMDD'),' ') LAST_UPDATE_DATE

FROM

<<TABLE>>


Minhajuddin wrote:Can you give us the design of the job, It would make the task of fixing up this warning easier.

But, My guess is that you are using this column --> 'LAST_UPDATE_DATE' somewhere in your constraint or may be you have a column derivation which does not do the null handling or the nullable property set as No in one of the stages.

So, it would be easy to fix your warning if you could paste the exact constraint and the column derivation for this column.
Shivaranjani
Minhajuddin
Participant
Posts: 467
Joined: Tue Mar 20, 2007 6:36 am
Location: Chennai
Contact:

Post by Minhajuddin »

I don't think that's the right way to do it. Because you are passing a SPACE character (' ') when it is null. This would need you to put a logic which converts the SPACE into a null before it inserts into the target table.

If it's fine for you to have SPACES in your TARGET TABLE instead of NULLS then this thing would work. There are more elegant ways to do the same thing.
Minhajuddin

<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
G SHIVARANJANI
Participant
Posts: 137
Joined: Sun Jan 07, 2007 11:17 pm
Location: VISAKHAPATNAM

Post by G SHIVARANJANI »

Hi,

Actually i am moving the data from a table to a text file .so this leads to make it work.

Thankuu..


Minhajuddin wrote:I don't think that's the right way to do it. Because you are passing a SPACE character (' ') when it is null. This would need you to put a logic which converts the SPACE into a null before it inserts into the target table.

If it's fine for you to have SPACES in your TARGET TABLE instead of NULLS then this thing would work. There are more elegant ways to do the same thing.
Shivaranjani
Zhang Bo
Participant
Posts: 15
Joined: Sun Jul 15, 2007 9:22 pm

Re: Records Dropped

Post by Zhang Bo »

you should change both the input and output nullable to YES,and this warning must be removed
MaDFroG
G SHIVARANJANI
Participant
Posts: 137
Joined: Sun Jan 07, 2007 11:17 pm
Location: VISAKHAPATNAM

Re: Records Dropped

Post by G SHIVARANJANI »

Ok
I have done this.

thanku.
Zhang Bo wrote:you should change both the input and output nullable to YES,and this warning must be removed
Shivaranjani
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Re: do not understand why this problem occurs

Post by balajisr »

G SHIVARANJANI wrote:When theres null value in one of the column in a table. when that column value is used any transformer or any other stage.

the row which has null value in a column is being dropped.

please help
You mentioned in your previous post that you are not using the column anywhere. :?
Post Reply