DSPXWorkingDir error while compling a parallel job

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Simar
Participant
Posts: 19
Joined: Thu Jul 19, 2007 5:35 am

DSPXWorkingDir error while compling a parallel job

Post by Simar »

Hi Guys,

While compiling a simple parallel job i am getting error as follows:

-------------------------------------------------------------------------------------
Output from transformer compilation follows:

##I IIS-DSEE-TFCN-00001 04:59:40(000) <main_program>
IBM WebSphere DataStage Enterprise Edition 8.0.1.4468
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved



##I IIS-DSEE-TUTL-00031 04:59:40(001) <main_program> The open files limit is 1024; raising to 65535.
##I IIS-DSEE-TOSH-00002 04:59:41(000) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 04:59:41(001) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 04:59:41(002) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 04:59:41(005) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##W IIS-DSEE-TFTM-00012 04:59:41(007) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W IIS-DSEE-TFEV-00025 04:59:41(008) <transform> Error when checking composite operator: Converting string to decimal.
##W IIS-DSEE-TFEV-00023 04:59:41(009) <transform> Error when checking composite operator: Implicit conversion from source type "String" to result type "Decimal".
##E IIS-DSEE-TFEV-00026 04:59:41(010) <transform> Error when checking composite operator: Setting null to this non-nullable field: RUN_WEEK.
##E IIS-DSEE-TFSR-00019 04:59:41(011) <main_program> Could not check all operators because of previous error(s)
##E IIS-DSEE-TCOS-00029 04:59:41(012) <main_program> Creation of a step finished with status = FAILED. (transformer90.Transformer)
-------------------------------------------------------------------------------------

Please suggest something as soon as possible.

Thanks...!
Simar
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

You are setting Null to field RUN_WEEK which is actually non nullable and hence the error.
Simar
Participant
Posts: 19
Joined: Thu Jul 19, 2007 5:35 am

Thanks buddy....

Post by Simar »

I changed it accordingly and it worked, but this was working in previous DS versions.
This is something new which they have introduced in DS 8.0.

Thanks for your help...!

Simar
Simar
Simar
Participant
Posts: 19
Joined: Thu Jul 19, 2007 5:35 am

Re: Thanks buddy....

Post by Simar »

Hi...

The earlier worked fine for me and now i have similar kind of error in another job. I am using stage variables in this and also taken care for Null values.

Please help me on this if you can.

The error is as:
------------------------------------------------------------------------------------
Output from transformer compilation follows:

##I IIS-DSEE-TFCN-00001 05:06:46(000) <main_program>
IBM WebSphere DataStage Enterprise Edition 8.0.1.4468
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved



##I IIS-DSEE-TUTL-00031 05:06:46(001) <main_program> The open files limit is 1024; raising to 65535.
##I IIS-DSEE-TOSH-00002 05:06:46(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 05:06:46(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 05:06:46(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 05:06:46(007) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##W IIS-DSEE-TFTM-00012 05:06:47(000) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W IIS-DSEE-TFEV-00025 05:06:47(001) <transform> Error when checking composite operator: Possible range limitation.
##W IIS-DSEE-TFEV-00023 05:06:47(002) <transform> Error when checking composite operator: Implicit conversion from source type "Int32" to result type "Decimal".
##W IIS-DSEE-TFEV-00025 05:06:47(003) <transform> Error when checking composite operator: Possible range limitation.
##W IIS-DSEE-TFEV-00023 05:06:47(004) <transform> Error when checking composite operator: Implicit conversion from source type "Int32" to result type "Decimal".
##E IIS-DSEE-TFEV-00026 05:06:47(005) <transform> Error when checking composite operator: Setting null to this non-nullable field: StageVar0_FISCALMTHENDDT.
##E IIS-DSEE-TFSR-00019 05:06:47(006) <main_program> Could not check all operators because of previous error(s)
##E IIS-DSEE-TCOS-00029 05:06:47(007) <main_program> Creation of a step finished with status = FAILED. (jp_TR_Load_xref_line_amt_all.xref_line_amt_all_Transformer)
Simar
Raghavendra
Participant
Posts: 147
Joined: Sat Apr 30, 2005 1:23 am
Location: Bangalore,India

Post by Raghavendra »

Check the following message from your post::
Setting null to this non-nullable field: StageVar0_FISCALMTHENDDT
Simar
Participant
Posts: 19
Joined: Thu Jul 19, 2007 5:35 am

Post by Simar »

Hi,

Actually that is a stage variable and it is not having any property as nullable. But where that variable is maped with table, there already i have set it as Nullable 'YES'.

I am just picking data from sequential file and then using stage variable i am mapping one field from file to that stage variable and then mapping that stage variable to the table.

The code i am using for mapping from file to stage variable is as:

-------------------------------------------------------------------------------------
If Len(trim(xref_line_amt_all_FILE.FISCAL_MTH_END_DT))= 0 then SetNull() Else StringToDate(xref_line_amt_all_FILE.FISCAL_MTH_END_DT [1,4] : "-" : xref_line_amt_all_FILE.FISCAL_MTH_END_DT [5,2] : "-" :xref_line_amt_all_FILE.FISCAL_MTH_END_DT [7,2],"%yyyy-%mm-%dd")

where
xref_line_amt_all_FILE.FISCAL_MTH_END_DT is file column.

-------------------------------------------------------------------------------------

For the moment i have changed this code and removed the SetNull() part,
but if anytime nothing comes to file for this field, then the values inserted into table will be wrong.

If you can suggest anything on this?

Thanks...!
Simar
Raghavendra
Participant
Posts: 147
Joined: Sat Apr 30, 2005 1:23 am
Location: Bangalore,India

Post by Raghavendra »

Stage variables are not-nullable always and so you cannot use setnull function inside the stage variable. You may need to achieve setting null outside the stage variable.
Simar
Participant
Posts: 19
Joined: Thu Jul 19, 2007 5:35 am

Post by Simar »

Thanks...!

Thanks a lot Raghavendra.
Simar
Post Reply