Dropping component and No Default Conversion

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
manuel.gomez
Premium Member
Premium Member
Posts: 291
Joined: Wed Sep 26, 2007 11:23 am
Location: Madrid, Spain

Dropping component and No Default Conversion

Post by manuel.gomez »

Hello everybody,

I do have a following the below schema:

Code: Select all

ODBC ----> Transformer------>Join------>Destination
                                               |
                                               |
                                               |
                                               |
                                            SeqFile
(the draw is not getting as I am writing it, the SeqFile is connected to the Join stage, not the ODBC)

I am having two problems here:

First one, error when writing in destination (seq file):
SIEACM24: Error when checking operator: When binding input interface field "FECHA_INI_ACM_CIF" to field "FECHA_INI_ACM_CIF": No default type conversion from type "date" to type "string[max=23]".
Error when checking operator: When binding input interface field "FECHA_FIN_ACM_CIF" to field "FECHA_FIN_ACM_CIF": No default type conversion from type "date" to type "string[max=23]".
The field is coming from the SeqFile, that is created in a previous job. Its a query coming from a ODBC Enterprise, then a Transformer do all transformation (no nulls, and timestamps and dates are converted to strings). I had to modify this job, so in its first execution, was not doing these transformations (so the fields were passed to the seqfile as dates)

PROBLEM2 (and I think this is the cause for everything)
Join: When checking operator: Dropping component "FECHA_INI_ACM_CIF" because of a prior component with the same name.
This column is read from the ODBC, but left behind in the following transformer. Then, in Join, a column with same name is coming from SeqFile.

Before you shout on me to search the forum: RCP is disabled in my project.
Knowing this, how is it possible the column from the ODBC is reaching the Join stage?

Thanks very much!!!!
Last edited by manuel.gomez on Thu Oct 02, 2008 5:08 am, edited 2 times in total.
Top
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Contact ray.wurlod

Post by ray.wurlod »

You can wrap your drawing in Code tags to preserve spacing.

Can you please post the generated OSH for this job? It may help to solve your issue.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Top
manuel.gomez
Premium Member
Premium Member
Posts: 291
Joined: Wed Sep 26, 2007 11:23 am
Location: Madrid, Spain

Post by manuel.gomez »

ray.wurlod wrote:You can wrap your drawing in Code tags to preserve spacing.
Now the SeqFile is at the end, hahahah

Here you have my generated OSH, I cant find the problem within this column in here, lets hope you are luckier (or better said, smarter than me!)

Code: Select all

#################################################################
#### STAGE: ODBC_Connector_0
## Operator
pxbridge
## Operator options
-XMLProperties '<?xml version=\'1.0\' encoding=\'UTF-16\'?><Properties version=\'1.0\'><Common><Context type=\'int\'>1</Context><Variant type=\'string\'>3.5</Variant><DescriptorVersion type=\'string\'>1.0</DescriptorVersion><PartitionType type=\'int\'>-1</PartitionType></Common><Connection><DataSource modified=\'1\' type=\'string\'><![CDATA[[&"NOVA.ODBC_NAME"]]]></DataSource><Username modified=\'1\' type=\'string\'><![CDATA[[&"NOVA.ODBC_USER"]]]></Username><Password modified=\'1\' type=\'string\'><![CDATA[[&"NOVA.ODBC_PASS"]]]></Password></Connection><Usage><GenerateSQL type=\'bool\'><![CDATA[0]]></GenerateSQL><EnableQuotedIDs type=\'bool\'><![CDATA[0]]></EnableQuotedIDs><SQL><SelectStatement collapsed=\'1\' modified=\'1\' type=\'string\'><![CDATA[SELECT 
	COFER_LISTA_CIFS.REF_OFERTA, 
	COFER_LISTA_CIFS.CIF, 
	COFER_DATOS_GRAL.COD_EST_OF, 
	COFER_LISTA_CIFS.FECHA_FIN, 
	COFER_LISTA_CIFS.FECHA_INI AS FECHA_INI_ACM_CIF, 
	COFER_LISTA_CIFS.FECHA_FIN AS FECHA_FIN_ACM_CIF
FROM
	dbo.COFER_LISTA_CIFS AS COFER_LISTA_CIFS
	INNER JOIN
	dbo.COFER_DATOS_GRAL AS COFER_DATOS_GRAL
		ON COFER_LISTA_CIFS.REF_OFERTA = COFER_DATOS_GRAL.REF_OFERTA]]><Tables collapsed=\'1\'><Table type=\'string\'><![CDATA[dbo.COFER_LISTA_CIFS]]></Table><Table type=\'string\'><![CDATA[dbo.COFER_DATOS_GRAL]]></Table></Tables><Parameters collapsed=\'1\'></Parameters><Columns collapsed=\'1\'><Column type=\'string\'><![CDATA[FECHA_FIN_ACM_CIF,FECHA_FIN,dbo.COFER_LISTA_CIFS]]></Column><Column type=\'string\'><![CDATA[FECHA_INI_ACM_CIF,FECHA_INI,dbo.COFER_LISTA_CIFS]]></Column><Column type=\'string\'><![CDATA[FECHA_FIN,FECHA_FIN,dbo.COFER_LISTA_CIFS]]></Column><Column type=\'string\'><![CDATA[COD_EST_OF,COD_EST_OF,dbo.COFER_LISTA_CIFS]]></Column><Column type=\'string\'><![CDATA[CIF,CIF,dbo.COFER_LISTA_CIFS]]></Column><Column type=\'string\'><![CDATA[REF_OFERTA,REF_OFERTA,dbo.COFER_LISTA_CIFS]]></Column></Columns></SelectStatement><EnablePartitioning collapsed=\'1\' type=\'bool\'><![CDATA[0]]></EnablePartitioning></SQL><Transaction><RecordCount type=\'int\'><![CDATA[2000]]></RecordCount><EndOfWave collapsed=\'1\' type=\'int\'><![CDATA[0]]></EndOfWave></Transaction><Session><IsolationLevel type=\'int\'><![CDATA[1]]></IsolationLevel><AutocommitMode type=\'int\'><![CDATA[0]]></AutocommitMode><ArraySize type=\'int\'><![CDATA[2000]]></ArraySize><SchemaReconciliation><FailOnSizeMismatch type=\'bool\'><![CDATA[1]]></FailOnSizeMismatch><FailOnTypeMismatch type=\'bool\'><![CDATA[1]]></FailOnTypeMismatch><FailOnCodePageMismatch type=\'bool\'><![CDATA[0]]></FailOnCodePageMismatch></SchemaReconciliation><PassLobLocator collapsed=\'1\' type=\'bool\'><![CDATA[0]]></PassLobLocator><CodePage collapsed=\'1\' type=\'int\'><![CDATA[0]]></CodePage></Session><BeforeAfter collapsed=\'1\' type=\'bool\'><![CDATA[0]]></BeforeAfter></Usage></Properties >'
-connector '{
   variant=3.5, 
   library=ccodbc, 
   version=1.0, 
   variantlist='3.5', 
   versionlist='1.0', 
   name=ODBCConnector
}'
-source 0 '{
      DSDescription={REF_OFERTA=\'\<none\>
Searchable\? N \', CIF=\'\<none\>
Searchable\? N \', COD_EST_OF=\'\<none\>
Searchable\? N \'}, 
      DSIsKey={REF_OFERTA=1, CIF=1}, 
      DSDisplayWidth={REF_OFERTA=12, CIF=13, COD_EST_OF=2}, 
      DSSQLType={REF_OFERTA=2, CIF=12, COD_EST_OF=12, FECHA_FIN=9, FECHA_INI_ACM_CIF=9, FECHA_FIN_ACM_CIF=9}, 
      DSSQLPrecision={REF_OFERTA=10, CIF=13, COD_EST_OF=2, FECHA_FIN=10, FECHA_INI_ACM_CIF=10, FECHA_FIN_ACM_CIF=10}, 
      DSSchema=\'record
         (
           REF_OFERTA\:decimal\[10\,0\]\;
           CIF\:ustring\[max\=13\]\;
           COD_EST_OF\:ustring\[max\=2\]\;
           FECHA_FIN\:nullable date\;
           FECHA_INI_ACM_CIF\:nullable date\;
           FECHA_FIN_ACM_CIF\:nullable date\;
         )\'
}'
   

## General options
[ident('ODBC_Connector_0'); jobmon_ident('ODBC_Connector_0')]
## Outputs
0> [] 'ODBC_Connector_0:dt_in.v'
;

#################################################################
#### STAGE: T1
## Operator
transform
## Operator options
-flag run
-name 'V0S1_SIEAcM024_T1'

## General options
[ident('T1'); jobmon_ident('T1')]
## Inputs
0< [] 'ODBC_Connector_0:dt_in.v'
## Outputs
0> [] 'T1:est_bo.v'
;

#################################################################
#### STAGE: T2
## Operator
transform
## Operator options
-flag run
-name 'V0S7_SIEAcM024_T2'

## General options
[ident('T2'); jobmon_ident('T2')]
## Inputs
0< [] 'Lookup1:cifs_acm.v'
## Outputs
0> [] 'T2:cif_err.v'
;

#### STAGE: Join.ges_Part
## Operator
entire
## General options
[ident('Join.ges_Part')]
## Inputs
0< [] 'Gestores:ges.v'
## Outputs
0> [] 'Gestores:ges_Part.v'
;

#################################################################
#### STAGE: Join
## Operator
innerjoin
## Operator options
-key 'CIF'
-key 'REF_OFERTA'

## General options
[ident('Join'); jobmon_ident('Join')]
## Inputs
0< [] 'T2:cif_err.v'
1< [] 'Gestores:ges_Part.v'
## Outputs
0> [-pp] 'Join:out.v'
;

#################################################################
#### STAGE: Gestores
## Operator
import
## Operator options
-schema record
  {final_delim=end, delim='|', quote=none}
(
  REF_OFERTA:string[max=12];
  CIF:string[max=13];
  COD_GESTOR:string[max=10];
  NB_GESTOR:string[max=30];
  COD_AGENCIA:ustring[max=10];
  NB_AGENCIA:string[max=50];
  COD_TERR:ustring[max=2];
  NB_TERR:string[max=50];
  COD_EST_OF:string[max=2];
  IN_ANEXOS:string[max=2];
  EST_PRO:string[max=2];
  FECHA_INI_ACM:string[max=23];
  FECHA_FIN_ACM:string[max=23];
  FECHA_INI_ACM_CIF:string[max=23];
  FECHA_FIN_ACM_CIF:string[max=23];
)
-file  'Arbol_Gestores.txt'
-rejects continue
-reportProgress yes

## General options
[ident('Gestores'); jobmon_ident('Gestores')]
## Outputs
0> [] 'Gestores:ges.v'
;

#### STAGE: Join2.ges_cifcab_Part
## Operator
entire
## General options
[ident('Join2.ges_cifcab_Part')]
## Inputs
0< [] 'Gestores_Cif_Cab:ges_cifcab.v'
## Outputs
0> [] 'Gestores_Cif_Cab:ges_cifcab_Part.v'
;

#################################################################
#### STAGE: Join2
## Operator
innerjoin
## Operator options
-key 'REF_OFERTA'

## General options
[ident('Join2'); jobmon_ident('Join2')]
## Inputs
0< [] 'Join:out.v'
1< [] 'Gestores_Cif_Cab:ges_cifcab_Part.v'
## Outputs
0> [-pp; modify (
  COD_GESTOR_CIF_CAB:not_nullable string[max=10]=COD_GESTOR_CIF_CAB;
  COD_AGENCIA_CIF_CAB:not_nullable ustring[max=10]=COD_AGENCIA_CIF_CAB;
  COD_TERR_CIF_CAB:not_nullable ustring[max=2]=COD_TERR_CIF_CAB;
)] 'Join2:final.v'
;

#################################################################
#### STAGE: SIEACM24
## Operator
export
## Operator options
-schema record
  {final_delim=end, delim='|', quote=none}
(
  REF_OFERTA:string[max=12];
  CIF:string[max=13];
  COD_GESTOR:string[max=10];
  NB_GESTOR:string[max=30];
  COD_AGENCIA:ustring[max=10];
  NB_AGENCIA:string[max=50];
  COD_TERR:ustring[max=2];
  NB_TERR:string[max=50];
  COD_EST_OF:string[max=2];
  IN_ANEXOS:string[max=2];
  EST_PRO:string[max=2];
  FECHA_INI_ACM:string[max=23];
  FECHA_FIN_ACM:string[max=23];
  FECHA_INI_ACM_CIF:string[max=23];
  FECHA_FIN_ACM_CIF:string[max=23];
  CIF_CAB:string[max=13];
  COD_GESTOR_CIF_CAB:string[max=10];
  NB_GESTOR_CIF_CAB:string[max=30];
  COD_AGENCIA_CIF_CAB:ustring[max=10];
  NB_AGENCIA_CIF_CAB:string[max=50];
  COD_TERR_CIF_CAB:ustring[max=2];
  NB_TERR_CIF_CAB:string[max=50];
)
-file '[&"BotesPath.Path"]SIEAcM024.txt'
-overwrite
-rejects continue
-firstLineColumnNames

## General options
[ident('SIEACM24'); jobmon_ident('SIEACM24')]
## Inputs
0< [] 'Join2:final.v'
;

#################################################################
#### STAGE: Gestores_Cif_Cab
## Operator
import
## Operator options
-schema record
  {final_delim=end, delim='|', quote=none}
(
  REF_OFERTA:string[max=12];
  CIF_CAB:string[max=13];
  COD_GESTOR_CIF_CAB:nullable string[max=10] {null_field=''};
  NB_GESTOR_CIF_CAB:string[max=30];
  COD_AGENCIA_CIF_CAB:nullable ustring[max=10] {null_field=''};
  NB_AGENCIA_CIF_CAB:string[max=50];
  COD_TERR_CIF_CAB:nullable ustring[max=2] {null_field=''};
  NB_TERR_CIF_CAB:string[max=50];
)
-file  'Arbol_Gestores_Cif_Cab.txt'
-rejects continue
-reportProgress yes

## General options
[ident('Gestores_Cif_Cab'); jobmon_ident('Gestores_Cif_Cab')]
## Outputs
0> [] 'Gestores_Cif_Cab:ges_cifcab.v'
;

#################################################################
#### STAGE: Lookup1
## Operator
lookup
## Operator options
-table
-key REF_OFERTA
-keep
-transfer_adapter 'transfer* renames REF_OFERTA as REF_OFERTA_BOTE'
-ifNotFound continue

## General options
[ident('Lookup1'); jobmon_ident('Lookup1')]
## Inputs
0< [] 'T1:est_bo.v'
1< [] 'RemDup:acm22.v'
## Outputs
0> [] 'Lookup1:cifs_acm.v'
;

#################################################################
#### STAGE: SIEACM22
## Operator
import
## Operator options
-schema record
  {final_delim=end, delim='|', quote=none}
(
  REF_OFERTA:ustring[max=12];
  CIF:ustring[max=13];
  COD_GESTOR:ustring[max=10];
  NB_GESTOR:ustring[max=30];
  COD_AGENCIA:ustring[max=10];
  NB_AGENCIA:ustring[max=50];
  COD_TERR:ustring[max=2];
  NB_TERR:ustring[max=50];
  COD_EST_OF:ustring[max=2];
  IN_ANEXOS:ustring[max=2];
  EST_PRO:ustring[max=2];
  FECHA_INI_ACM:ustring[max=23];
  FECHA_FIN_ACM:ustring[max=23];
  FECHA_INI_ACM_CIF:ustring[max=23];
  FECHA_FIN_ACM_CIF:ustring[max=23];
  CIF_CAB:ustring[max=13];
  COD_GESTOR_CIF_CAB:ustring[max=10];
  NB_GESTOR_CIF_CAB:ustring[max=30];
  COD_AGENCIA_CIF_CAB:ustring[max=10];
  NB_AGENCIA_CIF_CAB:ustring[max=50];
  COD_TERR_CIF_CAB:ustring[max=2];
  NB_TERR_CIF_CAB:ustring[max=50];
)
-file  '[&"BotesPath.Path"]SIEAcM022.txt'
-rejects continue
-reportProgress yes

## General options
[ident('SIEACM22'); jobmon_ident('SIEACM22')]
## Outputs
0> [] 'SIEACM22:in22.v'
;

#################################################################
#### STAGE: RemDup
## Operator
remdup
## Operator options
-keep first
-key 'REF_OFERTA'

## General options
[ident('RemDup'); jobmon_ident('RemDup')]
## Inputs
0< [] 'SIEACM22:in22.v'
## Outputs
0> [modify (
keep
  REF_OFERTA;
)] 'RemDup:acm22.v'
;
Top
manuel.gomez
Premium Member
Premium Member
Posts: 291
Joined: Wed Sep 26, 2007 11:23 am
Location: Madrid, Spain

Post by manuel.gomez »

Of course, if I remove the conflict columns from the source (although, I repeat, I "discard" them in the first transformer), the problem dissapears, but I would like to know why this is happening, when RCP is disabled for the project

Thanks again
Top
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:
Contact ArndW

Post by ArndW »

Check the stage output link to ensure that RCP is indeed turned off; perhaps this job was imported from a project where RCP was enabled.
Top
manuel.gomez
Premium Member
Premium Member
Posts: 291
Joined: Wed Sep 26, 2007 11:23 am
Location: Madrid, Spain

Post by manuel.gomez »

ArndW wrote:Check the stage output link to ensure that RCP is indeed turned off; perhaps this job was imported from a project where RCP was enabled.
ummm.....very interesting!!!!
Yes, the job was imported from an enabled RCP project

And the checkbox for RCP shows darkened (so that you cant edit it) but CHECKED!!!!
Top
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:
Contact ArndW

Post by ArndW »

export the job to a .dsx file and edit the RCP tag and re-import it.
Top
manuel.gomez
Premium Member
Premium Member
Posts: 291
Joined: Wed Sep 26, 2007 11:23 am
Location: Madrid, Spain

Post by manuel.gomez »

THANKS EVERYBODY!!!
Top
Gopinath
Participant
Posts: 52
Joined: Wed Apr 25, 2007 2:18 am
Location: Chennai

Post by Gopinath »

manuel.gomez wrote:Of course, if I remove the conflict columns from the source (although, I repeat, I "discard" them in the first transformer), the problem dissapears, but I would like to know why this is happening, when RCP is disabled for the project

Thanks again
Hi,

What is RCP and from where we need to take OSH for a Job.
Can u pls tell me..
Gopinath
Top
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Contact ray.wurlod

Post by ray.wurlod »

Welcome aboard. U (one of our participants) does not log in all that often, so it might be some time before U can tell you anything. Also, we do not hijack threads: please post a new topic in this forum.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Top
Post Reply

Return to “IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)”