Page 1 of 1

Multi Instance job log message

Posted: Tue Mar 19, 2013 8:56 am
by suja.somu
There are 20 reference table (Sql server tables) that are to be loaded to 20 different datasets.
The table structures are different and all the tables are in the same database.


A single table may be required to be executed at the same time in different sequence jobs.
A table will be executed only once in a sequence.


Solution:

I have created one job to read from the table ( ODBC_Connector) to load into dataset, with no other stages in between . the column definition is not defined in ODBC stage and dataset. Turned on the multi instance property along with RCP.
For each run pass the table name and dataset name through parameter in sequence each time for 20 refernce tables.


Is this a workable solution?


Log message:

There is a info messge in log as below for each column in the table.

ODBC_EmpCodes: External schema field, name: SrcSysCode, type: INT16 was not found in the design schema
External schema field, name: SrcCode1, type: STRING was not found in the design schema


Are there any effects of this kind of message. Why is this appearing in the log? can anyone explain this ?

Posted: Tue Mar 19, 2013 9:22 am
by prasannakumarkk
this is a good solution and workable.
For the issue that you are facing can you post the structure of the table that is throwing warning,
and also In the odbc connector what is the character set that you have provided

Posted: Tue Mar 19, 2013 9:30 am
by suja.somu
I use the Generated SQL for the job.
The code page in the ODBC_connector stage is set to Default.
i am not able to see the character set property ? Where is this present?


This is not a warning message. this is an info.

For each run of a reference table, it gives info message for all the columns.

I am just curious to know about the informational message.

Posted: Tue Mar 19, 2013 9:41 am
by prasannakumarkk
what is the default code page ?
Please post a table that has SrcSysCode column

Posted: Tue Mar 19, 2013 10:23 am
by suja.somu
Different Code page options are : Default,Unicode, user-specified.
Selected Default.


From the manual:

Default means
"The connector expects the data to be in the code page of the engine operating system where the connector runs.
If a different code page is used, the connector converts the data. This value is the default. "

Not sure what is set for Operating System. DS runs on Windows.

SQL server table structure.

EmpCodes:
SrcSysCode smallint NOT NULL,
SrcCode1 varchar(25) NOT NULL,
SrcCode1Desc varchar(50) NOT NULL,
SrcCode2 varchar(25) NOT NULL,
SrcCode2Desc varchar(50) NOT NULL,
EffStartDt date NOT NULL,
EffEndDt date NOT NULL,
TgtSysCode smallint NOT NULL,
TgtCode1 varchar(25) NOT NULL,
TgtCode1Desc varchar(50) NOT NULL,
TgtCode2 varchar(25) NOT NULL,
TgtCode2Desc varchar(50) NOT NULL

PRIMARY KEY :
SrcSysCode ASC
SrcCode1 ASC,
SrcCode2 ASC,
TgtSysCode ASC,
TgtCode1 ASC,
TgtCode2 ASC

Posted: Tue Mar 19, 2013 9:42 pm
by suja.somu
can anyone help me to understand the director log ( information message) on all the columns of the table for the multi instance job.

Posted: Tue Mar 19, 2013 10:30 pm
by harishkumar.upadrasta
Hi Suja.somu,

Thats a message been given by Datastage as the Table definitions were not available during the design time, they were created at the run time as the RCP is been enabled. Hence you are seeing tha message. Its not a warning and its not going to impact your job.

Regards,
Harish

Posted: Mon Apr 01, 2013 3:53 pm
by suja.somu
Thanks a lot for all your help. I am marking this post as Resolved