Multi Instance job log message

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
suja.somu
Participant
Posts: 79
Joined: Thu Feb 07, 2013 10:51 pm

Multi Instance job log message

Post by suja.somu »

There are 20 reference table (Sql server tables) that are to be loaded to 20 different datasets.
The table structures are different and all the tables are in the same database.


A single table may be required to be executed at the same time in different sequence jobs.
A table will be executed only once in a sequence.


Solution:

I have created one job to read from the table ( ODBC_Connector) to load into dataset, with no other stages in between . the column definition is not defined in ODBC stage and dataset. Turned on the multi instance property along with RCP.
For each run pass the table name and dataset name through parameter in sequence each time for 20 refernce tables.


Is this a workable solution?


Log message:

There is a info messge in log as below for each column in the table.

ODBC_EmpCodes: External schema field, name: SrcSysCode, type: INT16 was not found in the design schema
External schema field, name: SrcCode1, type: STRING was not found in the design schema


Are there any effects of this kind of message. Why is this appearing in the log? can anyone explain this ?
prasannakumarkk
Participant
Posts: 117
Joined: Wed Feb 06, 2013 9:24 am
Location: Chennai,TN, India

Post by prasannakumarkk »

this is a good solution and workable.
For the issue that you are facing can you post the structure of the table that is throwing warning,
and also In the odbc connector what is the character set that you have provided
Thanks,
Prasanna
suja.somu
Participant
Posts: 79
Joined: Thu Feb 07, 2013 10:51 pm

Post by suja.somu »

I use the Generated SQL for the job.
The code page in the ODBC_connector stage is set to Default.
i am not able to see the character set property ? Where is this present?


This is not a warning message. this is an info.

For each run of a reference table, it gives info message for all the columns.

I am just curious to know about the informational message.
prasannakumarkk
Participant
Posts: 117
Joined: Wed Feb 06, 2013 9:24 am
Location: Chennai,TN, India

Post by prasannakumarkk »

what is the default code page ?
Please post a table that has SrcSysCode column
Thanks,
Prasanna
suja.somu
Participant
Posts: 79
Joined: Thu Feb 07, 2013 10:51 pm

Post by suja.somu »

Different Code page options are : Default,Unicode, user-specified.
Selected Default.


From the manual:

Default means
"The connector expects the data to be in the code page of the engine operating system where the connector runs.
If a different code page is used, the connector converts the data. This value is the default. "

Not sure what is set for Operating System. DS runs on Windows.

SQL server table structure.

EmpCodes:
SrcSysCode smallint NOT NULL,
SrcCode1 varchar(25) NOT NULL,
SrcCode1Desc varchar(50) NOT NULL,
SrcCode2 varchar(25) NOT NULL,
SrcCode2Desc varchar(50) NOT NULL,
EffStartDt date NOT NULL,
EffEndDt date NOT NULL,
TgtSysCode smallint NOT NULL,
TgtCode1 varchar(25) NOT NULL,
TgtCode1Desc varchar(50) NOT NULL,
TgtCode2 varchar(25) NOT NULL,
TgtCode2Desc varchar(50) NOT NULL

PRIMARY KEY :
SrcSysCode ASC
SrcCode1 ASC,
SrcCode2 ASC,
TgtSysCode ASC,
TgtCode1 ASC,
TgtCode2 ASC
suja.somu
Participant
Posts: 79
Joined: Thu Feb 07, 2013 10:51 pm

Post by suja.somu »

can anyone help me to understand the director log ( information message) on all the columns of the table for the multi instance job.
harishkumar.upadrasta
Participant
Posts: 18
Joined: Tue Dec 25, 2012 10:39 pm
Location: Detroit,MI

Post by harishkumar.upadrasta »

Hi Suja.somu,

Thats a message been given by Datastage as the Table definitions were not available during the design time, they were created at the run time as the RCP is been enabled. Hence you are seeing tha message. Its not a warning and its not going to impact your job.

Regards,
Harish
Harish
suja.somu
Participant
Posts: 79
Joined: Thu Feb 07, 2013 10:51 pm

Post by suja.somu »

Thanks a lot for all your help. I am marking this post as Resolved
Post Reply