We have a job with three stages.
OracleConnector ->Copy->OracleConnector.
The job does a simple pull from Source. And in the target we INSERT the records with a DELETE statement defined in BeforeSQL Statement .
When I observe this particular job there is a log showing the configuration file. But this log is being shown after 30mins. (9:05:24 PM as shown in the below logs) Can someone help me understand what exactly is happening here? When I observe the other jobs with similar design this log is shown after 2-3secs maximum.
There are only 2000 records being fetched and deleted/inserted into the target. Even the other jobs which fetches more than 100,000 records is finished in less than 10mins. But the above job takes more than 40mins.
8:33:30 PM 12/16/2013 Environment variable settings: (...)
8:33:31 PM 12/16/2013 Parallel job initiated
8:33:31 PM 12/16/2013 Parallel job default NLS map ISO-8859-1, default locale OFF
8:33:32 PM 12/16/2013 main_program: IBM WebSphere DataStage Enterprise Edition 8.5.0.6152(...)
8:33:32 PM 12/16/2013 main_program: conductor uname: -s=AIX; -r=1; -v=6; -n=dsg1; -m=00F785DE4C00
8:33:32 PM 12/16/2013 main_program: orchgeneral: loaded(...)
8:33:34 PM 12/16/2013 SRC_ORACLE_STG: The connector connected to Oracle server PBWODS.
8:33:34 PM 12/16/2013 SRC_ORACLE_STG: The connector was configured to run in parallel mode on 2 nodes, but the partitioned reads were not enabled. The connector will run in sequential mode.
8:33:34 PM 12/16/2013 SRC_ORACLE_STG: The connector will run in sequential mode.
8:33:34 PM 12/16/2013 SRC_ORACLE_STG: The connector will use the following SELECT statement at runtime: SELECT(...)
8:33:35 PM 12/16/2013 TGT_ORACLE_STG: The connector connected to Oracle server PBWODS.
8:33:35 PM 12/16/2013 TGT_ORACLE_STG: The connector will run in parallel on 2 processing nodes.
9:05:24 PM 12/16/2013 main_program: APT configuration file: /fods/BW/PRD/dsg/IBM/InformationServer/Server/Configurations/default.apt
9:05:26 PM 12/16/2013 TGT_ORACLE_STG: The connector ran the specified Before SQL statement.