Search found 8 matches

by maneesahmed
Tue Nov 28, 2006 4:30 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to track which ETL job is loading 1 particular DB table
Replies: 24
Views: 11923

narasimha wrote:Just curious. Did you try Usage Analysis, did it not help?
Hello Narasimha,

Unfortunately, We have not used the metadata defintions in manager.
So cannot use the same to track the job.

I think your suggestion should help incase we had the metadata defintion defined.


Thanks.
by maneesahmed
Tue Nov 28, 2006 4:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to track which ETL job is loading 1 particular DB table
Replies: 24
Views: 11923

There are several SQL statements which I have posted which should give you this. They are all based on stage types. Most of the plugins use custom stage types. The metadata is consistent across these. I have several jobs included in EtlStats which can extract this information and load it into table...
by maneesahmed
Tue Nov 28, 2006 3:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to track which ETL job is loading 1 particular DB table
Replies: 24
Views: 11923

How to track which ETL job is loading 1 particular DB table

Hello, We are facing one problem where we are not able to track the ETL job which is populating data into one particular oracle table. We have close to 500-600 ETL jobs and it is time consuming to go thru each of the job to find out which job is actually populating data into the table. Is there any ...
by maneesahmed
Thu Oct 19, 2006 2:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Server Job - Performance Issue
Replies: 15
Views: 8392

performance

It ran fine for intial loads because, it was an initial load which is to say that your table was empty and all were inserts. But, as your table grows eventually, it will perform Insert else Update action for every row which is why it will take longer. Even the current load is a initial load as we h...
by maneesahmed
Thu Oct 19, 2006 2:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Server Job - Performance Issue
Replies: 15
Views: 8392

Peformance

That is where your problem is. It's always better to seperate inserts and updates (via two seperate links) to load data into table rather than doing it through a single link. They usually(no..not usually..I would rather say always) take long(in fact very very long) times and even worse as the table...
by maneesahmed
Thu Oct 19, 2006 2:34 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Server Job - Performance Issue
Replies: 15
Views: 8392

kris007 wrote:What is your Update action set to? Is it just inserts or Updates/Inserts?
It is set to "Insert New Rows or Update Existing"
by maneesahmed
Thu Oct 19, 2006 2:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Server Job - Performance Issue
Replies: 15
Views: 8392

Performance Issue

This happened to me in DB2 and the reason for me was that i was getting lots of warnings. The job took hours to write those warnings. these warnings are because of load to the table... data issues..metadata mismatch.. try and find the log file. Thanks for the reply, I checked the DSTG job log and f...
by maneesahmed
Thu Oct 19, 2006 2:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Server Job - Performance Issue
Replies: 15
Views: 8392

DataStage Server Job - Performance Issue

Hello, We are using Peoplesoft EPM delivered ETL jobs for loading data from PeopleSoft OLTP table to the Staging area table on Oracle 10g. DataStage Version : 7.5 OS : HP-UNIX Job follows CRC logic to load the data. Since this is the initial load there is nothing much happening on the CRC front. Job...