Surrogate Key Perfromance
Posted: Thu Dec 17, 2009 1:57 pm
Hi All,
I have a job running for 28 minutes. Just wanted to check if some one can help me in tuning my job.
Job design looks like this :
Dataset - Lkp(with DB2) - Xfm - DB2
This job was taking less than a minute , after I had included the Surrogate key in the Transformer this takes 28 minutes.
Surrogate Key generation options:
1st Job) Created a job with
DB2stage SurrogateKeyGeneratorstage with following options:
SourceTYpe : File
KeySOurceUpdateAction: Create and Update
ExecutionMode: Sequential
This job has loaded :22365500 records. (keys have holes )
2nd Job) This is the one takes 28 minutes.
Initial value :0 ( It has to take the values from File)
In Blocks of = 1
Execution Mode : Parallel
The max value from the database is '573793419' , Its supposed to start from '573793420', but it starts from some30237,30283,30318 ( took 3 values as sample.) these values are not existing in the table.
Can some one throw some light , how to get my job run faster ?
I have a job running for 28 minutes. Just wanted to check if some one can help me in tuning my job.
Job design looks like this :
Dataset - Lkp(with DB2) - Xfm - DB2
This job was taking less than a minute , after I had included the Surrogate key in the Transformer this takes 28 minutes.
Surrogate Key generation options:
1st Job) Created a job with
DB2stage SurrogateKeyGeneratorstage with following options:
SourceTYpe : File
KeySOurceUpdateAction: Create and Update
ExecutionMode: Sequential
This job has loaded :22365500 records. (keys have holes )
2nd Job) This is the one takes 28 minutes.
Initial value :0 ( It has to take the values from File)
In Blocks of = 1
Execution Mode : Parallel
The max value from the database is '573793419' , Its supposed to start from '573793420', but it starts from some30237,30283,30318 ( took 3 values as sample.) these values are not existing in the table.
Can some one throw some light , how to get my job run faster ?