JOb Running for Hours
Moderators: chulett, rschirm, roy
JOb Running for Hours
Hi all,
Job is running for a long time
Orcale connector(source)-->aggregator--->transformer-->Orcale connector(Target)
source oracle connector consists of query using 4 tables joined based upon Join Keys.
Enabled partition=No, so the oracle connector is running in the sequentail Mode.
In aggregator 6 group by keys are present.Is there any way to improve the performance of Job by selecting Enabled partition=Yes or some other option?
Job is running for a long time
Orcale connector(source)-->aggregator--->transformer-->Orcale connector(Target)
source oracle connector consists of query using 4 tables joined based upon Join Keys.
Enabled partition=No, so the oracle connector is running in the sequentail Mode.
In aggregator 6 group by keys are present.Is there any way to improve the performance of Job by selecting Enabled partition=Yes or some other option?
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
@Thanks for the input
1)Target is key partition
2)I am running the JOb for 63 iterations using Loop activity in
Sequence.For each iteration the volume of input data is 50 Lakhs approximately
Clarification:1)Is select Enabled partition=YES and Hash partitioning will effect aggregator functionality?
2)Hash partitioning,oracle partitons,rowid are datastage partitions or oracle partitions?
1)Target is key partition
2)I am running the JOb for 63 iterations using Loop activity in
Sequence.For each iteration the volume of input data is 50 Lakhs approximately
Clarification:1)Is select Enabled partition=YES and Hash partitioning will effect aggregator functionality?
2)Hash partitioning,oracle partitons,rowid are datastage partitions or oracle partitions?
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
I think It will not affect the aggregator performance, as I have used the same in DB2. And for your 2nd point, hope this might help.
<corrected>
<corrected>
Thanx and Regards,
ETL User
ETL User
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
vamsi, I dont think that you'll be able to to do that.
If your query has multiple tables in it, then its difficult to achieve partitioned read.
But you can test it at your end by running the job and taking the driving table of your query for partitioned reads and match the count. Give it a try.
If your query has multiple tables in it, then its difficult to achieve partitioned read.
But you can test it at your end by running the job and taking the driving table of your query for partitioned reads and match the count. Give it a try.
Thanx and Regards,
ETL User
ETL User