hi guys,
i got job like 1:1 mapping....
job is : oracle--->tranformar--->oracle
thier is no functions ,no tranformns ....in tranformer stage....
my question is with out tranformer can we use it....right.....
i tried with that one toooo....
their is know change in performace......
how can i increase the performace......
keep in mind ...i didnot use any calculations in all the stages,,,,,
performance
Moderators: chulett, rschirm, roy
-
Krazykoolrohit
- Charter Member
- Posts: 560
- Joined: Wed Jul 13, 2005 5:36 am
- Location: Ohio
performance
Hi RohitKrazykoolrohit wrote:include a sequential file stage in between . make your job design as follows:
oracle--->tranformer--->sequential file--->oracle
Can you please tell me how adding a sequential file stage will improve the performance?
Regards
Ashwin
-
Krazykoolrohit
- Charter Member
- Posts: 560
- Joined: Wed Jul 13, 2005 5:36 am
- Location: Ohio
it breaks the job flow into two. the first half of the job will execute first extracting all data from oracle table and loading it in the sequential file. then the sequential file is used to bulk load it into the oracle table.
Flowing data from one table to another is slow.
Hey! i forgot to ask. Are you using orabulk loader as the loading stage?
Flowing data from one table to another is slow.
Hey! i forgot to ask. Are you using orabulk loader as the loading stage?
-
Krazykoolrohit
- Charter Member
- Posts: 560
- Joined: Wed Jul 13, 2005 5:36 am
- Location: Ohio
it breaks the job flow into two. the first half of the job will execute first extracting all data from oracle table and loading it in the sequential file. then the sequential file is used to bulk load it into the oracle table.
Flowing data from one table to another is slow.
Hey! i forgot to ask. Are you using orabulk loader as the loading stage?
Flowing data from one table to another is slow.
Hey! i forgot to ask. Are you using orabulk loader as the loading stage?
-
suresh_dsx
- Participant
- Posts: 160
- Joined: Tue May 02, 2006 7:49 am
-
Krazykoolrohit
- Charter Member
- Posts: 560
- Joined: Wed Jul 13, 2005 5:36 am
- Location: Ohio
You will have to break your Job into two parts to achieve good performance.
Design your Job like this and see how much difference you will find.
It's always better to put a Transformer if you are designing your Job as
because the Compiler is going to put Tranformer if you are not. So, why not just put one in there.
And at last, if you are just moving data from one table into another table without doing any tranformatios why do you want to use DataStage.( Assuming you are only inserting data everytime).
If you want to acheive high speed with your current Job design you might want to play around with the array sizes in both source and target but that would be much lesser than what you would acheive with what Rohit and myself have suggested.
Code: Select all
Job 1 Oracle -> Transformer---->Sequentialfile
Job2 SequentialFIle--> Transformer---->>Oracle
It's always better to put a Transformer if you are designing your Job as
Code: Select all
Oracle---->Oracle
And at last, if you are just moving data from one table into another table without doing any tranformatios why do you want to use DataStage.( Assuming you are only inserting data everytime).
If you want to acheive high speed with your current Job design you might want to play around with the array sizes in both source and target but that would be much lesser than what you would acheive with what Rohit and myself have suggested.
Kris
Where's the "Any" key?-Homer Simpson
Where's the "Any" key?-Homer Simpson
Re: performance
If you dont have any transformation between the two oracle stages,suresh_dsx wrote: thier is no functions ,no tranformns ....in tranformer stage....
why not do a insert into oracle, outside Datastage?
Or you could use something like
Transformer ---> Oracle
Narasimha Kade
Finding answers is simple, all you need to do is come up with the correct questions.
Finding answers is simple, all you need to do is come up with the correct questions.