Performace Issue

[ntr]

Hi all,

Thanks for giving the qick response.

I am facing the performance issuse in datastage 8.5 parallel.
Can any one guide me.

When i am runnung a job in datastage it is taking 10.37 mins.
I want to reduce it.
In my job i am reading a .Dat file using External source Stage it is having 97000 records.After that i am conerting the file into Columns in transformer and then i am using Shared Container,Inside the shared Container i am using 11 transformers and 6 oracle databases and one Stored Procedure Stages.
When i am running with 100 records it is taking 1 min .
But when i try to run it with all the records it is taking around 10.30hrs.
Why it was taking this much of time.This the first part of job i want to take another 3 Shaed containers along with stored procedures.

Can any one guide me how i can reduce the running time.
How i can i resolve the issue?

Thanks ,
NTR

[chulett]

So 10 minutes or 10 hours? And what exactly are you doing in the shared container with those 11 transformers and 6 Oracle stages?

[ray.wurlod]

You could change the system clock while the job is running.

You really have not provided enough information to attempt cogent diagnosis - we have no idea what you are trying to do with those Transformers and Oracle connections, nor whether you're doing it efficiently. Nor even why you want to introduce more shared containers - to do what?

The more processing you add to a job, the longer it will take (all else being equal). Maybe you could try executing on more nodes.

[ntr]

Hai It is 10 hrs.

i am doing error validation and some lookup in side.

[chulett]

I don't know about Ray but I was hoping for a wee bit more detail than that.

[qt_ky]

Without knowing much detail, I would suggest making a copy of the job/shared container. Remove the stored procedure call and see how long the job takes. Start narrowing it down from there.