Page 1 of 1

Replace simple px jobs by server jobs DS 7.5.2

Posted: Thu Nov 16, 2006 7:13 am
by kjaouhari
Hello all !

I have to replace PX jobs by server jobs. The PX jobs take long time. These jobs are very simple because they are just a copy of table from ORACLE to an other DB ORACLE.

My question is what is the best choice for replce these PX jobs ? I precise that we don't have PX but just DS server.

And do you think server jobs can run more quicky than PX jobs ?

Thanks in advance !

Posted: Thu Nov 16, 2006 7:40 am
by ray.wurlod
Server jobs start up more quickly than parallel jobs, even parallel jobs on a single-node configuration. But I don't think this is your issue. How are you loading the rows into the target table? That is, what write rule are you following? If they are all new (insert) rows, prefer to use a bulk loader.

Re: Replace simple px jobs by server jobs DS 7.5.2

Posted: Thu Nov 16, 2006 8:21 am
by chulett
kjaouhari wrote:My question is what is the best choice for replce these PX jobs ?
A DBA? Sounds like a simple exp and imp could be a better choice if there's no transformations going on. Or as Ray notes, sqlldr.

Posted: Thu Nov 16, 2006 12:42 pm
by vmcburney
We get so many server job to parallel job questions, this might be the first conversion the other way, are you completely dropping parallel edition? There is a summary in DataStage tip: What do you mean I need to optimise small jobs? You can add a config file job parameter to your job to restrict a small volume parallel job to just one node or you can replace it with a server job to reduce job start up time.

The Oracle change capture stage may help you synch these tables more efficiently.

Posted: Thu Nov 16, 2006 3:52 pm
by kjaouhari
Today, a parallel job can take 6 hours to load tables from oracle to oracle.
We want to drop the px jobs by the ds jobs. In fact there is no transformation between the source and the target.
The table are very big and contains lot of fields...

Posted: Thu Nov 16, 2006 4:23 pm
by ray.wurlod
It is almost certain that the fastest solution will involve Oracle to Oracle utilities, and not use DataStage at all.

Posted: Thu Nov 16, 2006 4:34 pm
by chulett
In other words, as noted before - pawn it off on your DBAs. :wink:

Posted: Thu Nov 16, 2006 7:19 pm
by vmcburney
Change data capture or replication between the databases so you don't have to move all the data every day. Both of these are not in the standard DataStage product though they are both options for the IBM Information Server along with DataStage 8.

Posted: Sun Nov 26, 2006 5:17 pm
by Chuah
kjaouhari wrote:Today, a parallel job can take 6 hours to load tables from oracle to oracle.
We want to drop the px jobs by the ds jobs. In fact there is no transformation between the source and the target.
The table are very big and contains lot of fields...
Hi,
If you can drop and create the target tables, then you can write simple SQL script to
1. Drop target tables
2. CREATE TABLE AS SELECT * FROM <SOURCE TABLE>
Add in the appropriate tablespace options if you must

but that's pretty fast and if your tables are partitioned even better.
This way you don't land the data onto disk first and write it to the database.

Chin