Replace simple px jobs by server jobs DS 7.5.2

kjaouhari · Post by **kjaouhari** » Thu Nov 16, 2006 7:13 am

Hello all !

I have to replace PX jobs by server jobs. The PX jobs take long time. These jobs are very simple because they are just a copy of table from ORACLE to an other DB ORACLE.

My question is what is the best choice for replce these PX jobs ? I precise that we don't have PX but just DS server.

And do you think server jobs can run more quicky than PX jobs ?

Thanks in advance !

ray.wurlod · Post by **ray.wurlod** » Thu Nov 16, 2006 7:40 am

Server jobs start up more quickly than parallel jobs, even parallel jobs on a single-node configuration. But I don't think this is your issue. How are you loading the rows into the target table? That is, what write rule are you following? If they are all new (insert) rows, prefer to use a bulk loader.

chulett · Post by **chulett** » Thu Nov 16, 2006 8:21 am

kjaouhari wrote:My question is what is the best choice for replce these PX jobs ?

A DBA? Sounds like a simple exp and imp could be a better choice if there's no transformations going on. Or as Ray notes, sqlldr.

vmcburney · Post by **vmcburney** » Thu Nov 16, 2006 12:42 pm

We get so many server job to parallel job questions, this might be the first conversion the other way, are you completely dropping parallel edition? There is a summary in DataStage tip: What do you mean I need to optimise small jobs? You can add a config file job parameter to your job to restrict a small volume parallel job to just one node or you can replace it with a server job to reduce job start up time.

The Oracle change capture stage may help you synch these tables more efficiently.

kjaouhari · Post by **kjaouhari** » Thu Nov 16, 2006 3:52 pm

Today, a parallel job can take 6 hours to load tables from oracle to oracle.
We want to drop the px jobs by the ds jobs. In fact there is no transformation between the source and the target.
The table are very big and contains lot of fields...

ray.wurlod · Post by **ray.wurlod** » Thu Nov 16, 2006 4:23 pm

It is almost certain that the fastest solution will involve Oracle to Oracle utilities, and not use DataStage at all.

chulett · Post by **chulett** » Thu Nov 16, 2006 4:34 pm

In other words, as noted before - pawn it off on your DBAs.

vmcburney · Post by **vmcburney** » Thu Nov 16, 2006 7:19 pm

Change data capture or replication between the databases so you don't have to move all the data every day. Both of these are not in the standard DataStage product though they are both options for the IBM Information Server along with DataStage 8.

Chuah · Post by **Chuah** » Sun Nov 26, 2006 5:17 pm

kjaouhari wrote:Today, a parallel job can take 6 hours to load tables from oracle to oracle.
We want to drop the px jobs by the ds jobs. In fact there is no transformation between the source and the target.
The table are very big and contains lot of fields...

Hi,
If you can drop and create the target tables, then you can write simple SQL script to
1. Drop target tables
2. CREATE TABLE AS SELECT * FROM <SOURCE TABLE>
Add in the appropriate tablespace options if you must

but that's pretty fast and if your tables are partitioned even better.
This way you don't land the data onto disk first and write it to the database.

Chin

DSXchange

Replace simple px jobs by server jobs DS 7.5.2

Replace simple px jobs by server jobs DS 7.5.2

Re: Replace simple px jobs by server jobs DS 7.5.2