converting shell scripts to datastage jobs

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
rajiivnb
Participant
Posts: 77
Joined: Fri Sep 10, 2004 8:38 am
Location: India

converting shell scripts to datastage jobs

Post by rajiivnb »

Hi,
My project requirement statement is as follows:
1.Existing project is in production with shell scripts and datastage job together,where the shell scripts talks with some complex queries and as initial process before the datastage jobs.Scripts written in unix talks more with the extraction phase.Production is happening with long time taken to complete the process
2.this exisiting shell scripts has to be converted to a datastage jobs such a way that time taken to be considerably less when compared to shell scripts .

Please someone suggest how will i go about initialize this process

Regards,
Raji
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

There is only one sensible way to go about this task.

1. Analyse what the shell script does. Under all circumstances.

2. Write this out as an set of target from source mappings.

3. Implement the same as one or more DataStage jobs.

Look for opportunities to optimize at each step in the above.

Since you've specified parallel as your job type, you might also examine opportunities to implement partition parallelism (see Parallel Job Developer's Guide) either through the PX engine's inbuild capabilities, or using multi-instance server jobs each acting on a subset of the data to be processed.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply