FlatFile perfomance issue

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
myukassign
Premium Member
Premium Member
Posts: 238
Joined: Fri Jul 25, 2008 8:55 am

FlatFile perfomance issue

Post by myukassign »

I got a fixed length flat file. The file is too big. I would like to know which approach from the given below give bettr perfomance by datastage.#

Sample Line from file

AAA2008NEO
BBB2007RAM


Approach 1

Define 3 columns in the sequntial file stage and read data.
Col1 char(3)
Col2 Integer(4)
Col3 char(3)


Approach2

Define a single column in the sequntial file to take the entire line from the flatfile. Apply a transformer stage and break to 3 columns.
dineshrk
Participant
Posts: 46
Joined: Thu Jun 26, 2008 9:14 pm

Re: FlatFile perfomance issue

Post by dineshrk »

Use the transformer to break it up. It will increse your perfomance and more reliable.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Experiment. Your results may be different. What dineshrk has suggested might be true on one combination of hardware and not on another.
Post your results so that others can benefit.

Remember that it is Display Width that specifies the field width, not the data type.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Pierre
Participant
Posts: 66
Joined: Thu May 24, 2007 7:16 am
Location: Paris

Post by Pierre »

Ray is right, experiment.
We sometimes have surprises.
What seems better is sometimes worst. (and vice versa)

Pierre.
Post Reply