Delimited v/s Fixed width files

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mc_harsha
Premium Member
Premium Member
Posts: 32
Joined: Mon Mar 06, 2006 5:44 am
Location: bangalore

Delimited v/s Fixed width files

Post by mc_harsha »

Hi,

I am having 6 million of records in the source file.

Which one (DELIMITED OR FIXED WIDTH) is better to use as a source?

Can you please provide me some insight(advanatages & disadvantages) regarding this?

thanks and regards,
MCH
harshakumar mc
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Fixed width is better in terms of being able to parse the contents, because substring is a far faster operation than scanning delimiters. Bulk loaders perform noticeably faster in a fixed-width regime, particularly where there are no VarChar fields in the table.

On the other hand, delimited can mean that you do not have to trim leading zeroes or trailing or leading space characters.

Like life, it's a compromise.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply