Sequential File - 2 Character Delimiter

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
nvalia
Premium Member
Premium Member
Posts: 180
Joined: Thu May 26, 2005 6:44 am

Sequential File - 2 Character Delimiter

Post by nvalia »

Hi All,

We have been trying to finalize the source extract delimiter but the source system seems to have most characters like | ~ and so on.

We were thinking of using Double Quotes around every field in all the extracts to take care of this issue there is a likely hood of even " (Double Quotes) being present in the data itself.

I know this is not an issue with Datastage per se but any ideas on how to handle this handle this scenario..

Is using 2 character combo as a delimiter an option, like Pipe and Tilde --> |~

We anticipate the biggest first full file to be 40-50 GB for the biggest one and then incremental extracts

Any known issue with this approach?

Thanks
NV
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Go with a fixed-width format instead of delimited.
Choose a job you love, and you will never have to work a day in your life. - Confucius
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

When the field delimiter has more than one character replace the Field Delimiter property with the Field Delimiter String property.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Nagac
Premium Member
Premium Member
Posts: 127
Joined: Tue Mar 29, 2011 11:39 am
Location: India

Post by Nagac »

You can go ahead with 2 characters as field delimiter. and follow Ray's suggestion.
Post Reply