Contains Terminators option to handle newlines in Sequential

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Theenathayalan
Participant
Posts: 15
Joined: Fri Jul 06, 2007 4:48 pm

Contains Terminators option to handle newlines in Sequential

Post by Theenathayalan »

Hi

I know how to handle newlines appearing inthe column datavalues in the seq. file stages in DS Server.

How to achieve this in DS parallel jobs Seq. file stage.

Is there anyother way to handle newlines in data.

Thanks
Theena
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Are the strings in which the newline characters appear quoted?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Theenathayalan
Participant
Posts: 15
Joined: Fri Jul 06, 2007 4:48 pm

Post by Theenathayalan »

No..The strings are not quoted in the input...

I was able to handle it in Server jobs. The Seq. file has contains terminator option in the columns tab.

But I could not find it in Parallel jobs.


Is this option present or any other option to acheive this?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You could always use a server Sequential File stage in a server shared container in your parallel job.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Theenathayalan
Participant
Posts: 15
Joined: Fri Jul 06, 2007 4:48 pm

Post by Theenathayalan »

Ok..Thanks..Will try that..

Is there any other option to handle newlines in the input columns in the file data in parallel jobs....


Thank you
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

None of which I am aware. Others may educate us.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Pagadrai
Participant
Posts: 111
Joined: Fri Dec 31, 2004 1:16 am
Location: Chennai

Re: Contains Terminators option to handle newlines in Sequen

Post by Pagadrai »

Hi,
What are your column and row delimiter values.?
If they are other than new line character, I think you can handle
new line values in columns easily.
Do let us know.
sima79
Premium Member
Premium Member
Posts: 38
Joined: Mon Jul 16, 2007 8:12 am
Location: Melbourne, Australia

Post by sima79 »

As Pagadrai mentioned, you will need to alter your record delimiter. This usually means altering the process that creates your sequential file. You may not have the ability to change the format. If you do choose an ascii character for your record delimiter that is unlikely to occur in your data e.g. Char(204).
Theenathayalan
Participant
Posts: 15
Joined: Fri Jul 06, 2007 4:48 pm

Post by Theenathayalan »

Hi..

The column delimiter is ~
The row delimiter is unix newline character.

Some columns are text columns that contains newlines as datavalue.

Actually we are redesigning our server jobs to parallel jobs.
Server jobs - Sequential file has "Contains terminator option" which is being used.

Parallel jobs - Seq. stage does not have this option.

We cannot ask the source system to change the row delimiter.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

You don't need to. However, you should ask the source system to properly quote any string values.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply