Page 1 of 1

Contains Terminators option to handle newlines in Sequential

Posted: Fri Mar 20, 2009 1:13 pm
by Theenathayalan
Hi

I know how to handle newlines appearing inthe column datavalues in the seq. file stages in DS Server.

How to achieve this in DS parallel jobs Seq. file stage.

Is there anyother way to handle newlines in data.

Thanks
Theena

Posted: Fri Mar 20, 2009 4:19 pm
by ray.wurlod
Are the strings in which the newline characters appear quoted?

Posted: Sat Mar 21, 2009 11:51 am
by Theenathayalan
No..The strings are not quoted in the input...

I was able to handle it in Server jobs. The Seq. file has contains terminator option in the columns tab.

But I could not find it in Parallel jobs.


Is this option present or any other option to acheive this?

Posted: Sat Mar 21, 2009 1:39 pm
by ray.wurlod
You could always use a server Sequential File stage in a server shared container in your parallel job.

Posted: Sun Mar 22, 2009 7:06 pm
by Theenathayalan
Ok..Thanks..Will try that..

Is there any other option to handle newlines in the input columns in the file data in parallel jobs....


Thank you

Posted: Mon Mar 23, 2009 12:25 am
by ray.wurlod
None of which I am aware. Others may educate us.

Re: Contains Terminators option to handle newlines in Sequen

Posted: Mon Mar 23, 2009 1:55 am
by Pagadrai
Hi,
What are your column and row delimiter values.?
If they are other than new line character, I think you can handle
new line values in columns easily.
Do let us know.

Posted: Mon Mar 23, 2009 4:04 am
by sima79
As Pagadrai mentioned, you will need to alter your record delimiter. This usually means altering the process that creates your sequential file. You may not have the ability to change the format. If you do choose an ascii character for your record delimiter that is unlikely to occur in your data e.g. Char(204).

Posted: Mon Mar 23, 2009 12:55 pm
by Theenathayalan
Hi..

The column delimiter is ~
The row delimiter is unix newline character.

Some columns are text columns that contains newlines as datavalue.

Actually we are redesigning our server jobs to parallel jobs.
Server jobs - Sequential file has "Contains terminator option" which is being used.

Parallel jobs - Seq. stage does not have this option.

We cannot ask the source system to change the row delimiter.

Posted: Mon Mar 23, 2009 3:15 pm
by chulett
You don't need to. However, you should ask the source system to properly quote any string values.