Remove new line character from modify stage

Sagnik Mukherjee · Post by **Sagnik Mukherjee** » Fri Nov 16, 2012 10:59 am

Hi,
I am using modify stage in a multiinstance job.Now in one field of the input file I get a new line character. For example - suppose the field name is 'ADDRESS1' and the data is populating like 'SOUDI ARAB'.
Now in between SOUDI and ARAB there is a new line character(not space).For that we are not getting correct data in output.

Now my question is how can we remove or trim new line character from modify stage.

ArndW · Post by **ArndW** » Fri Nov 16, 2012 11:21 am

I have to admit that I use the modify stage less and less over time. There is no reason not to use a transform stage and the CONVERT() function to solve this problem.

Sagnik Mukherjee · Post by **Sagnik Mukherjee** » Sat Nov 17, 2012 9:42 am

Actually I am using a multiinstance job. I have done all the transformation in modifyspec of modify stage.I cant use convert function in transformer as I pass everything at runtime.So I have to do it in modify stage only.
Please suggest.

ArndW · Post by **ArndW** » Sat Nov 17, 2012 9:48 am

In this case multi-instance jobs play no role.

If you can do it in a modify stage, then you can do it in a transform stage. Is the column name in question a known one or are you passing the name in as a parameter?

ray.wurlod · Post by **ray.wurlod** » Sat Nov 17, 2012 10:53 am

To answer the original question, the required Modify stage function is string_trim()

Sagnik Mukherjee · Post by **Sagnik Mukherjee** » Mon Nov 26, 2012 5:24 am

Sorry for my late reply.

Now I am using this :

AD_LINE_1_TX:string[max=40]=string_trim(AD_LINE_1_TX,"\n");

where AD_LINE_1_TX is th column name.

But it gives an error.

main_program: Error parsing modify adapter: Error in binding: Expected ')', got: ","
Expected destination field selector, got: ")"; input:
drop D,TS1,TS2,TS3,TS4,TIMESTAMP1,DATE1;MER_STRT_DT=D1;MER_END_DT=D2;AD_LINE_1_TX:string[max=40]=string_trim(AD_LINE_1_TX,"
");[/b]NOWARN

please suggest..

Sagnik Mukherjee · Post by **Sagnik Mukherjee** » Mon Nov 26, 2012 7:04 am

Now I am using this :

AD_LINE_1_TX:string[max=40]=string_trim["\n"](AD_LINE_1_TX)

and its working fine..

Thanks
:D

ray.wurlod · Post by **ray.wurlod** » Mon Nov 26, 2012 3:33 pm

So you didn't really need to send me a PM asking me to look at this.

I do not spend 24/7 logged in to DSXchange. Indeed, I probably only devote about 1 hour per day, maybe less on weekends.