How to remove control M or special character by ds jobs

mayura · Post by **mayura** » Fri Aug 13, 2010 5:16 am

Hi,

We can remove the control m or special characters in UNIX scripts.. but
is there any way to remove the special characters coming in flat files from Datastage jobs?

ArndW · Post by **ArndW** » Fri Aug 13, 2010 5:51 am

Yes, there are various ways and which method is used depends upon how you read the files. Are the Control-M characters in strings in the job? If yes, then a simple Convert(Char(13),'',In.ColumnName) will do the trick.

sagar deshmukh · Post by **sagar deshmukh** » Fri Aug 13, 2010 5:54 am

You can use Tr command to remove control M character... in the before job subroutine....

You have to design your job accordingly

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Fri Aug 13, 2010 6:16 am

If ^M is at the end of the record, it may be due to DOS type record termination. Setting this property will handle it properly.

chulett · Post by **chulett** » Fri Aug 13, 2010 6:24 am

Sainath.Srinivasan wrote:If ^M is at the end of the record, it may be due to DOS type record termination. Setting this property will handle it properly.

This, typically. But as Arnd noted there are various ways so it really depends on the where and the what of it.

ray.wurlod · Post by **ray.wurlod** » Fri Aug 13, 2010 6:25 am

I expect you will end up setting the Record Delimiter String property to "DOS style".

kduke · Post by **kduke** » Fri Aug 13, 2010 8:58 am

FTP will also get rid of these if you transfer ascii instead of binary.

mayura · Post by **mayura** » Thu Aug 19, 2010 3:19 am

kduke wrote:FTP will also get rid of these if you transfer ascii instead of binary. ...

ok will try this and let u all know...

between thanks.. but keep posting new ideas for the same

chulett · Post by **chulett** » Thu Aug 19, 2010 5:29 am

Looks like plenty of ideas here already, you need to go implement now and let us know how things turn out.