Need to reject only junk values

chulett · Post by **chulett** » Tue Jun 11, 2013 7:05 am

What are you considering "junk" or "special" characters? You probably just have a characterset issue.

ray.wurlod · Post by **ray.wurlod** » Tue Jun 11, 2013 2:31 pm

Do you have authority from the data owner arbitrarily to delete some of the characters in their data? (There are no "junk" characters.)

If the data owner needs to have particular characters removed, the "double Convert()" technique is recommended. Otherwise you have to work out how to process them.

m_mani87 · Post by **m_mani87** » Tue Jun 11, 2013 11:06 pm

open the file in vi editor,then type

:%s/^M//g

(To enter ^M, type CTRL+V, then CTRL+M)

This will remove the junk control M characters if it is present.
Then you can process the data in datastage

ray.wurlod · Post by **ray.wurlod** » Tue Jun 11, 2013 11:22 pm

Where did the question mention Ctrl-M?

ray.wurlod · Post by **ray.wurlod** » Tue Jun 11, 2013 11:23 pm

Can you please post the result of the AlNum() function on each of your five use cases?

ray.wurlod · Post by **ray.wurlod** » Wed Jun 12, 2013 2:39 pm

OK, here's how I would go about this provided I had my customer's imprimatur. Create a stage variable containing the characters you want to keep. Use the "double Convert" technique to remove all the others.

Code: Select all

Convert(Convert(svKeepChars, "", InLink.TheString), "", InLink.TheString)

sathyak098 · Post by **sathyak098** » Mon Jun 17, 2013 5:58 am

Thanks Ray.
It worked. Double convert is the perfect technique. hence marking as resolved

DSXchange

Need to reject only junk values

Re: Need to reject only junk values