DSXchange

We have created a Datastage parallel job to remove junk characters from a sequential file and load data into Netezza table.

We are able to remove the Junk Characters using Basic transformer using Convert and Oconv function.

But we think that the Basic transformer might create a perfomance issue.

So can anyone suggest an alternative solution to remove junk character using parallel transformer or anything else.

check this
viewtopic.php?t=120691

Make very sure that they're junk! Don't assume anything.

We have confirmed that these characters are control characters.

When you say 'control characters' - what do you mean exactly? (newline characters? tabs?) Examples please.

Control characters like ^A,^Z...etc should get removed.

The control characters having Ascii values like "\000\001\002\003\004\005\006\007\010\011\013\014\015\016\017\020\021\022\023\024\025\026\027\030\031\032\033\034\035\036\037\177\377"
should get reomoved from the input field.