DSXchange

We have a requirement to strip some bad words from the input - replace the bad words with a '-'.

for bad words, we have a list of reguler expressions - We need to substitute these reguler expressions with a '-'.

Currently I have implemented a demo of it using external filterstage. But I was looking for something within DS which can do this.

Is there a way we can have reguler expressions replaced by another string.

search for "px version of ereplace" in dsxchange

or

Use basic transformer and use ereplace function.

If each bad word is a single character, then use CONVERT function in PX transformer stage.

You mean like 'F' and 'U'?

No, those ones would be replaced by something like "#@!&!"

Well the reguler expressions need to be replaced by '-' would be like below.

\bDAMN\s?|FART|----(ED|ER|ING|ME|S)\b
\b(HELL|HORNY|J(AC|ER)K-OFF|JI(SM|Z(M)?))\b
\b(MOTHA|MOTHER)?----(ER(S)?|IN(G)?)?\b

I am not familair with ereplace,going to try now.

HAs anyone else done regulerexpression repleacement in DS PX? Please let me know.

Use a BASIC transformer. BASIC transformer is available in a PX job. If you want to know more about BASIC transformer, search for it in the forum.

BTW, this is the meaning of regular expression replacement !!

Have you considered an External Filter stage that uses something like sed or awk commands/scripts?