Substring in Filter

kittu.raja · Post by **kittu.raja** » Wed Feb 24, 2010 2:43 pm

Hi Everyone,

Can we use substring function in a filter.
Like in transformer column_name[1,6] = 7777

Can we do the same in a filter? If yes what is the syntax

Thanks in advance.

DSguru2B · Post by **DSguru2B** » Wed Feb 24, 2010 2:48 pm

I do not think that is possible in a filter stage. The filter stage only filters records, unmodified.

ray.wurlod · Post by **ray.wurlod** » Wed Feb 24, 2010 4:00 pm

One task, one stage.

The Filter stage filters.

If you need substring perform that in an upstream Modify or Transformer stage.

devo · Post by **devo** » Mon Mar 26, 2012 8:45 am

Is it possible to then do something like a SQL "LIKE" command?

mobashshar · Post by **mobashshar** » Mon Mar 26, 2012 9:25 am

Yes.. you can use LIKE condition in Filter

jwiles · Post by **jwiles** » Mon Mar 26, 2012 9:40 am

The filter option is calling an external command/script/program on the operating system. Therefore, you have whatever functionality is provided within that command/script/program.

Regards,

ray.wurlod · Post by **ray.wurlod** » Mon Mar 26, 2012 3:10 pm

I think they're talking about the Filter stage, James.

jwiles · Post by **jwiles** » Mon Mar 26, 2012 10:00 pm

Well I'll be darned...how'd I miss THAT?

qt_ky · Post by **qt_ky** » Tue Mar 27, 2012 4:42 pm

I'm not seeing where it says stage vs. seq. file option. vs. coffee, etc.