Filter Stage - Custom function

[myukassign]

I have the following flow...

Flat File -----------> Filter -------> remaining stages.

In flat file, I have a field product_id. I want to process only those records where the product_id is not null or blank.

I used the following statment in the where clause of a filter stage...

Trim(product_id)<>''

But job geting aborted compaling
"Expected comparison, 'between', or 'like' operator, got: "("
Parse error: Expected boolean operator (and, or) got: "product_id"."


Please help how can I use filter stage to do my job.

[ray.wurlod]

Move the trim to an upstream Transformer or Modify stage.

Of course, if you're going to use a Transformer stage, you can eliminate the Filter stage and use constraint expressions in the Transformer stage instead.

[myukassign]

Thanks ray...

I knew that option.... but I thought if I can avoid this costly transformer with a filter stage for this simple operation..... That prompted me to ask this...

I hope we cannot do that in filter right....

[Sainath.Srinivasan]

If you are so particular to use within filter then you can include multiple condition for each length possibility.

For example, if the field productId is of 2 char length, you can write

Code: Select all

If productId = '' Or productId = ' ' Or productId = '  ' 
   False Link
Otherwise
  True Link

You can try to pad the field with spaces from source and use a single full length blank check in filter.

[krishnuka123]

Should use transform stage in between flat file and filter stage and use below syntax.


Product_ID : If IsNull(product_id) then setNull() else trim(product_id)