Filter stage not removing nulls

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
times29
Premium Member
Premium Member
Posts: 202
Joined: Mon Sep 22, 2008 3:47 pm

Filter stage not removing nulls

Post by times29 »

Hi,
i am doing this in filter stage payr_vblnr is not null and i am still getting nulls and i am doing trim in transformer as i can't do trim in filter stage

But when i run sql in oracle doing where trim(payr_vblnr) is not null it works gives me desire result

I did try putting constraint in transformer doing IsNotnull it don't work.

Please tell me what can i do in filter then
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

That would imply they're not nulls but rather empty strings. It works in Oracle because Oracle treats them as equivalent but DS does not. Try filtering for empty strings ('') or both and see if that works.
-craig

"You can never have too many knives" -- Logan Nine Fingers
times29
Premium Member
Premium Member
Posts: 202
Joined: Mon Sep 22, 2008 3:47 pm

Post by times29 »

i did try payr_vblnr is not null or payr_vblnr <>' ' but same result
srinivas.g
Participant
Posts: 251
Joined: Mon Jun 09, 2008 5:52 am

Post by srinivas.g »

Use below constraint in transformer

Not(isnull(<<column_name>>) and len(<<column_name>>)<>0
Srinu Gadipudi
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

times29 wrote:i did try payr_vblnr is not null or payr_vblnr <>' ' but same result
Unless that's a typo, there's a space between those two quotes in what you posted so that (a space) is what it is attempting to filter. Just use two quotes to represent the empty string.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply