Hi,
I am probably being dense (dont all shout at once) but have a simple job
read Seqfile A do lookup (lookup based on single key value, lookup data fed into lookup stage from Sequential file B) and wanted to do the lookup ONLY if A.FIELD <> something - but when building the expression the input columns option on the dropdown list was grey-out (other options, functions, DSMacro etc all fine and dandy)
Okay ladies and gents - what am I missing
Conditional Lookups where condition references an input col
Moderators: chulett, rschirm, roy
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
evening ray , yes there are input columns being fed into the lookup stage , this is a design rather than a runtime issue - just cant select input columns as an option from the dropdown
Actually sorted the functional issue with what is commonly known in UK as 'fudge' but in my never-ending quest for knowledge I would like to know why I cant use input columns in conditional expression, I blame myself for missing something , but again that is a UK thing
Actually sorted the functional issue with what is commonly known in UK as 'fudge' but in my never-ending quest for knowledge I would like to know why I cant use input columns in conditional expression, I blame myself for missing something , but again that is a UK thing
</a>I just tried a simple job to test this:
Seq File, one field called 'Key', input to Look Up.
Seq File, two fields called 'Key', 'Data', reference to Look Up.
Perform look up between field 'Key', outputting 'Key' from input link, and 'Data' from reference link.
When I try to add a Condition I can select 'Input Column' from the list, no problems.
I'm running 7.5.1A. Sorry this isn't any help. Can you hand type the condition including the input column link and name?
Ray, not sure if the idea about Sparse look-up holds true here because we're only dealing with Sequential File, not DB stage, and sparse is set up in the directly joining stage, not the look-up stage.
Seq File, one field called 'Key', input to Look Up.
Seq File, two fields called 'Key', 'Data', reference to Look Up.
Perform look up between field 'Key', outputting 'Key' from input link, and 'Data' from reference link.
When I try to add a Condition I can select 'Input Column' from the list, no problems.
I'm running 7.5.1A. Sorry this isn't any help. Can you hand type the condition including the input column link and name?
Ray, not sure if the idea about Sparse look-up holds true here because we're only dealing with Sequential File, not DB stage, and sparse is set up in the directly joining stage, not the look-up stage.
I think Arnd is probably on the right track with sparse/non-sparse.
A flat file lookup (or non-sparse database lookup) reads the entire lookup into memory. The lookup function will be very fast... no need for a condition.
In a sparse lookup (database), individual SELECT statements are issued to the database... a very expensive operation that would benefit from being conditional.
Mike
A flat file lookup (or non-sparse database lookup) reads the entire lookup into memory. The lookup function will be very fast... no need for a condition.
In a sparse lookup (database), individual SELECT statements are issued to the database... a very expensive operation that would benefit from being conditional.
Mike