parsing full file for a string

mahi_mahi · Post by **mahi_mahi** » Thu Apr 20, 2006 10:12 am

Hi All,
I have a requirement like this, I have a data file and lookup file
in datafile i have a field called file_name which is lenght of say 50

my reqmnt is to process each record from data-file and see
if any of the record from lookup file has the file_name, then that
record from data-file should be written in output example

data-file:
john
raam
Dev
rita

Lookup file
raajohnxyz
zaadasd
abcrita
asdfasd

my out-file should have below records
john
rita

coz rita john records from data-file are as substring in lookup file

One way of doing this in datastage is reading data-file as input and inside transformer I can call a routine and in that routine I can read look-up
file and return the indicator....let me know if anything better way to do
in datastage...am relatively new to this tool

Mahi

ratikmishra1 · Post by **ratikmishra1** » Thu Apr 20, 2006 10:30 am

if position and length of your file_name field in your lookup file is fixed, then you can build a has file.

then use the hash file in the transformer to do the existence check.

diamondabhi · Post by **diamondabhi** » Thu Apr 20, 2006 1:45 pm

Hashed file please.

mahi_mahi · Post by **mahi_mahi** » Thu Apr 20, 2006 2:21 pm

Thanks a lot for the response , How can i use hash file when portion of my lookp up file field matches with data-file field.....

Mahi

ray.wurlod · Post by **ray.wurlod** » Thu Apr 20, 2006 4:49 pm

Hashed file only does a whole-key match.
The solution to this can only be a grep for each name on the input stream, given that the "lookup file" is a file. If it's a database table, then a "LIKE" lookup might be possible, but via a Hashed File stage no.