EE Lookup Stage VS Server Transformer

Nick_6789 · Post by **Nick_6789** » Wed Apr 11, 2007 9:21 pm

Hi Guys! Just a lil' curious.

Currently, my project involves utilizing server jobs.

The design is like this. I have a sequential file (main flow),

columns:

1) Customer ID
2) Name

and a lookup hash file (Which serves as independent lookup)

columns:

1) Area ID
2) Address

Utilizing a transformer to do output assignment, my hash file serves as an independent lookup, whereby it does not do any sort of key join with the main flow.

In the hashfile lookup flow, by the 'Address' column, I pre-input the value '56, Washington Street' in the Key Expression column.

What happens is, Area ID (Only related to 56 Washington Street), will be outputted into the output flow. Which means all records from the sequential file will eventually contain the Area ID pertaining to 56 Washington Street.

Can I perform the exact same independent lookup like the above with the 'Lookup Stage' in a parallel job? Or is lookup stage's function is to perform dependent lookups with main flows?

Please advice. Many thanks! =)[/img]

ray.wurlod · Post by **ray.wurlod** » Wed Apr 11, 2007 9:40 pm

Change your mindset. Parallel job philosophy is "one stage, one task". The Lookup stage performs lookups. It has no other function. If you want to pre-set the lookup key, do so in an upstream Column Generator stage.

Nick_6789 · Post by **Nick_6789** » Thu Apr 12, 2007 1:08 am

ray.wurlod wrote:Change your mindset. Parallel job philosophy is "one stage, one task". The Lookup stage performs lookups. It has no other function. If you want to pre-set the lookup key, do so in an upstream Colu ...

Hi Ray, Thanks for the feedback.

The reason asking this is because I am required to translate the server job design to parallel. I guess, that being too dependent on Server's limited stage availability, and coming to terms of fully utilizing one stage (particularly the transformer stage) to perform multiple tasks, I guess it takes getting used to to the parallel design.

Thanks for the advice though! =D

ray.wurlod · Post by **ray.wurlod** » Thu Apr 12, 2007 2:29 am

Enrol on the Server to Parallel Transition Lab offered by DCS Strategies (the company that funds this site).