DSXchange

Good afternoon DSXchangers,

Is it a red flag if I use 1 lookup stage to do multiple different lookups in terms of performance? I am essentially using one lookup stage instead of many lookup stages to do lookups against different tables.

The algorithm is simplified as below.

Stream ----Only LookUp Stage--Lookup Dates Dim Table -- Date Key
--Lookup One_Dim Table -- One Key
--Lookup Two_Dim Table --Two Key

I test with decent data volume and does not cause an issue data or performance wise so far.

Any input would be greatly appreciated.

Thank you!!

It depends on many factors ...How big is your reference data , How big is the memory ...How many processes are running at that time etc

Amuktamalyada wrote:I am essentially using one lookup stage instead of many lookup stages

That makes absolutely no difference.

Thanks Craig!!

If you find a need to lookup multiple rows in more than one reference link then those would need separate lookup stages.

Thanks Eric.