Lookup in a Grid environment
Posted: Wed Sep 10, 2008 7:14 am
Hi,
We are working in a DataStage Grid environment with multiple compute nodes. We came across a situation that worked unexpectedly.
We run a job using 2 compute nodes and 2 partitions each. The job works as expected. The lookup to an Oracle table fetches correct reference data.
When we run the same same job with 5 compute nodes, the lookup returns null value for all the incoming records.
The Lookup stage has both the input links Hash partitioned on the key column.
Could anyone suggest what could cause a lookup not to work when increasing the compute nodes.
Thanks.
We are working in a DataStage Grid environment with multiple compute nodes. We came across a situation that worked unexpectedly.
We run a job using 2 compute nodes and 2 partitions each. The job works as expected. The lookup to an Oracle table fetches correct reference data.
When we run the same same job with 5 compute nodes, the lookup returns null value for all the incoming records.
The Lookup stage has both the input links Hash partitioned on the key column.
Could anyone suggest what could cause a lookup not to work when increasing the compute nodes.
Thanks.