sparse lookup-join
Posted: Fri Jun 17, 2011 2:09 am
Hi,
We have used sparse lookup in a job where the condition in the oracle stage is select value from table where lowsc<=orchestrate.sc and highsc>=orchestrate.sc.
So, i pass the field "value" to the output, based on the field sc from input .
Now, the job is failing with heap allocation error, and the ulimit is set to unlimited.
So, the only way is to change this condition to join.
Can anyone suggest, how we can do this in join, as this concept is conditional lookup.
Thanks!
We have used sparse lookup in a job where the condition in the oracle stage is select value from table where lowsc<=orchestrate.sc and highsc>=orchestrate.sc.
So, i pass the field "value" to the output, based on the field sc from input .
Now, the job is failing with heap allocation error, and the ulimit is set to unlimited.
So, the only way is to change this condition to join.
Can anyone suggest, how we can do this in join, as this concept is conditional lookup.
Thanks!