SIGSEGV Issue Using Lookup Stage for Range Lookup

tgeorge · Post by **tgeorge** » Thu Mar 18, 2010 12:13 pm

Hello Everyone,

I am sorry to be asking about a SIGSEGV issue as I know the question has been asked many times because I used the search button. Unfortunately, I've not been able to find any help.

We are using DataStage 8.1. I am attempting to do a lookup using a range. The input file contains a number, an ID and two date columns (START and END date). The lookup file contains the number and ONE date. I would like to compare the number and START / END date from the input file to the number and a TRANSACTION date in the lookup file. I then want to pass through the corresponding ID from the source file.

All lookups are done using datasets. The datasets contain "not null" columns. I have no idea why this is not working, as it seems very basic to me and the SIGSEGV error is not helpful.

If anyone else has run into this before, please help! Thanks!

Vinothbaskaran · Post by **Vinothbaskaran** » Thu Mar 18, 2010 3:10 pm

use APT_DISABLE_COMBINATION parameter and set it to true in your job.

ray.wurlod · Post by **ray.wurlod** » Thu Mar 18, 2010 3:54 pm

Is there a large volume of reference data?

tgeorge · Post by **tgeorge** » Mon Mar 22, 2010 11:56 am

Yes, Ray, there is a very large volume of reference data.

ray.wurlod · Post by **ray.wurlod** » Mon Mar 22, 2010 1:40 pm

A Lookup stage needs to load the entire reference data set into memory. It would appear that you don't have enough memory for this. You need to re-think your design - perhaps load the reference data set into a database table and perform the BETWEEN join there.