Could not map table file "/PX_Scratch/PX_Scratch1/looku

[satheesh_color]

Hi All,

I have a problem with one of my parallel jobs..It ran fine for the past couple of years..We run the jobs through third party scheduling tool..We have enough space at the below specified path..Today it aborted with the below error:

Job Design:


OracleStg
|
SrcStg----->LkpStg----->AggStg--->OraStg--->SortStg--->TgtOraStg

Error:

When binding output interface field "SrcFiled" to field "TgtField": Implicit conversion from source type "dfloat" to result type "decimal[38,10]": Possible range/precision limitation.
LookupProductFlags,0: Could not map table file "/PX_Scratch/PX_Scratch1/lookuptable.20071204.kdc5whc (size 30252000 bytes)": Not enough space (...)

17716 FATAL Tue Dec 4 04:47:56 2007
LookupProductFlags,0: The runLocally() of the operator failed.
17717 INFO Tue Dec 4 04:47:56 2007
LookupProductFlags,0: Input 0 consumed 889744 records.
17718 INFO Tue Dec 4 04:47:56 2007
LookupProductFlags,0: Output 0 produced 0 records. (...)
17719 FATAL Tue Dec 4 04:47:56 2007
LookupProductFlags,0: Operator terminated abnormally: runLocally did not return APT_StatusOk
17720 FATAL Tue Dec 4 04:47:56 2007
LookupProductFlags,1: Operator terminated abnormally: received signal SIGSEGV
17721 FATAL Tue Dec 4 04:47:56 2007
LookupProductFlags,2: Operator terminated abnormally: received signal SIGSEGV
17722 FATAL Tue Dec 4 04:47:56 2007
LookupProductFlags,0: Operator terminated abnormally: received signal SIGSEGV
17723 FATAL Tue Dec 4 04:47:57 2007
LookupProductFlags,3: Operator terminated abnormally: received signal SIGSEGV
17724 FATAL Tue Dec 4 04:48:02 2007
main_program: Unexpected exit status 1 (...)
17725 FATAL Tue Dec 4 04:48:02 2007
main_program: Step execution finished with status = FAILED.

When we ran the same job through DS Director it ran successfully.Please give me your thought on this issue.

[ArndW]

I would suggest that you check the log files to ensure that both the good and the bad run used the same APT_CONFIG file, I suspect that the didn't.

[satheesh_color]

Hi ArndW,

I checked both the log files..we use the same 4node configuration file..

Some more info from log

LookupProductFlags,0: Could not map table file "/PX_Scratch/PX_Scratch1/lookuptable.20071204.kdc5whc (size 30252000 bytes)": Not enough space
Error finalizing / saving table /dstage/tmp/dynLUT20611856c31cb.


Thanks,

[ArndW]

/dstage/tmp ran out of space. It might have been a one-off issue during the failed run, with other jobs using that same space.

[balajisr]

How big is your reference data? It seems that your reference data could not fit in memory.

Consider using join instead of lookup.