DSXchange

Hi All,

We are facing an issue with lookup stage when running parallel job.

Earlear it ran fine. But recently we migrated from DS 7.5.1 to DS 7.5.3.

From then the problem has started.Please find the below error bessage what we got in our job.

Log:

main_program: APT configuration file: /product/datastage/Ascential/DataStage/Configurations/dwh.apt (...)
395 FATAL Wed Sep 30 04:41:25 2009
Lk_Rejets,0: Could not map table file "/data001_dwh/dataset/dwh/lookuptable.20090930.ozhqfrb (size 964718872 bytes)": Not enough space (...)
396 FATAL Wed Sep 30 04:41:25 2009
Lk_Rejets,0: The runLocally() of the operator failed.
397 INFO Wed Sep 30 04:41:25 2009
Lk_Rejets,0: Input 0 consumed 4425301 records. (...)
398 INFO Wed Sep 30 04:41:25 2009
Lk_Rejets,0: Output 0 produced 1 records. (...)
399 FATAL Wed Sep 30 04:41:25 2009
Lk_Rejets,0: Operator terminated abnormally: runLocally did not return APT_StatusOk
400 FATAL Wed Sep 30 04:41:25 2009
APT_CombinedOperatorController(2),2: Operator terminated abnormally: received signal SIGSEGV
401 FATAL Wed Sep 30 04:41:25 2009
APT_CombinedOperatorController(2),1: Operator terminated abnormally: received signal SIGSEGV
402 FATAL Wed Sep 30 04:41:25 2009
APT_CombinedOperatorController(2),3: Operator terminated abnormally: received signal SIGSEGV
403 FATAL Wed Sep 30 04:41:26 2009
APT_CombinedOperatorController(2),0: Operator terminated abnormally: received signal SIGSEGV
404 FATAL Wed Sep 30 04:41:34 2009
main_program: Unexpected exit status 1
405 FATAL Wed Sep 30 04:41:34 2009

So be seeing the FATAL error message I checked the DS dataset scratch disk path "/data001_dwh/dataset/dwh/" for space availability. But we have enough space in the directory almost 50% is free.

Job Design:
DataSet DataSET
DataSet--
DataSet-- LOOKUP -- TRANSFORMER--- DataSET
DataSet-- --SequentialFile
DataSet--

I check the DSxchange relating this defects.But no fruitful results.

Please suggest me how to resolve the issue.

Thanks in Advance!!!

a search will reveal all.

For hint you need ldedit command for AIX or substitutes for other unix flavours.

Hi Kunal,

Thanks for your respose. Can you please be more clear and explain me What is the reason for this error.

priyadarshikunal wrote:viewtopic.php?t=105102&highlight=ldedit

Hi ,

I am sandeepgs's friend.

we tried the ldedit but ldedit is not for HP UX.
But we tried changing the kernel tunable max_mem_window from 0 to 40 and reboot the machine.

still the same issue.

we have also tried the folowing steps.
1. Increased the space in $TMPDIR ( issue still remains )
2. increased the space in the datastage/dataset directories ( issue still remains)
3. tried making the following environment variable true
APT_BUFFERIO_NOMAP=1
APT_IO_NOMAP=1 (issue still remains)
4. Tried to set APT_DISABLE_COMBINATION to true ( issue still remains)
5. Tried to disable APT_COMBINATION at stage level ( issue still remains)

Is there any other resolutiion for the same issue.

thanks,
Samyam

You could try using unbounded VarChar() fields in the lookup and use only those columns you need to reduce lookup size. If that fails, you will need to revert to a JOIN stage.

Samyam

viewtopic.php?t=92775&postdays=0&postor ... IX&start=0


Thanks
Sanjay