Lk_Rejets,0: Could not map table file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sandeepgs
Participant
Posts: 87
Joined: Wed Jul 02, 2008 12:22 am

Lk_Rejets,0: Could not map table file

Post by sandeepgs »

Hi All,

We are facing an issue with lookup stage when running parallel job.

Earlear it ran fine. But recently we migrated from DS 7.5.1 to DS 7.5.3.

From then the problem has started.Please find the below error bessage what we got in our job.

Log:

main_program: APT configuration file: /product/datastage/Ascential/DataStage/Configurations/dwh.apt (...)
395 FATAL Wed Sep 30 04:41:25 2009
Lk_Rejets,0: Could not map table file "/data001_dwh/dataset/dwh/lookuptable.20090930.ozhqfrb (size 964718872 bytes)": Not enough space (...)
396 FATAL Wed Sep 30 04:41:25 2009
Lk_Rejets,0: The runLocally() of the operator failed.
397 INFO Wed Sep 30 04:41:25 2009
Lk_Rejets,0: Input 0 consumed 4425301 records. (...)
398 INFO Wed Sep 30 04:41:25 2009
Lk_Rejets,0: Output 0 produced 1 records. (...)
399 FATAL Wed Sep 30 04:41:25 2009
Lk_Rejets,0: Operator terminated abnormally: runLocally did not return APT_StatusOk
400 FATAL Wed Sep 30 04:41:25 2009
APT_CombinedOperatorController(2),2: Operator terminated abnormally: received signal SIGSEGV
401 FATAL Wed Sep 30 04:41:25 2009
APT_CombinedOperatorController(2),1: Operator terminated abnormally: received signal SIGSEGV
402 FATAL Wed Sep 30 04:41:25 2009
APT_CombinedOperatorController(2),3: Operator terminated abnormally: received signal SIGSEGV
403 FATAL Wed Sep 30 04:41:26 2009
APT_CombinedOperatorController(2),0: Operator terminated abnormally: received signal SIGSEGV
404 FATAL Wed Sep 30 04:41:34 2009
main_program: Unexpected exit status 1
405 FATAL Wed Sep 30 04:41:34 2009

So be seeing the FATAL error message I checked the DS dataset scratch disk path "/data001_dwh/dataset/dwh/" for space availability. But we have enough space in the directory almost 50% is free.

Job Design:
DataSet DataSET
DataSet--
DataSet-- LOOKUP -- TRANSFORMER--- DataSET
DataSet-- --SequentialFile
DataSet--

I check the DSxchange relating this defects.But no fruitful results.

Please suggest me how to resolve the issue.

Thanks in Advance!!!
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

a search will reveal all.

For hint you need ldedit command for AIX or substitutes for other unix flavours.
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
sandeepgs
Participant
Posts: 87
Joined: Wed Jul 02, 2008 12:22 am

Post by sandeepgs »

Hi Kunal,

Thanks for your respose. Can you please be more clear and explain me What is the reason for this error.
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
samyamkrishna
Premium Member
Premium Member
Posts: 258
Joined: Tue Jul 04, 2006 10:35 pm
Location: Toronto

Post by samyamkrishna »

Hi ,

I am sandeepgs's friend.

we tried the ldedit but ldedit is not for HP UX.
But we tried changing the kernel tunable max_mem_window from 0 to 40 and reboot the machine.

still the same issue.

we have also tried the folowing steps.
1. Increased the space in $TMPDIR ( issue still remains )
2. increased the space in the datastage/dataset directories ( issue still remains)
3. tried making the following environment variable true
APT_BUFFERIO_NOMAP=1
APT_IO_NOMAP=1 (issue still remains)
4. Tried to set APT_DISABLE_COMBINATION to true ( issue still remains)
5. Tried to disable APT_COMBINATION at stage level ( issue still remains)

Is there any other resolutiion for the same issue.

thanks,
Samyam
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

You could try using unbounded VarChar() fields in the lookup and use only those columns you need to reduce lookup size. If that fails, you will need to revert to a JOIN stage.
sanjay
Premium Member
Premium Member
Posts: 203
Joined: Fri Apr 23, 2004 2:22 am

Post by sanjay »

Post Reply