Data Stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
prams
Participant
Posts: 73
Joined: Mon Apr 02, 2007 11:26 pm

Data Stage

Post by prams »

When I execute a Lookup job I'm getting the following error message bcz of some space issue.



LKP_AL_YES_COEP,0: Could not map table file "/dsetlsoft/datastage/Ascential/DataStage/Datasets/lookuptable.20070613.ujo03nc (size 1733722784 bytes)": Not enough space

Error finalizing / saving table /tmp/dynLUT6390006fc4e533





Could you guess what could be the reason?



We tried to increase data stage temp directory memory. But still we r getting the same error msg.
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

Duplicate of the duplicate post. Please delete the other post.
JoshGeorge
Participant
Posts: 612
Joined: Thu May 03, 2007 4:59 am
Location: Melbourne

Post by JoshGeorge »

It can be because of many reasons:
/Ascential/DataStage/Datasets" directory doesn't have enough space. Your installation might not be using /tmp for temporary files, check your configuration file this. File size limit for the user executing the job is not adequate, lookup table size might have crossed that limit.
If your ref. data is huge consider using a join stage instead of look up.
Joshy George
<a href="http://www.linkedin.com/in/joshygeorge1" ><img src="http://www.linkedin.com/img/webpromo/bt ... _80x15.gif" width="80" height="15" border="0"></a>
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Let's do the math. 1,73,37,22,784 bytes divided by 300 lakh rows = 58 bytes per row (approximately). That seems reasonable.
So how much free disk space do you have in the file system on which /dsetlsoft/datastage/Ascential/DataStage/Datasets exists?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
rprasanna28
Participant
Posts: 10
Joined: Fri May 12, 2006 12:31 am

Post by rprasanna28 »

we have 40GB free space over there
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Space where? In /tmp or in /dsetlsoft?
rprasanna28
Participant
Posts: 10
Joined: Fri May 12, 2006 12:31 am

Post by rprasanna28 »

In temp directory
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

How much free space do you have in "/dsetlsoft/datastage/Ascential/DataStage/Datasets?
rprasanna28
Participant
Posts: 10
Joined: Fri May 12, 2006 12:31 am

Post by rprasanna28 »

"/dsetlsoft/datastage/Ascential/DataStage/Datasets" has a free space of 39GB
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

And how much space at runtime in your scratch directory as pointed to in the config file?
Post Reply