Page 1 of 1

lookup error

Posted: Mon Sep 07, 2009 8:24 pm
by pavan_test
Hi All,

My etl job sometimes aborts with this error;

Error when inserting partitioner: No disk resources found in pool "". Disk resources in this pool are required to create a lookup table

can anyone please suggest me what might be causing this error message and the job to abort.

Thanks
Mark

Posted: Mon Sep 07, 2009 8:39 pm
by ray.wurlod
You have not defined a default disk pool (one whose name is "") in your configuration file, but have used a stage type that requires the existence of the default disk pool.

Solution: add a default disk pool (ideally containing all resource disks).

Posted: Mon Sep 07, 2009 10:22 pm
by chulett
Don't really see how this can be a 'sometimes' thing, unless you mean you only use the Lookup stage sometimes or do lookups with this particular config file sometimes. Or are you saying that your problematic job sometimes works correctly and sometimes generates this error? :?

lookup error

Posted: Tue Sep 08, 2009 8:29 am
by pavan_test
Actually now all the jobs are aborting (which ran successfully previously) with this error message;

Error when inserting partitioner: No disk resources found in pool "". Disk resources in this pool are required to create a lookup table.

this is what I see in my config file;

{
node "node1"
{
fastname "XXXX"
pools ""
resource disk "/opt/IBM/IIS/dstage0" {pools "export"}
resource scratchdisk "/opt/IBM/IIS/scratch0" {pools "sort"}
resource scratchdisk "/opt/IBM/IIS/scratch0" {pools "buffer"}
}
node "node2"
{
fastname "XXXX"
pools ""
resource disk "/opt/IBM/IIS/dstage1" {pools "export"}
resource scratchdisk "/opt/IBM/IIS/scratch1" {pools "sort"}
resource scratchdisk "/opt/IBM/IIS/scratch1" {pools "buffer"}

}
}

Please advice me

Thanks
Mark

Posted: Tue Sep 08, 2009 8:32 am
by algfr
For each of these folders, check the remaining space using a df function

Posted: Tue Sep 08, 2009 8:35 am
by Sainath.Srinivasan
Add a default pool for all resources.

Alternatively change all jobs which uses the pools to use your named ones.

To include the available in default, append "" after each pool definition.

lookup error

Posted: Tue Sep 08, 2009 8:51 am
by pavan_test
I executed df, it appears There is enough space in the directories;

Filesystem 512-blocks Free %Used Iused %Iused Mounted on

/dev/fs18 33554432 20534560 39% 457 1% /opt/IBM/IIS/dstage0

/dev/fs19 33554432 11569544 66% 405 1% /opt/IBM/IIS/dstage1

/dev/fs20 50331648 49999784 1% 56 1% /opt/IBM/IIS/scratch0

/dev/fs21 50331648 50001184 1% 51 1% /opt/IBM/IIS/scratch1

Thanks
Mark

lookup error

Posted: Tue Sep 08, 2009 8:54 am
by pavan_test
[quote="Sainath.Srinivasan"]Add a default pool for all resources.

Alternatively change all jobs which uses the pools to use your named ones.

To include the available in default, append "" after each pool definition. ...[/quote]

I can't change in each job since i have around 200 etl jobs.

Can you please tell me how do I add default pool for all resources.

Thanks
Mark

lookup error

Posted: Tue Sep 08, 2009 9:38 am
by pavan_test
I changed the default pool in my configuration file and all jobs competed successfully.

Thanks All.

Thanks
Mark