Help Required - Regarding Configuration File

[DSDexter]

Hi Gurus,

I have a complex datastage jobs. I run it on test environment (2-Nodes). Prod Environment(4-Node) and Stage Environment(3-Node).

The job runs fine on Test and Prod but always fails on Stage with a fork() error. (Not enough Space).

I tried running the job in stage environment on 2 and eventually 1 node, Still its failing. I am unable to understand this behaviour....

Below is the output of hte check option on the single node config file

Code: Select all

##I TFCN 000001 06:36:22(000) <main_program> 
Ascential DataStage(tm) Enterprise Edition 7.5.1A
Copyright (c) 2004, 1997-2004 Ascential Software Corporation.
All Rights Reserved


##I TUTL 000031 06:36:22(001) <main_program> The open files limit is 100; raising to 65536.
##I TOCK 000000 06:36:22(002) <main_program> OS charset: ISO-8859-1.
##I TOCK 000000 06:36:22(003) <main_program> Input charset: UTF-8.
##W TFPA 000015 06:36:22(004) <main_program> Warning: unable to chdir("."): No such file or directory
##I TFSC 000001 06:36:22(005) <main_program> APT configuration file: /tech/ascential/Ascential/DataStage/Configurations/default1.apt
##W TFPA 000015 06:36:23(000) <APT_CheckConfigOperator,0> Warning: unable to chdir("."): No such file or directory
##W TFPA 000015 06:36:23(000) <APT_RealFileExportOperator in APT_FileExportOperator,0> Warning: unable to chdir("."): No such file or directory
##I TFOP 000059 06:36:24(000) <APT_RealFileExportOperator in APT_FileExportOperator,0> Export complete; 2 records exported successfully, 0 rejected.
##I TFSR 000010 06:36:24(000) <main_program> Step execution finished with status = OK.
##I TOCK 000000 06:36:24(001) <main_program> Total virtual memory on node node1 is 61440.2 MB.
.
##I TOCK 000000 06:36:24(002) <main_program> Config file checker on node node1 reports 0 error(s), 0 warning(s).
.
##I TOCK 000000 06:36:24(003) <main_program> 0 error(s) detected.
##I TOCK 000000 06:36:24(004) <main_program> 0 warning(s) detected.

Please help me out in this . Also can anyone explain what the warnings shown above in the code indicate?

Thanks in advance.

[DSDexter]

Forgot to mention this one.

The OS is SUN Solaris

[DSDexter]

Help Please

[keshav0307]

did you try with 2 node configuration file in stage environment?

[DSDexter]

Yes, I tried with 2 Node and with single node also.... Also to add environments are isolated.

The job on 3 nodes creates 159 Process.

2 Nodes - 102 and on

1 Node - 55 Process.

[ArndW]

Are all 3 environments on the same machine? Solaris is odd in that it preallocates swap space when memory is allocated.

[DSDexter]

Andrw,

All environments are isolated and lie on different servers.

[keshav0307]

do you get the same error when you run the job in 2 node configuration file in stage environment

[ray.wurlod]

Add extra file systems to resource scratchdisk.

[John Smith]

Your problem is related to how Solaris manages it's virtual memory.Please log a call with IBM support and they will sort you out.

[sunayan_pal]

As earlier Ray had told,

check where is the location for the scratch space.
it will be mention in the Configuration File.
now check that location lies in which file system and check the free space.

can you check how many cpu are there in your respective server
let say 6 CPU are there then mention 3 node in the Configuration file.

[ArndW]

Andrw,
All environments are isolated and lie on different servers.

In that case the one machine has less swap space than the others and that is causing your virtual memory issues.