Page 1 of 1

number of jobs in a project

Posted: Tue May 08, 2007 3:50 pm
by kirankota79
is there any limit on the number of jobs to be created in a single project

Posted: Tue May 08, 2007 4:00 pm
by nick.bond
I don't think so, at least can't think of a reason for there being a limit, but someone else will need to confirm that. As long as you organize your jobs well you should be able to have a large number of them before it becomes unwieldy. We currently have just under 1000 jobs and have no issues.

It would be interesting to know what's the largest number anyone has worked with in one project.......just because..... :?:

Posted: Tue May 08, 2007 5:07 pm
by ray.wurlod
There is a limit on some operating systems; it's actually the number of subdirectories in a directory. On Solaris 5.2 that limit is 32K, which effectively limits the maximum number of jobs to around 5000. It's mainly cropped up as a problem in the Version Control project, and the workaround is to use multiple Version Control projects.

Posted: Wed May 09, 2007 11:08 am
by csrazdan
ray.wurlod wrote:There is a limit on some operating systems; it's actually the number of subdirectories in a directory. On Solaris 5.2 that limit is 32K, which effectively limits the maximum number of jobs to around ...
Yes there is a limitation. This is because DataStage being a 32 bit application can address only 32K address space.

On Solaris:
When the number of sub-directories under the project directory reaches 32804, the UV command CREATE.FILE will fail and you cannot create any more jobs in this project.

On AIX:
The above statement is true for AIX also but we have a workarround. The file system on which project directory is created should have variable VIX (Variable Inode) set to YES

On Windows:
Sorry... No Experience

Hope it helps...

Posted: Wed May 09, 2007 11:48 am
by chulett
This has nothing to do with DataStage being a 32bit app but is strictly a limitation imposed by the O/S.

Posted: Wed May 09, 2007 11:55 am
by csrazdan
chulett wrote:This has nothing to do with DataStage being a 32bit app but is strictly a limitation imposed by the O/S. ...
Yes you are correct.
I remember even touch command failed to create a file.