retrict the number of process of one stage with in a job

mathewb · Post by **mathewb** » Thu Feb 26, 2009 11:03 am

I have a job which has to extract the data parallel and then insert the data into Netezza. Since the insert into NZ is fast I want only 1 process to insert. In order to extract, I have an parallel odbc stage for which I need to specify at least 4 nodes to pull data fast. So how do I restrict the one stage with in the job to create only one process. Even if I specify node map constraint as node 0, it creates 4 process to insert. Job flow is like
ODBCstage (4process)-->copy stage-->NZstage.

v2kmadhav · Post by **v2kmadhav** » Thu Feb 26, 2009 11:16 am

you could change the netezza stage execution properties to sequential. did you try that?

mathewb · Post by **mathewb** » Thu Feb 26, 2009 12:10 pm

v2kmadhav wrote:you could change the netezza stage execution properties to sequential. did you try that?

I tried this earlier but used node constraint along with this and it gave me some error. I will try just specifying the sequential.

mathewb · Post by **mathewb** » Thu Feb 26, 2009 12:40 pm

No..it is not helping. The NZ stage is invoking the number of nodes specified for the job and not getting restricted by any of these.

dh_Madhu · Post by **dh_Madhu** » Fri Feb 27, 2009 11:40 am

may be develop a server job ....Database server can be taxed for the extraction process....

mathewb · Post by **mathewb** » Fri Feb 27, 2009 12:15 pm

dh_Madhu wrote:may be develop a server job ....Database server can be taxed for the extraction process....

the extraction has to be a parallel odbc process and hence I need parallel job.

mathewb · Post by **mathewb** » Fri Feb 27, 2009 12:16 pm

dh_Madhu wrote:may be develop a server job ....Database server can be taxed for the extraction process....

the extraction has to be a parallel odbc process and hence I need parallel job.

mandyli · Post by **mandyli** » Sun Mar 01, 2009 4:33 pm

Hi

Use sequential mode and don't use Node Constraint option.

Thanks
Man

mandyli · Post by **mandyli** » Sun Mar 01, 2009 4:34 pm

Hi

Use sequential mode and don't use Node Constraint option.

Thanks
Man

ray.wurlod · Post by **ray.wurlod** » Sun Mar 01, 2009 6:16 pm

Have you tried limiting the Netezza stage to a single-node node pool?