Page 1 of 1
retrict the number of process of one stage with in a job
Posted: Thu Feb 26, 2009 11:03 am
by mathewb
I have a job which has to extract the data parallel and then insert the data into Netezza. Since the insert into NZ is fast I want only 1 process to insert. In order to extract, I have an parallel odbc stage for which I need to specify at least 4 nodes to pull data fast. So how do I restrict the one stage with in the job to create only one process. Even if I specify node map constraint as node 0, it creates 4 process to insert. Job flow is like
ODBCstage (4process)-->copy stage-->NZstage.
Posted: Thu Feb 26, 2009 11:16 am
by v2kmadhav
you could change the netezza stage execution properties to sequential. did you try that?
Posted: Thu Feb 26, 2009 12:10 pm
by mathewb
v2kmadhav wrote:you could change the netezza stage execution properties to sequential. did you try that?
I tried this earlier but used node constraint along with this and it gave me some error. I will try just specifying the sequential.
Posted: Thu Feb 26, 2009 12:40 pm
by mathewb
No..it is not helping. The NZ stage is invoking the number of nodes specified for the job and not getting restricted by any of these.
Posted: Fri Feb 27, 2009 11:40 am
by dh_Madhu
may be develop a server job ....Database server can be taxed for the extraction process....
Posted: Fri Feb 27, 2009 12:15 pm
by mathewb
dh_Madhu wrote:may be develop a server job ....Database server can be taxed for the extraction process....
the extraction has to be a parallel odbc process and hence I need parallel job.
Posted: Fri Feb 27, 2009 12:16 pm
by mathewb
dh_Madhu wrote:may be develop a server job ....Database server can be taxed for the extraction process....
the extraction has to be a parallel odbc process and hence I need parallel job.
Posted: Sun Mar 01, 2009 4:33 pm
by mandyli
Hi
Use sequential mode and don't use Node Constraint option.
Thanks
Man
Posted: Sun Mar 01, 2009 4:34 pm
by mandyli
Hi
Use sequential mode and don't use Node Constraint option.
Thanks
Man
Posted: Sun Mar 01, 2009 6:16 pm
by ray.wurlod
Have you tried limiting the Netezza stage to a single-node node pool?