Page 1 of 1
max how many stages we can use in single parallel job
Posted: Tue Feb 12, 2013 5:31 am
by venkateshrupineni
max how many stages we can use in single parallel job
Posted: Tue Feb 12, 2013 5:43 am
by dr.murthy
There is No limitation
Posted: Tue Feb 12, 2013 7:17 am
by eph
Hi,
According to IBM, it is a best practice to keep that number under 30, for readability, easy debug and server load.
You can use more of course.
Eric
Re: max how many stages we can use in single parallel job
Posted: Tue Feb 12, 2013 11:27 am
by 123gopal
1.Minimize the usage of Transformer(instead of use copy,modify,filter,row generator)
2.Reduce the number of lookups in job design use not more than 20 stages in a job
3.There is no limit for no of stages like 20 or 30 but we can break the job into small jobs then we use dataset stages to store data
etc.....
Re: max how many stages we can use in single parallel job
Posted: Tue Feb 12, 2013 4:07 pm
by ray.wurlod
123gopal wrote:1.Minimize the usage of Transformer(instead of use copy,modify,filter,row generator)
2.Reduce the number of lookups in job design use not more than 20 stages in a job
3.There is no limit for no of stages like 20 or 30 but we can break the job into small jobs then we use dataset stages to store data
etc.....
The first of these has not been true since version 8.1.1.
What is the provenance of the other two?