Using RCP in a job that has multilpe join stages

pdntsap · Post by **pdntsap** » Mon Oct 17, 2011 7:19 am

Hello,

There is a parallel job that has multiple (4-5) join stages. The join keys are about 10 in each stage but the input into the join stages have anywhere between 70-120 columns. I am looking at ways to decrease the total run time for the job. I am wondering if using RCP will help me in this process. I have come across posts that say RCP does not work well with joins and other posts that say RCP does not decrease the total run time of the job. Any thoughts in helping me decide for/against RCP is greatly appreciated.

Thanks.

chulett · Post by **chulett** » Mon Oct 17, 2011 7:53 am

RCP has nothing to do with 'reducing the total run time' of a job, it's all about creating more 'generic' jobs.

pdntsap · Post by **pdntsap** » Mon Oct 17, 2011 9:33 am

Thanks Craig.

chulett · Post by **chulett** » Mon Oct 17, 2011 10:07 am

So, look closer at your job design, see if anything about it can be made more... optimal.