Need logic for Soring for huge Volume of records

sriec12 · Post by **sriec12** » Thu May 02, 2013 7:40 am

Table A : 110 M
Table B : 180 M

I am doing INNER JOIN to get common records, it produces 85 million records.

Problem: In 85 millions records, I am doing HASH partition(2 keys) and unique at Transformer. Next it loads to oracle database , when it loading it getting aborted after some time due to

Error message: ORA-02396: exceeded maximum idle time, please connect again

Can I use Sort stage instead of sorting on the link ? Does it works ?

chulett · Post by **chulett** » Thu May 02, 2013 7:50 am

Sort in the database and then add a Sort stage set to "Don't sort already sorted'.

ps. What is your idle timeout?

prasson_ibm · Post by **prasson_ibm** » Thu May 02, 2013 10:48 am

Hi,
Are you using oracle connector stage in target,there i think you can increase the timeout or it can never be timeout.