Poor performance at sequential file stage while reading
Posted: Mon Jul 25, 2011 5:40 am
Hello:
While processing end-to-end run in my project one of the DS server job is demonstrating poor performance. Here is the job design:
We're been running this process for 5 yrs and have not had a problem until now. Suddenly it started to run with slow performance. The sequential file has only 34500 records. The before dependent job for this source ran successfully without having any problem and also post-dependent jobs are also working fine. Only this particular process is not working with successfully. Both lookups are extracting 28 million records. Earlier we used hashed-lookup but due to some development issues, we're changed those lookups into ORAOCI9.
Regularly this job will take only 5-15 minutes and the average records are 30K-50K in regular process. Currently, the sequential file stage was not reading from the source. Since 15 minutes it was showing 0 records.
Job Properties --> Performance tab --> Active-to-active link performance --> Enable row buffer (checked) --> Inter process (selected) --> Buffer size = 128KB and Timeout = 600 seconds
Please respond with your advice, ideas or suggestions.
While processing end-to-end run in my project one of the DS server job is demonstrating poor performance. Here is the job design:
Code: Select all
Sequential File Stage
|
V
Transformer <-- OraOCI9 Stage as Lookup1
Stage <-- OraOCI9 Stage as Lookup2
|
V
Sequential File Stage
Regularly this job will take only 5-15 minutes and the average records are 30K-50K in regular process. Currently, the sequential file stage was not reading from the source. Since 15 minutes it was showing 0 records.
Job Properties --> Performance tab --> Active-to-active link performance --> Enable row buffer (checked) --> Inter process (selected) --> Buffer size = 128KB and Timeout = 600 seconds
Please respond with your advice, ideas or suggestions.