We have a job that reads from external source stage.
The source program given in this stage is
"sh filename".
The volume of souce data is 193 million rows.
The job hangs after reading 17 million rows.
Is there any limitation for External source stage?
If this stage is replaced with sequential file stage, the job finishes successfully.
Job with External source stage hangs
Moderators: chulett, rschirm, roy
So... a script. And not a lot of other information to go on. I'm not sure how anyone can answer your question without seeing exactly what the script does and thus what "to get data from different files" means. At this point we don't even know if the ESS is what is "hanging" for you or even where you are attempting to write all of these records to. Perhaps your target is what hangs.
After processing how many files / loading how many records? All 193M or a small portion of the total?If this stage is replaced with sequential file stage, the job finishes successfully.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers