Hi all,
We have a job which reads a .txt file through FTP enterprise stage and bulk load the data to DB2. Issue is , the job is copying the file which it reads through FTP stage and the file is stored in parallel resource folder in DS server.
Job design-
FTP Stage-- Transformer---Bulk Load to DB2
Any thought on this. has anyone come across this issue before.
Thanks.
FTP Enterprise stage
Moderators: chulett, rschirm, roy
I've not seen this at all, over almost three years using FTP Enterprise as the first stage in multi-stage jobs.
I don't agree that landing the files first is preferable even most of the time. It's first a redundant use of disk on the local server, second doesn't require clean-up of files afterwards (except in Sam's case, which I don't understand how it works).
But dueling opinions aside, the decision point is resources. Do you have a luxury of excess disk? Land the files, by all means. Is your FTP channel restricted (mine is)? Timing becomes critical, and again landing files can be a better option. But for a cycle with dozens of downloads representing close to terabytes in volume, landing files may just be the worse idea.
I don't agree that landing the files first is preferable even most of the time. It's first a redundant use of disk on the local server, second doesn't require clean-up of files afterwards (except in Sam's case, which I don't understand how it works).
But dueling opinions aside, the decision point is resources. Do you have a luxury of excess disk? Land the files, by all means. Is your FTP channel restricted (mine is)? Timing becomes critical, and again landing files can be a better option. But for a cycle with dozens of downloads representing close to terabytes in volume, landing files may just be the worse idea.
Franklin Evans
"Shared pain is lessened, shared joy increased. Thus do we refute entropy." -- Spider Robinson
Using mainframe data FAQ: viewtopic.php?t=143596 Using CFF FAQ: viewtopic.php?t=157872
"Shared pain is lessened, shared joy increased. Thus do we refute entropy." -- Spider Robinson
Using mainframe data FAQ: viewtopic.php?t=143596 Using CFF FAQ: viewtopic.php?t=157872