Folder stage : Increase the length?

SHARAD123 · Post by **SHARAD123** » Mon Jul 07, 2008 3:49 am

Hi Forum,
I have used Folder stage in a job to read a set of files. But the files may contain more than 999,999,999 characters (which is the maximum length that i could specify as the length). Is it possible to increase this length.

Also, it seems that our production server has some memory problems when folder stage is used. Could you please advise me as to the use of folder stage, some best practices, alternatives for folderstage...?

phew....
Thanks.

ray.wurlod · Post by **ray.wurlod** » Mon Jul 07, 2008 4:51 am

The original purpose for the Folder stage was to be able to grab a number of (small) XML documents out of a directory. Both this original specification and the size of XML documents seems to have gotten well out of hand.

Try an alternative approach using a job sequence loop and a sequential file stage within the job activity inside the loop.

SHARAD123 · Post by **SHARAD123** » Mon Jul 07, 2008 5:43 am

How can we increase the maximum allowed length of the folder stage?

chulett · Post by **chulett** » Mon Jul 07, 2008 7:33 am

You cannot. What kind of files are you reading? You may need to loop through them or concatenate them together before processing.