how much volume of data can load in Xml stage per file?

balaya.ds · Post by **balaya.ds** » Tue Mar 09, 2010 1:13 am

how much volume of data can load in Xml stage in datastage per file?

ray.wurlod · Post by **ray.wurlod** » Tue Mar 09, 2010 2:52 am

As much as is just short of your server running out of memory.

roy · Post by **roy** » Tue Mar 09, 2010 4:02 am

Hi,
In my experiance and as Ray said if your DS Server has enough resources when the job runs, everything around 200MB (+-) starts to be slow and 1GB(+-) might fail or take a very long time to finish.

I think that till IBM decides to improove the XML Plugin we might concider an alternative to using the XML stage for large files or files with multiple repeating elements.

IHTH (I Hope This Helps),

chulett · Post by **chulett** » Tue Mar 09, 2010 6:21 am

Nex time, just clarify your question in your original post rather than starting over with a new one.

In my experience, a 'large' file was somewhere in the vicinity of 300MB, anything much more than that would cause the job to fall over dead. As I said in the other thread, 'depends', as each system seems to be different. You would have to experiment to determine just how large of a 'large' file you'll be able to process on yours.