DSXchange

When reading an xml-file using the XML Input stage, we are getting an error "Abnormal termination of stage <stagename> detected"

This error occurs when the xml files are larger than about 6 MB. When we split the xml file into several smaller files, the job runs normally.

Is there a limit to the size of an xml file? Is there a way to read larger files?

There is definitely a limit, but in extensive testing I've done, it's nearly 100 times bigger than 6M.....of course, it is probably impacted by other variables. Is there anything particularly interesting about your xml document? 1000's of elements? really large strings in those elements? anything else out of the ordinary?

Also, are you reading the document via the XMLInput Stage by sending it the url for your xml document? ...or reading the document first with the folder stage "as content" and sending it down the link. 6M on Server should be fine either way, but it would be interesting to see what happens when you try the other --- the Folder can send just the fully qualified filename or the filename and content down the link. Try the other option from what you are doing and be sure to change the radio button in the XMLInput Stage for content or url.

Ernie

I get the abnormal termination with both the url method or the content method.

The filecontents are like this: I don't know how I should count the number of elements.
One line is about 1000 bytes wide with 20 or so elements/ fields.
The total file is about 150.000 of those records large.
So the total file is like 3,000,000 elements.