Hi,
I am using the XmlReader stage to load data into an oracle 9.0.2 database. This works just fine when the files are less than 110 Mb in size. When the files get larger DataStage aborts with no proper error message. Anyone with the same experience and hopefully a solution to this problem?
regards
Leif-Arne Bakker
XMLReader
Moderators: chulett, rschirm, roy
Memory Leak?
This sounds like a Memory Leak issue. You should open a case with support and they can walk you through the debugging process. If you're on unix you might want to do a ps -aux while the job is running and watch the process memory to see if it is causing the job to crash.
-
- Premium Member
- Posts: 209
- Joined: Fri Jan 09, 2004 1:14 pm
- Location: Toronto, Canada
- Contact:
Re: XMLReader
The recommendation we had from Ascential support on this problem was to split the processing into two jobs. The first job reads the XML into a sequential file, the second processes the sequential file. All our XML reads are done this way now.leifabak wrote:Hi,
I am using the XmlReader stage to load data into an oracle 9.0.2 database. This works just fine when the files are less than 110 Mb in size. When the files get larger DataStage aborts with no proper error message. Anyone with the same experience and hopefully a solution to this problem?
regards
Leif-Arne Bakker
For some reason (memory leak as suggested above?) if the XML reader has to pause to do lookups, write to DB, etc, memory gets swapped out ( or whatever!) and the reader gets unhappy.
Regards,
Rob Wierdsma