Parsing large xml files (more than 10 mb)
Posted: Thu Oct 30, 2014 4:28 am
Hi,
We are facing an issue with large xml sizes which are bigger tan 10 MB. We receive a SOAP response, in that response the actual content is embedded. Now we used the xml stage to parse the xml. Now we changed the value of apt_transport_block_size to 10 MB (which I understand is not good practice). Now when the xml files are bigger than 10 mb, we are getting an error saying: "the record is too big to fit in a block".
Files are stored in datastage server, we need to parse the soap and then the actual content and store the data into database table.
Please help me on this. We are facing this issue in production.
Thanks
We are facing an issue with large xml sizes which are bigger tan 10 MB. We receive a SOAP response, in that response the actual content is embedded. Now we used the xml stage to parse the xml. Now we changed the value of apt_transport_block_size to 10 MB (which I understand is not good practice). Now when the xml files are bigger than 10 mb, we are getting an error saying: "the record is too big to fit in a block".
Files are stored in datastage server, we need to parse the soap and then the actual content and store the data into database table.
Please help me on this. We are facing this issue in production.
Thanks