Page 1 of 1

Issue in Reading a Sequential File

Posted: Wed Jul 27, 2011 12:09 pm
by mac4rfree85
Hi Guys,

I am trying to read XML file using the Sequential file stage. I am giving a Record delimiter as </Transaction> (closing Transaction Tag).
But for some reasons, after 10 records the job is throwing error that delimiter is not present. But i am able to see the delimiter. In fact, i did a grep on the Closing tag to check the number of records which was exact number of records which is needed.

I created a new XML from my source MQ queue. Even the new XML file, aborted after processing 10 records(using peek stage am able to say this). I even removed the 11th record and kept the remaining records. Still, i am having the same issue.

So, can somebody let me know what is going wrong.

Cheers!!

Re: Issue in Reading a Sequential File

Posted: Wed Jul 27, 2011 4:29 pm
by chulett
mac4rfree85 wrote:I am trying to read XML file using the Sequential file stage.
Why? An XML file is not a "sequential" file in the sense that the Sequential File stage understands reliably. Technically they are one long stream of characters with no individual records. Why not use the stage that was meant to read XML, the XML Input stage?

Re: Issue in Reading a Sequential File

Posted: Thu Jul 28, 2011 2:58 am
by mac4rfree85
chulett wrote:
mac4rfree85 wrote:I am trying to read XML file using the Sequential file stage.
Why? An XML file is not a "sequential" file in the sense that the Sequential File stage understands reliably. Technically they are one long stream of characters with no individual records. Why not use the stage that was meant to read XML, the XML Input stage?
I agree to it. But this how the client needs it. As there are already existing jobs which is designed in this manner. I added an environmental variable which helped me to resolve the issue. "$APT_DELIMITED_READ_SIZE = 990000000" This is what i added. Now i am able to read the file. :)

Posted: Thu Jul 28, 2011 3:30 am
by ray.wurlod
<rant>Resist stupid requirements!</rant>
Please post your client's reasons for "needing" it.
Does your client have pointy hair?

Posted: Thu Jul 28, 2011 6:27 am
by chulett
Nobody "needs" it that way. :?