Reading the data file

bala_135 · Post by **bala_135** » Wed Jul 09, 2008 7:32 am

Hi All,

I am having a source file like this column1,column2(xml tag),column3.
I read it and pass the column(xml) to the xml input stage and then to the targets.The job aborts after reading a million rows and throws the "ACCESS VIOLATION ERROR".
I guess these are some data related issues.I have written a routine to strip the unwanted characters but I need to read the data first.
My question is I am reading the data as a varchar field.Its able to read some but could not read all.Any inputs most appreciated.

Regards,
Bala.

ArndW · Post by **ArndW** » Wed Jul 09, 2008 11:08 am

What stage are you using to read this data and what Varchar() length did you specify? If you remove the XML stage and no longer get an error in the program, then it probably isn't an issue with input lengths.

bala_135 · Post by **bala_135** » Thu Jul 10, 2008 12:11 am

Hi,

Thanks for the reply.Sequential file stage and the length i am specfying is 8000 for the XML column.I did another test used sequential file stage datatype as varchar 8000,removed all the other fields expect for the XML column field and written the results using another filestage.Used the strip routine as well.No issues able to read all the data.
My speculation there might be some data related issues with the other fields which propagates with the XML column field into the XML stage.

Regards,
Bala.

ArndW · Post by **ArndW** » Thu Jul 10, 2008 12:53 am

I don't know where your problem might be happening, but you might think about using the debugger. Find out the last "good" output line and put a breakpoint on that value, then step to the next one and see if the data contents might give a clue as to the cause of your problem. Sometimes the debugger shows the Heisenberg effect - meaning that by using it you change the error or get rid of it completely.

WoMaWil · Post by **WoMaWil** » Thu Jul 10, 2008 3:29 am

Please give us two sample lines from your file.

ray.wurlod · Post by **ray.wurlod** » Thu Jul 10, 2008 7:07 am

I'm uncertain what the Heisenberg effect is - can you please amplify?

chulett · Post by **chulett** » Thu Jul 10, 2008 7:51 am

Ah... Wurlod Humor.

ArndW · Post by **ArndW** » Thu Jul 10, 2008 7:59 am

ray.wurlod wrote:I'm uncertain what the Heisenberg effect is - can you please amplify?

Sorry, Ray, I cannot do that; since it would change the result for others. But I do have a [live] cat in a sealed box for you....