Need Help on Parsing an XML file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mac4rfree85
Participant
Posts: 126
Joined: Thu Jul 01, 2010 11:39 pm

Need Help on Parsing an XML file

Post by mac4rfree85 »

Hi Guys,

I have designed a job which was running fine with a particular XML file. Now I have got a similiar XML file . The job is failing with the below error.

Code: Select all

Src,0:Error reading on import.
Src,0:Consumed more than 100000 bytes looking for record delimiter; aborting
Src,0:Import error at record 75.
Src,0:The runLocally() of the operator failed.
Can somebody throw some light on where the error could be.
Mac4rfree
pandeesh
Premium Member
Premium Member
Posts: 1399
Joined: Sun Oct 24, 2010 5:15 am
Location: CHENNAI, TAMIL NADU

Re: Need Help on Parsing an XML file

Post by pandeesh »

mac4rfree85 wrote:Hi Guys,

Now I have got a similiar XML file . The job is failing with the below error.
How you are telling that's the similar xml file?
Does the metadata matches?

The import failed is because of some incorrect metadata definition.

Double check your data and the metadata specification.
pandeeswaran
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

Do some searching..this looks like the classic "trying to read the xml document with a Sequential Stage"..... Search the forum or follow the link below to my blog and find the xml entries in the table of contents...look for the various ways to read xml using the External Source Stage.
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
Mike
Premium Member
Premium Member
Posts: 1021
Joined: Sun Mar 03, 2002 6:01 pm
Location: Tampa, FL

Post by Mike »

Add environment variable APT_DEFAULT_TRANSPORT_BLOCK_SIZE to your job parameters, then increase its default size by some binary multiple.

e.g.
APT_DEFAULT_TRANSPORT_BLOCK_SIZE=16777216

Mike
Mike
Premium Member
Premium Member
Posts: 1021
Joined: Sun Mar 03, 2002 6:01 pm
Location: Tampa, FL

Post by Mike »

I think Ernie is probably more on target. I think increasing the transport blocksize was more of a solution for moving large XML documents from MQ to the XML Input stage.

Mike
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply