pros/cons XML

mystuff · Post by **mystuff** » Mon May 14, 2007 7:24 am

I haven't used XML stage until now..

Are there any pros/cons of using XML stage verses sequential file.
Like
a) XML stage have size constraint???? where as sequential file doesnt.

chulett · Post by **chulett** » Mon May 14, 2007 8:10 am

The pros and cons of XML? Sounds like a Roger Waters album.

I've never pondered it, really. All things have limits but I've only ended up using XML when required to, not because I had a choice in the matter.

ray.wurlod · Post by **ray.wurlod** » Mon May 14, 2007 4:25 pm

Because of the tags, XML files are substantially larger than sequential files for the same volume of data. For that reason I prefer to use the latter.

However, XML can transport the metadata along with the data in the same file, which may prove useful in some circumstances. Apart from that, I think it's really just the latest fad.

eostic · Post by **eostic** » Mon May 14, 2007 7:07 pm

Not exactly sure of the nature of your question...are you comparing the Seq Stage vs the XML Stage for reading XML documents? or the merits of using XML at all? That's a huge issue and one that is far bigger than DataStage.....

Ernie

sanjay · Post by **sanjay** » Mon May 14, 2007 8:13 pm

Hi

My client is using XML instead of sequential file . they say information available from xml has more clarity and easier to undertand then sequential file .we use XMLSPY editor to read the file.

Sanjay

eostic wrote:Not exactly sure of the nature of your question...are you comparing the Seq Stage vs the XML Stage for reading XML documents? or the merits of using XML at all? That's a huge issue and one that is far bigger than DataStage.....

Ernie

mystuff · Post by **mystuff** » Tue May 15, 2007 2:59 am

Not exactly sure of the nature of your question...are you comparing the Seq Stage vs the XML Stage for reading XML documents? or the merits of using XML at all? That's a huge issue and one that is far bigger than DataStage.....
Ernie

I wanted to know about limitations while using XML, when compared to sequential Stage.

Post
viewtopic.php?t=109773
mentions something about the size limit.

Similary, I wanted to know whether we can deal with dynamic xml files in datastage AND anything else that I need to know.

chulett · Post by **chulett** » Tue May 15, 2007 7:19 am

You can't directly compare the two.

Yes, there is a size limit because of the nature of the 'suck everything into memory to parse' way that XML works, but then you already knew that.

Not sure what 'dynamic' XML files would be, perhaps an explanation of what you mean would be in order.

Lastly, 'anything else that you need to know' will come from experience using the tool and XML, I don't see how anyone can quantify it here for you.

"Here kid, here's everything else you need to know. Now just prick your finger and sign on the bottom in blood.".

mystuff · Post by **mystuff** » Tue May 15, 2007 8:27 am

I was looking for recommendations on using XML files.

From,

viewtopic.php?t=109773

It appears that,

Recommended ways :

a) below 50MB, 'two field' way works fine (offcourse depends on memory).
b) below 500MB, second methodology, without folder stage.
c) Above 500MB, if other alternatives are available, prefer them.

Can I assume it this way (numbers not being exact).

Thanks

eostic · Post by **eostic** » Tue May 15, 2007 9:08 am

Yes.. those recommendations are about best methods [where size is your criteria] for reading XML with DataStage, and aren't too bad, +/- the number you choose. With EE, of course, there is no (a) because there is no folder stage.

If you are at option (c), perhaps one should re-examine why the documents are so large....

Ernie