Is anyone using DataDirect XML products with DataStage?

chulett · Post by **chulett** » Thu May 17, 2007 8:38 am

Or just have an opinion in general on using third-part tools with DataStage to generate large quantities of XML? I'm looking to see if there are any options to the XML Output stage when 12 to 18 million records need to be converted to XML.

I get spammed quite a bit for both their XQuery and now XML Converter products, so wondering if either of those would be appropriate? Or any other tool for that matter, not really picky.

Thanks for any info.

ps. XQuery. XML Converters.

ray.wurlod · Post by **ray.wurlod** » Thu May 17, 2007 4:20 pm

In my case no; the very fact that they choose spam as their advertising channel would be a big negative for me (not to mention illegal here).

chulett · Post by **chulett** » Thu May 17, 2007 5:06 pm

Guess I should have used a different verb as I didn't mean literally that is was unsolicited - I opted in to their mailing list. It's just that they are very proud of their tools, it seems.

So, you've had no need to worry about large volumes of XML? Or pondered life beyond the XML Output stage?

ray.wurlod · Post by **ray.wurlod** » Thu May 17, 2007 5:52 pm

Very few (none) of my clients uses XML in their ETL strategy.

chulett · Post by **chulett** » Thu May 17, 2007 6:09 pm

Well, maybe Uncle Ernie will wander in to our little Holiday Camp and give us his two cents on the issue.

ray.wurlod · Post by **ray.wurlod** » Thu May 17, 2007 7:08 pm

We're not gonna take it!

chulett · Post by **chulett** » Thu May 17, 2007 7:14 pm

Never did and never will!

eostic · Post by **eostic** » Thu May 17, 2007 9:17 pm

aah, ease up on DD.

Data Direct has some very good tools and are a very good partner of DataStage... However, we haven't needed their tools on the XML front for "typical" DataStage activities. Keep in mind that DataStage in its current form is a tool whose transformation model, like most all ETL tools, is heavily relational based... (works around rows and columns). Where XML work is relational, things are typically straightforward and will continue to be --- most often for reading xml (however complex) and breaking it into multiple tables, or taking mostly relational data and creating XML. While "sometimes" complex xml targeting is needed, or XML to XML, it isn't that often (only once in awhile in this forum). Most [there are always exceptions] of the xml work done in ETL style tools is parsing it and loading into a relational target. I have an action item to dig into DD's capabilities here to determine it's value to _any_ ETL tool, but it hasn't made it to the top of my "to do" list. If I find something cool (or if you find something cool, let me know), I'll pass it on to the appopriate folks. I'm just a lowly field guy.

Ernie

chulett · Post by **chulett** » Fri May 18, 2007 6:44 am

Thanks, Ernie. Appreciate any sage advice you can pass along.

eostic wrote:aah, ease up on DD.

Not a Who fan? Miss the 'Tommy' references in all the bantering?

Or are we going back to the 'spam' statements?

eostic · Post by **eostic** » Fri May 18, 2007 8:54 am

Yes...saw them....it was late so I missed making a comment. Was never a "big" Who fan, but saw the movie and wore out the album.

We're dating ourselves of course. Mostly these days I hear references to Sesame St.

ray.wurlod · Post by **ray.wurlod** » Fri May 18, 2007 4:37 pm

Wore out two copies of the vinyl LP, I think the CD is wearing out too!