Server Or Parallel Job for XML tasks...?

VCInDSX · Post by **VCInDSX** » Fri May 18, 2007 1:40 pm

Hi Group,
Is there any recommended approach for XML tasks when choosing "Server vs Parallel" job?

If there are any DS XML experts (I am sure there must be quite a good number), what in your experience, would be helpful if I were to deal with a few million records, that involves joins and filters for generating an XML file.

Is there any XML subcategory in the forums that i should be looking at?

Thanks for your time,

eostic · Post by **eostic** » Fri May 18, 2007 8:27 pm

I don't think there are a whole lot of reasons for choosing Server over EE "because of XML." There are pros and cons on both sides --- reading XML with Server is a bit more "simplistic" because of the available Folder Stage and Server's willingness to let you define any kind of string and not be too concerned about it's actual length...but EE is going to be far more capable for high volume scenarios for either reading or doing heavy transformations prior to writing, xml. Better that you choose EE for it's extra performance, flexibility for parallel options when you need 'em, or because maybe many of your other non-xml jobs are already EE [and skills on your team], and because it's the long term direction for DataStage and where any/all new features in the future will go. If you have both, start using EE (XML having nothing to do with the answer) --- if you only have Server, or are just getting into EE but have lots of Server skills and have to have the Job working by tomorrow at lunchtime, choose Server...

Ernie

chulett · Post by **chulett** » Fri May 18, 2007 10:11 pm

I would agree, I don't really see the "XML-ness" of the task being the driving force behind the choice of job platform.

ray.wurlod · Post by **ray.wurlod** » Sat May 19, 2007 3:07 pm

Unless it turns out to be like clothes sizing, and we get XXML, XXXML and so on. Then parallel may be better, like some folks needing two seats on the aircraft.

VCInDSX · Post by **VCInDSX** » Mon May 21, 2007 1:31 pm

Erine, Craig and Ray,
Thanks a lot for your time and feedback. Looks like EE would be a better choice, if one were to think strategically.

Ernie's thoughts on certain features not being available in EE (Folder, String length) are "gotchas" based on past experience, appreciate your input. I haven't burnt my fingers on the string length, yet. Any additional input on this would be helpful.

"Number of Xs" matter.....definitely :D. Thanks Ray. Will keep that in mind. At this time, the XML burden is mostly tied to the XML output stage. Not yet into Reading XML.

Is XML Reader/Writer a deprecated pair?

Right now, I am using ODBC input, regular Transformer to provide XPath(s) and then an XML Output stage to write my output to a file.

Thanks a lot,

chulett · Post by **chulett** » Mon May 21, 2007 2:08 pm

VCInDSX wrote:Is XML Reader/Writer a deprecated pair?

Yes.

VCInDSX · Post by **VCInDSX** » Tue May 22, 2007 8:49 am

Thanks Craig. 2 items not to worry about :D :D