Reading XML file.

Siddharth3012 · Post by **Siddharth3012** » Sat Dec 22, 2007 2:13 am

Hi Friends,

I am new to DSxchange and Datastage both. I have a requirement to read XML file and post into oracle RDBMS tables. I am using DS 7.x Enterprise edition....the thing is that when i searched the DS pallete, I could not find any stage to read XML format file. Can you please help me to read the XML file reading and validation. Please provide the answer step wise..so that i could go fwd step wise to implement....
Thanks in adavnce..bi

chulett · Post by **chulett** » Sat Dec 22, 2007 9:54 am

Welcome. :D

So seriously, you couldn't find any of the XML stages in your palette? You have to have a job open in the Designer (other than a Sequence job) to see the appropriate icons for the job type, but unless yours has been customized they all should be there under the Real Time category:

XML Input: for reading
XML Output: for writing
XML Transformer: for... 'transforming', typically via XSLT

Suggest you find and read the XMLPACK_20_Designer.pdf document in the Docs directory on your PC. That and get the XML Best Practices document from the Tips page on Kim Duke's website. Both will go a long ways towards getting you going in XML with DataStage.

And lastly you'll find the Folder stage is used to feed the XML Input stage in Server jobs while the Sequential File stage is used in PX jobs.

Siddharth3012 · Post by **Siddharth3012** » Fri Dec 28, 2007 3:57 am

Hi,

First thing first...Thank you very much for your help and support...
Next thing ...you have mentioned that Sequential File stage is used to feed the XML input stage in PX. My question is How we are going to read the XML file in seq. stage...Do we need to set any properties in Seq stage to read XML file...

2. When we have XML input stage to read XML file..then Why we are taking seq file stage to feed XML input stage...wat is the basis of that?

Thanks in advance!

chulett wrote:Welcome. :D

So seriously, you couldn't find any of the XML stages in your palette? You have to have a job open in the Designer (other than a Sequence job) to see the appropriate icons for the job type, but unless yours has been customized they all should be there under the Real Time category:

XML Input: for reading
XML Output: for writing
XML Transformer: for... 'transforming', typically via XSLT

Suggest you find and read the XMLPACK_20_Designer.pdf document in the Docs directory on your PC. That and get the XML Best Practices document from the Tips page on Kim Duke's website. Both will go a long ways towards getting you going in XML with DataStage.

And lastly you'll find the Folder stage is used to feed the XML Input stage in Server jobs while the Sequential File stage is used in PX jobs.

Siddharth3012 · Post by **Siddharth3012** » Fri Dec 28, 2007 3:59 am

chulett wrote:Welcome. :D

So seriously, you couldn't find any of the XML stages in your palette? You have to have a job open in the Designer (other than a Sequence job) to see the appropriate icons for the job type, but unless yours has been customized they all should be there under the Real Time category:

XML Input: for reading
XML Output: for writing
XML Transformer: for... 'transforming', typically via XSLT

Suggest you find and read the XMLPACK_20_Designer.pdf document in the Docs directory on your PC. That and get the XML Best Practices document from the Tips page on Kim Duke's website. Both will go a long ways towards getting you going in XML with DataStage.

And lastly you'll find the Folder stage is used to feed the XML Input stage in Server jobs while the Sequential File stage is used in PX jobs.

Siddharth3012 · Post by **Siddharth3012** » Fri Dec 28, 2007 4:01 am

chulett wrote:Welcome. :D

So seriously, you couldn't find any of the XML stages in your palette? You have to have a job open in the Designer (other than a Sequence job) to see the appropriate icons for the job type, but unless yours has been customized they all should be there under the Real Time category:

XML Input: for reading
XML Output: for writing
XML Transformer: for... 'transforming', typically via XSLT

Suggest you find and read the XMLPACK_20_Designer.pdf document in the Docs directory on your PC. That and get the XML Best Practices document from the Tips page on Kim Duke's website. Both will go a long ways towards getting you going in XML with DataStage.

And lastly you'll find the Folder stage is used to feed the XML Input stage in Server jobs while the Sequential File stage is used in PX jobs.

chulett · Post by **chulett** » Fri Dec 28, 2007 7:52 am

The XML Input stage needs an input link. Since there is no PX folder stage, the Sequential File stage will have to take its place and luckily it supports wildcard pattern matching so it can 'read' multiple files much like the folder stage. It can also be set to capture and pass just the filename, which is all the XML Input stage needs when the XML Source is set to URL/filepath.

When you end up with multiple posts, you can delete the 'last' one as long as it is truly last, meaning there are no replies to it yet. So, you could have worked your way up from the bottom and deleted the two 'extra' posts. Do this by selecting the 'Edit/delete this post' and then checking the 'Delete this post' before clicking on Submit.

Siddharth3012 · Post by **Siddharth3012** » Sat Dec 29, 2007 12:41 am

Hi Craig,

U mean that we are going to set the seq file stage just to capture and pass the filename to XML input stage. If we configure the seq files stage to pass the filename only...then wat about the load of metadata...do we need load the metadata in Seq stage...if not then how we are gng to connect to XML input stage....Also we need to set the properties of data pattern in seq file stage whether its an CSV file, fixed format like that..otherwise without metadata and file format...how seq file satge wud read the file...

Thanks!

Siddharth

chulett wrote:The XML Input stage needs an input link. Since there is no PX folder stage, the Sequential File stage will have to take its place and luckily it supports wildcard pattern matching so it can 'read' multiple files much like the folder stage. It can also be set to capture and pass just the filename, which is all the XML Input stage needs when the XML Source is set to URL/filepath.

When you end up with multiple posts, you can delete the 'last' one as long as it is truly last, meaning there are no replies to it yet. So, you could have worked your way up from the bottom and deleted the two 'extra' posts. Do this by selecting the 'Edit/delete this post' and then checking the 'Delete this post' before clicking on Submit.

ray.wurlod · Post by **ray.wurlod** » Sat Dec 29, 2007 12:51 am

Standards Note
U is a Burmese name (indeed, one of the posters here has that name), wat is a Buddhist temple, and wud isn't anything. Nor is gng. Please endeavour to use a professional standard of English on DSXchange. It makes things easier for those whose first language is not English.

Metadata is managed by importing or parsing, separately from job design.

Siddharth3012 · Post by **Siddharth3012** » Sat Dec 29, 2007 8:50 am

i will take care of this in future.....
bi

ray.wurlod wrote:Standards Note
U is a Burmese name (indeed, one of the posters here has that name), wat is a Buddhist temple, and wud isn't anything. Nor is gng. Please endeavour to use a professional standard of English on DSXchange. It makes things easier for those whose first language is not English.

Metadata is managed by importing or parsing, separately from job design.

eostic · Post by **eostic** » Sat Dec 29, 2007 9:19 am

On the source for an EE xml job, I've found that passing in the url for filenames is the simplest way to go.....then you aren't dealing with variable length file sizes and size limits for single columns, etc. Use the External Source stage if this is EE, with an "ls" as the source command. I have the full syntax that I use at http://dsrealtime.wordpress.com/2007/12 ... -a-source/

Ernie

chulett · Post by **chulett** » Sat Dec 29, 2007 9:32 am

Thanks for posting that, Ernie. Bookmarked your blog.

Siddharth3012 · Post by **Siddharth3012** » Mon Jan 07, 2008 4:14 am

Hey,

I tried to read the XML file with sequential file stage but its giving some proble. I have set the XML input stage properly to read the XML file.
Can you please help me to set the Sequential file stage for XML file reading. By setting i mean, can you please provide the properties/attributies that are needed to set before i could read the XML file in sequential stage in PX.
Thanks in advance!

Siddharth

chulett wrote:Thanks for posting that, Ernie. Bookmarked your blog.

chulett · Post by **chulett** » Mon Jan 07, 2008 7:37 am

Hey,

Why not give Ernie's method a shot? Sounds way more better. And learn to post without nonsensically quoting the previous post for no dang reason.

DSXchange

Reading XML file.

Reading XML file.

How to read XML file in Sequential file stage

Metadata in Seq file stage

Hey

Hey