xml files

pukars4u · Post by **pukars4u** » Mon Jul 24, 2006 8:30 am

I have n number of Xml files ... and I need to read those xml files one by one(all have same metadata) and then do some transformation for the logic

My problem here in parallel is I don,t have FOlder stage to do.How can I implement this in parallel

Anyone have an idea abt this

THis will help me a lot

chulett · Post by **chulett** » Mon Jul 24, 2006 8:32 am

Why not do it as a Server job? Does it require a PX implementation?

pukars4u · Post by **pukars4u** » Mon Jul 24, 2006 8:44 am

I can implement in server Job.But I want it to implement in PX.Is there any way that i can implement the same in PX

chulett · Post by **chulett** » Mon Jul 24, 2006 8:58 am

Not sure. The Sequential stage in PX can support bringing in multiple wild-carded files without having to cat them together. However, I don't know if it can supply just the filename of each file rather than the file's data. If that's the case, you can use the URL method in the XML Input stage.

Or roll your own external command to return the filenames to the XML Input stage.

Or perhaps someone will chime in with something more better for PX.

mctny · Post by **mctny** » Mon Jul 24, 2006 9:19 am

chulett wrote:Not sure. The Sequential stage in PX can support bringing in multiple wild-carded files without having to cat them together. However, I don't know if it can supply just the filename of each file rather than the file's data. If that's the case, you can use the URL method in the XML Input stage.

Or roll your own external command to return the filenames to the XML Input stage.

Or perhaps someone will chime in with something more better for PX.

yes you can use as many files as you want, in your sequential stage, and you can also use wildcard characters in those file names,

thanks
cetin

shawn_ramsey · Post by **shawn_ramsey** » Mon Jul 24, 2006 9:24 am

pukars4u wrote:I have n number of Xml files ... and I need to read those xml files one by one(all have same metadata) and then do some transformation for the logic

My problem here in parallel is I don,t have FOlder stage to do.How can I implement this in parallel

Anyone have an idea abt this

THis will help me a lot

External Source -> XML Input -> Rest of processing

Use the external source to get a list of XML files to process. We on Linux so I put find /data3/XMLLogin/ -name '*.xml' -print -type f as the command (not exactly sure what you would use for windows). This command gives you a list of file names with path. Feed this into the XML Stage and set the Column Content to URL/File path.

That is it.

DSXchange

xml files

xml files

Re: xml files