File pattern option for XML file processing

[techiexavier]

Hi All,

I have to process more number of XML files of same structure.

Seq file ---> XML Input ---> DataSet

I am using XML input stage. I am planning to use URL/File path option (In XML input stage) and file pattern option for source in Sequential file stage. Can anyone help me how to use both the options in my job. Currently I am having my settings as below,

XML files:

Input_1.xml
Input_2.xml
Input_3.xml

Sequential file stage source option:
/opt/input_file_location/filenames.txt

Content of filenames.txt is - /opt/input_file_location/input_*.xml

So I am expecting, as per the content of filenames.txt which having the pattern of my input files the files will be picked and will be processed.

Note: I can go for folder stage in server jobs, but I am looking for any workaround in parallel job using these stages.

Please share your thoughts on this. Thanks.

[chulett]

Use an External Source stage to deliver the filenames, not a Sequential File stage.

[techiexavier]

Thanks for your inputs. I am able to achieve whatever i was trying for.

I have used external file stage to list all the file names and selected the XML document option in XML input stage. It worked.

Thanks.