Hi,
I have some xml messages in a folder on UNIX server and I want these files to be read by DataStage.
1.Can I use "File Pattern to read these files? Is there any limitation in the number of files read using the File Pattern Technique?
2.If File pattern can be used, suggest me some other idea to read those files.
Note - all the files donot have the same metadata.
Thanks in advance!
File pattern
Moderators: chulett, rschirm, roy
'File Pattern' just means to use wildcards in the filename and, in essence, read more than one file in at a time. It has no bearing on the type of file, so of course you can use the feature with XML files. And there is no limitation on the number of files that I am aware of.
Your 'note' is another kettle of fish - how do you plan on processing them all in one job when they don't have the same metadata? Since these are allegedly XML files, will you somehow be trying to recognize what you've caught in your 'file pattern' net and use different XML Input stages and XPath Expressions to parse them accordingly?
Your 'note' is another kettle of fish - how do you plan on processing them all in one job when they don't have the same metadata? Since these are allegedly XML files, will you somehow be trying to recognize what you've caught in your 'file pattern' net and use different XML Input stages and XPath Expressions to parse them accordingly?
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
A requirement of the File Pattern value is that all files share the same structure. Unless you're reading them as a single VarChar column, it appears that this is not the case in your situation.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.