External Source Stage with Multiple XML
Moderators: chulett, rschirm, roy
External Source Stage with Multiple XML
Hi,
Actually I am having 1000 xml in one folder and i need to process this all xml and load it into oracle db.
I have developed the job like below
RowGen -->Trans ---> XML Input ---> Oracle
in Sequencer, I am using ls -m command to take all the file with comma seperator and doing loop to load it into DB but I heared if i use External source stage then i put <code> ls *.xml </code> then datastage concate all the xml file and do the process at same time. is it TRUE?
I am suspecting because every XML have starting with some unwanted tags (ie) Namespace info as well if it concate then it may be wrong.
Please suggest me for moving to next step.
One more request from your guys,
any body having external source stage exact syntax for windows pls give me bcz i tried lot but not working.
Thanks & Regards
Pradeep
Actually I am having 1000 xml in one folder and i need to process this all xml and load it into oracle db.
I have developed the job like below
RowGen -->Trans ---> XML Input ---> Oracle
in Sequencer, I am using ls -m command to take all the file with comma seperator and doing loop to load it into DB but I heared if i use External source stage then i put <code> ls *.xml </code> then datastage concate all the xml file and do the process at same time. is it TRUE?
I am suspecting because every XML have starting with some unwanted tags (ie) Namespace info as well if it concate then it may be wrong.
Please suggest me for moving to next step.
One more request from your guys,
any body having external source stage exact syntax for windows pls give me bcz i tried lot but not working.
Thanks & Regards
Pradeep
Not true. No 'concatenation' will occur but it will process all of the files one after the other without that pesky looping job sequencer.
For DOS, you want to look into dir with the /b option but you're better off sticking with UNIX commands.
For DOS, you want to look into dir with the /b option but you're better off sticking with UNIX commands.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
Use "ls". "pretend" it's unix.
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
Right, because you've always got the MKS Toolkit to fall back on with a Windows server and was part of the reason why I said you'd be better off sticking with UNIX commands. Seems to me it is more problematical getting a fully pathed filename from a dir command which is trivial with ls.
Just surprised it doesn't seem to know what 'dir' is.
Just surprised it doesn't seem to know what 'dir' is.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
we are using DS7.5.1 in UNIX box and DS8.1 in Windows box both servers are using for diff project. when i try
<code> ls -t filename </code> command in DS7.5 then i can able to view the file list but the same job in DS8.1 i can't view the file.
But MKSToolkit is installed in my Windows server mechine.
<code> ls -t filename </code> command in DS7.5 then i can able to view the file list but the same job in DS8.1 i can't view the file.
But MKSToolkit is installed in my Windows server mechine.