Reading xml file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
shivan
Participant
Posts: 70
Joined: Mon Jul 25, 2005 9:29 am

Reading xml file

Post by shivan »

Hi,
I am using xslt to divide the big xml file into 6 parts. But is there any way, i can use datastage to divide the xml into 6 parts and then get the data from there and load it in the tables.
thanks
shivan
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

DataStage flattens XML complex structures into relational records. If you are talking about dividing your XML file into six files with the same record structure then you are better off doing it outside of DataStage. If you are dividing it into six different record structures then you can do it in DataStage but you may need to do it in six different jobs as DataStage can only flatten on one key at a time.

Any way you can use xslt to convert the xml to delimited text files? DataStage can process them easily.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The approach you're already taking (using xlst) is almost certainly the most efficient for larger data volumes.

The DataStage XML stages have this terrible proclivity to run out of memory.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply