Hi Friends
I am reading an xml file using
sequential file-->xml_input---> sequence file
Job is running fine but the out put is like all the records are identical
I have 422 records in the xml file(source) and when I run this job I get 1 single record repeated 422 times.
Any suggestions where I am failing?
Regards
Karry
XML input stage
Moderators: chulett, rschirm, roy
Hard to say....for xmlInput, share with us a snippet of your xml document and share the xpath (descriptions on the output link) for some of your cols that are duplicating and you think they shouldnt be.
Ernie
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
XML input stage
source xml :
XPATH:
/root/ID/text()
/root/UIS/text()
/root/clubColor/text()
/root/playerName/text()
/root/codeVersion/text()
/root/username/text()
/root/buildDate/text()
Repeating KEY is on ID.
and the output Im getting is below which is wrong.
ID,"UIS","clubColor","playerName","codeVersion","username","buildDate"
1,"Yes","red","Josh R","1.0.3","willekra","04-Aug-2015 11:09:48"
2,"Yes","red","Josh R","1.0.3","willekra","04-Aug-2015 11:09:48"
3,"Yes","red","Josh R","1.0.3","willekra","04-Aug-2015 11:09:48"
My job design is
sequential file--->xmlinput-----> seqfile
please help if Im missing anything?
Code: Select all
<?xml version="1.0" encoding="UTF-8" ?>
<root>
<ID>1</ID>
<ID>2</ID>
<ID>3</ID>
<UIS>Yes</UIS>
<UIS></UIS>
<UIS>Yes</UIS>
<clubColor>red</clubColor>
<clubColor>blue</clubColor>
<clubColor>yellow</clubColor>
<playerName>Josh R</playerName>
<playerName>Jeff K</playerName>
<playerName>Graham S</playerName>
<codeVersion>1.0.3</codeVersion>
<username>willekra</username>
<buildDate>04-Aug-2015 11:09:48</buildDate>
</root>
/root/ID/text()
/root/UIS/text()
/root/clubColor/text()
/root/playerName/text()
/root/codeVersion/text()
/root/username/text()
/root/buildDate/text()
Repeating KEY is on ID.
and the output Im getting is below which is wrong.
ID,"UIS","clubColor","playerName","codeVersion","username","buildDate"
1,"Yes","red","Josh R","1.0.3","willekra","04-Aug-2015 11:09:48"
2,"Yes","red","Josh R","1.0.3","willekra","04-Aug-2015 11:09:48"
3,"Yes","red","Josh R","1.0.3","willekra","04-Aug-2015 11:09:48"
My job design is
sequential file--->xmlinput-----> seqfile
please help if Im missing anything?
Sadly, that is a pretty poor xml design. There is structure, but it is merely implied, not forced as it could or should be. There ought to be a "player" element, with id, UID, clubcolor, etc. within it...and then multiple of those player elements.
As it stands now, there are multiple, entirely independent repeating units. id....UID.....clubcolor....playerName, etc.
You may be able to play with the xpath or use xslt in the stage, but the quickest and simplest thing is probably just to have one output link (from the same stage) for each of those groups...one column each, and then work out a way to combine them downstream into a single row.
Ernie
As it stands now, there are multiple, entirely independent repeating units. id....UID.....clubcolor....playerName, etc.
You may be able to play with the xpath or use xslt in the stage, but the quickest and simplest thing is probably just to have one output link (from the same stage) for each of those groups...one column each, and then work out a way to combine them downstream into a single row.
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
karry450 wrote:Sorry I don't have a premium membership to lookinto can you please help
Why not get one? You're over 200 posts, so clearly benefiting from DSXchange. Premium memberships make up the funding mechanism that keeps DSXchange alive.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.