Hi,
I have a source system which stores XML message in Oracle database as CLOB. I'm trying to read the CLOB messages and loading them into another table in tabular form columns.
To acheive it - am reading data from Oracle connector and processing them as XML Data through XML Input Stage. Now the issue here is - If I've 10 CLOB Messages in Database, Orale Connector reads all 10 but XML Input Stage processes only one CLOB and ignores others.
Can any one point where am going wrong? Do you people think it's job design issue or any setup issue, at job level?
Kindly suggest your ideas.
Thanks - Anusha
Xml-Input Stage Processes only one Oracle CLOB at time
Moderators: chulett, rschirm, roy
Are each of the 10 seen downstream as individual rows?.....the xmlInput Stage is going to parse out the xml on each "row" as known to the DS engine.....if you take out the xmlInput Stage and put in, say, a transformer or other stage that can at least pass the CLOB, do you see "10" rows in the final stats for that link?
Ernie
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
The xmlInput Stage is very consistent...the CLOBs might be screwing it up, but I doubt it.....here are some things to check...
a) are you certain that it is only reading the first one? Keep in mind that "downstream" you won't be able to easily tell....it will just keep parsing and sending out "rows" based on your xpath in the output link(s).
b) are you certain that it's pushing 10 rows? don't go according to the sequential stage --- look at the stats of the job and the performance values on the link. The sequential file could easily be storing CRLFs or something and you'd still "see" 10 rows in say, notepad.
c) test a separate job that "reads" the 10 rows from the sequential file, and sends "those" to the xmlInput Stage.
Ernie
a) are you certain that it is only reading the first one? Keep in mind that "downstream" you won't be able to easily tell....it will just keep parsing and sending out "rows" based on your xpath in the output link(s).
b) are you certain that it's pushing 10 rows? don't go according to the sequential stage --- look at the stats of the job and the performance values on the link. The sequential file could easily be storing CRLFs or something and you'd still "see" 10 rows in say, notepad.
c) test a separate job that "reads" the 10 rows from the sequential file, and sends "those" to the xmlInput Stage.
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>