Hi all,
My Job design:
Seqfile ------> XML Input ------> Xtrans------->Sql server
1)I am trying to extract the xml file and straightly dump raw data into the table
I am getting an error in the seq file stage:
" <Sequential_File_0,0> Error reading on import.
>##E TOIX 000061 14:38:30(001) <Sequential_File_0,0> Consumed more than 100,000 bytes looking for record delimiter; aborting
>##E TOIX 000179 14:38:30(002) <Sequential_File_0,0> Import error at record 0.
>##E TOIX 000000 14:38:30(003) <Sequential_File_0,0> the runLocally() of combination of 4 operators [Sequential_File_0; _Head; _PEEK_IDENT_; _ABORT_IDENT_], partition 0 of 1, processID 27,156 on node1 failed.
##I TOIX 000094 14:38:30(004) <Sequential_File_0,0> Output 0 produced 0 records "
Could you please let me know wht properties i need to set while extracting the xml file
I have given
In properties tab:
source\Read method = File pattern
In format tab:
Record level\Final delimeter = end
Field defaults\delimeter = none
Quote = double
and in columns tab:
I want the whole file in single rec .
2)About XML input stage:
a)In XML input stage /output properties:
" XML_Input_1,0: Error: No repetition element specified for link "DSLink5". Please make sure a column that contains the repetition path is set as key in the output link table definition. am getting an error if I donot specify any key column "
b)If I have multiple repetition path then wht should I do.Becoz it will throw another error saying:
" XML_Input_1,0: Error: The link contains more than one repetition rule"
c)I would like to know about when I can use xsd schema and xslt stlysheets
while reading or writing the file and about the namespace declaration.
can anyone advise me and try to help me out solving this whole issue.
Thanks in advance.
XML Input stage/Seqfile stage/xsd/xslt:
Moderators: chulett, rschirm, roy
Re: XML Input stage/Seqfile stage/xsd/xslt:
shilpa79 wrote:Hi all,
My Job design:
Seqfile ------> XML Input ------> Xtrans------->Sql server
1)I am trying to extract the xml file and straightly dump raw data into the table
I am getting an error in the seq file stage:
" <Sequential_File_0,0> Error reading on import.
>##E TOIX 000061 14:38:30(001) <Sequential_File_0,0> Consumed more than 100,000 bytes looking for record delimiter; aborting
>##E TOIX 000179 14:38:30(002) <Sequential_File_0,0> Import error at record 0.
>##E TOIX 000000 14:38:30(003) <Sequential_File_0,0> the runLocally() of combination of 4 operators [Sequential_File_0; _Head; _PEEK_IDENT_; _ABORT_IDENT_], partition 0 of 1, processID 27,156 on node1 failed.
##I TOIX 000094 14:38:30(004) <Sequential_File_0,0> Output 0 produced 0 records "
Could you please let me know wht properties i need to set while extracting the xml file
I have given
In properties tab:
source\Read method = File pattern
In format tab:
Record level\Final delimeter = end
Field defaults\delimeter = none
Quote = double
and in columns tab:
I want the whole file in single rec .
2)About XML input stage:
a)In XML input stage /output properties:
" XML_Input_1,0: Error: No repetition element specified for link "DSLink5". Please make sure a column that contains the repetition path is set as key in the output link table definition. am getting an error if I donot specify any key column "
b)If I have multiple repetition path then wht should I do.Becoz it will throw another error saying:
" XML_Input_1,0: Error: The link contains more than one repetition rule"
c)I would like to know about when I can use xsd schema and xslt stlysheets
while reading or writing the file and about the namespace declaration.
can anyone advise me and try to help me out solving this whole issue.
Thanks in advance.
This is happening, because XML Stage tries to read the whole data at one time, before it can start processing it.
Is this a large XML file ?
One way to solve this, is to use a shared container to read the xml file as a flat file, and then XML transform can parse xml.
-Kash.
-Kash.
Re: XML Input stage/Seqfile stage/xsd/xslt:
I never worked on shared containers. How should I call the container in my job.
Re: XML Input stage/Seqfile stage/xsd/xslt:
Create a shared container. Calling is not difficult. Just drag n drop.shilpa79 wrote:I never worked on shared containers. How should I call the container in my job.
But before i joined the current project, they had same problem and they implemented shared container to solve it.
If you can send me .dsx file and xml file may be i can try to play around.
-Kash
Kash2007@gmail.com