XML Input stage/Seqfile stage/xsd/xslt:

[shilpa79]

Hi all,

My Job design:

Seqfile ------> XML Input ------> Xtrans------->Sql server

1)I am trying to extract the xml file and straightly dump raw data into the table

I am getting an error in the seq file stage:

" <Sequential_File_0,0> Error reading on import.
>##E TOIX 000061 14:38:30(001) <Sequential_File_0,0> Consumed more than 100,000 bytes looking for record delimiter; aborting
>##E TOIX 000179 14:38:30(002) <Sequential_File_0,0> Import error at record 0.
>##E TOIX 000000 14:38:30(003) <Sequential_File_0,0> the runLocally() of combination of 4 operators [Sequential_File_0; _Head; _PEEK_IDENT_; _ABORT_IDENT_], partition 0 of 1, processID 27,156 on node1 failed.
##I TOIX 000094 14:38:30(004) <Sequential_File_0,0> Output 0 produced 0 records "

Could you please let me know wht properties i need to set while extracting the xml file

I have given

In properties tab:
source\Read method = File pattern

In format tab:
Record level\Final delimeter = end
Field defaults\delimeter = none
Quote = double

and in columns tab:
I want the whole file in single rec .

2)About XML input stage:

a)In XML input stage /output properties:

" XML_Input_1,0: Error: No repetition element specified for link "DSLink5". Please make sure a column that contains the repetition path is set as key in the output link table definition. am getting an error if I donot specify any key column "

b)If I have multiple repetition path then wht should I do.Becoz it will throw another error saying:

" XML_Input_1,0: Error: The link contains more than one repetition rule"

c)I would like to know about when I can use xsd schema and xslt stlysheets
while reading or writing the file and about the namespace declaration.


can anyone advise me and try to help me out solving this whole issue.

Thanks in advance.

[ks489]

Hi all,

My Job design:

Seqfile ------> XML Input ------> Xtrans------->Sql server

1)I am trying to extract the xml file and straightly dump raw data into the table

I am getting an error in the seq file stage:

" <Sequential_File_0,0> Error reading on import.
>##E TOIX 000061 14:38:30(001) <Sequential_File_0,0> Consumed more than 100,000 bytes looking for record delimiter; aborting
>##E TOIX 000179 14:38:30(002) <Sequential_File_0,0> Import error at record 0.
>##E TOIX 000000 14:38:30(003) <Sequential_File_0,0> the runLocally() of combination of 4 operators [Sequential_File_0; _Head; _PEEK_IDENT_; _ABORT_IDENT_], partition 0 of 1, processID 27,156 on node1 failed.
##I TOIX 000094 14:38:30(004) <Sequential_File_0,0> Output 0 produced 0 records "

Could you please let me know wht properties i need to set while extracting the xml file

I have given

In properties tab:
source\Read method = File pattern

In format tab:
Record level\Final delimeter = end
Field defaults\delimeter = none
Quote = double

and in columns tab:
I want the whole file in single rec .

2)About XML input stage:

a)In XML input stage /output properties:

" XML_Input_1,0: Error: No repetition element specified for link "DSLink5". Please make sure a column that contains the repetition path is set as key in the output link table definition. am getting an error if I donot specify any key column "

b)If I have multiple repetition path then wht should I do.Becoz it will throw another error saying:

" XML_Input_1,0: Error: The link contains more than one repetition rule"

c)I would like to know about when I can use xsd schema and xslt stlysheets
while reading or writing the file and about the namespace declaration.


can anyone advise me and try to help me out solving this whole issue.

Thanks in advance.

This is happening, because XML Stage tries to read the whole data at one time, before it can start processing it.

Is this a large XML file ?

One way to solve this, is to use a shared container to read the xml file as a flat file, and then XML transform can parse xml.

-Kash.
-Kash.

[shilpa79]

I never worked on shared containers. How should I call the container in my job.

[ks489]

I never worked on shared containers. How should I call the container in my job.

Create a shared container. Calling is not difficult. Just drag n drop.

But before i joined the current project, they had same problem and they implemented shared container to solve it.

If you can send me .dsx file and xml file may be i can try to play around.
-Kash
Kash2007@gmail.com