Problem Reading sequential file in parallel job
Moderators: chulett, rschirm, roy
Problem Reading sequential file in parallel job
Hi,
1) I am created a sequential file using folder stage.
The source to folder stage is a single file.
The output from folder stage is filename, record.
The data is loaded successfully in the target sequential file in this server job.
When i am trying to read this server job generated sequential file in a parallel job.
I am getting following warnings:
Product,0: Field "Record" with 'delim=end' did not consume entire input, at offset: 34
Product,0: Import complete; 0 records imported successfully, 1 rejected.
Even though job gets successfully completed, no data is moved to output.
Also when i try to do view data for this sequential file in server job i can see data.
But when i do view data on this sequential file in parallel job i get following error:
##W IIS-DSEE-TFIG-00184 10:16:33(000) <Product,0> Field "Record" with 'delim=end' did not consume entire input, at offset: 34
##W IIS-DSEE-TOIX-00154 10:16:33(001) <Product,0> Import warning at record 0.
##W IIS-DSEE-TOIX-00018 10:16:33(002) <Product,0> Import unsuccessful at record 0.
##I IIS-DSEE-TOIX-00163 10:16:33(003) <Product,0> Import complete; 0 records imported successfully, 1 rejected.
Appreciate help in reading the sequential file in parallel job.
2) Also if the source file to folder stage is very big, then also the parallel job is giving some error saying something like this:
Read 100000 characters no delim found.
Please help me with this 2 questions.
1) I am created a sequential file using folder stage.
The source to folder stage is a single file.
The output from folder stage is filename, record.
The data is loaded successfully in the target sequential file in this server job.
When i am trying to read this server job generated sequential file in a parallel job.
I am getting following warnings:
Product,0: Field "Record" with 'delim=end' did not consume entire input, at offset: 34
Product,0: Import complete; 0 records imported successfully, 1 rejected.
Even though job gets successfully completed, no data is moved to output.
Also when i try to do view data for this sequential file in server job i can see data.
But when i do view data on this sequential file in parallel job i get following error:
##W IIS-DSEE-TFIG-00184 10:16:33(000) <Product,0> Field "Record" with 'delim=end' did not consume entire input, at offset: 34
##W IIS-DSEE-TOIX-00154 10:16:33(001) <Product,0> Import warning at record 0.
##W IIS-DSEE-TOIX-00018 10:16:33(002) <Product,0> Import unsuccessful at record 0.
##I IIS-DSEE-TOIX-00163 10:16:33(003) <Product,0> Import complete; 0 records imported successfully, 1 rejected.
Appreciate help in reading the sequential file in parallel job.
2) Also if the source file to folder stage is very big, then also the parallel job is giving some error saying something like this:
Read 100000 characters no delim found.
Please help me with this 2 questions.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
We need to see the server job metadata both for Format and Columns.
Import the table definition from the sequential file then, in the table definition, click Sync Parallel. Then use the table definition in the parallel job.
Import the table definition from the sequential file then, in the table definition, click Sync Parallel. Then use the table definition in the parallel job.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.