Problem Reading sequential file in parallel job

highpoint · Post by **highpoint** » Wed Jun 01, 2011 9:22 am

Hi,

1) I am created a sequential file using folder stage.
The source to folder stage is a single file.

The output from folder stage is filename, record.

The data is loaded successfully in the target sequential file in this server job.

When i am trying to read this server job generated sequential file in a parallel job.

I am getting following warnings:

Product,0: Field "Record" with 'delim=end' did not consume entire input, at offset: 34
Product,0: Import complete; 0 records imported successfully, 1 rejected.

Even though job gets successfully completed, no data is moved to output.

Also when i try to do view data for this sequential file in server job i can see data.

But when i do view data on this sequential file in parallel job i get following error:

##W IIS-DSEE-TFIG-00184 10:16:33(000) <Product,0> Field "Record" with 'delim=end' did not consume entire input, at offset: 34
##W IIS-DSEE-TOIX-00154 10:16:33(001) <Product,0> Import warning at record 0.
##W IIS-DSEE-TOIX-00018 10:16:33(002) <Product,0> Import unsuccessful at record 0.
##I IIS-DSEE-TOIX-00163 10:16:33(003) <Product,0> Import complete; 0 records imported successfully, 1 rejected.

Appreciate help in reading the sequential file in parallel job.

2) Also if the source file to folder stage is very big, then also the parallel job is giving some error saying something like this:

Read 100000 characters no delim found.

Please help me with this 2 questions.

Ravi.K · Post by **Ravi.K** » Wed Jun 01, 2011 9:36 am

have you set Delimiter. If already set then Check for proper Delimiter.

highpoint · Post by **highpoint** » Wed Jun 01, 2011 9:46 am

In both files i am using delimiter as comma.

But the parallel job sequential file has option of final delimiter =end
but there is no option is server job sequential file of "final delimiter"

Help is appreciated.

Ravi.K · Post by **Ravi.K** » Wed Jun 01, 2011 10:06 am

First have you set Record delimiter.

highpoint · Post by **highpoint** » Wed Jun 01, 2011 10:16 am

The line terminator option is already set to Unix Style as server is on unix.

This is for the sequential file on server job.

highpoint · Post by **highpoint** » Wed Jun 01, 2011 10:27 am

Also tried using Record delimiter in the parallel job sequential file
as
Record delimiter =UNIX newline

still does not work.

cannot see data in view data

ray.wurlod · Post by **ray.wurlod** » Wed Jun 01, 2011 5:45 pm

Parallel job or server job? The error messages look like a parallel job, but there is no Folder stage for parallel jobs.

chulett · Post by **chulett** » Wed Jun 01, 2011 5:51 pm

The file is being created in a Server job, the problem comes in when a Parallel job tries to read it.

ray.wurlod · Post by **ray.wurlod** » Wed Jun 01, 2011 6:14 pm

We need to see the server job metadata both for Format and Columns.

Import the table definition from the sequential file then, in the table definition, click Sync Parallel. Then use the table definition in the parallel job.