problem Reading sequential file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Locked
highpoint
Premium Member
Premium Member
Posts: 123
Joined: Sat Jun 19, 2010 12:01 am
Location: Chicago

problem Reading sequential file

Post by highpoint »

Hi,

1) I am created a sequential file using folder stage.
The source to folder stage is a single file.

The output from folder stage is filename, record.

The data is loaded successfully in the target sequential file in this server job.



When i am trying to read this server job generated sequential file in a parallel job.

I am getting following warnings:

Product,0: Field "Record" with 'delim=end' did not consume entire input, at offset: 34
Product,0: Import complete; 0 records imported successfully, 1 rejected.


Even though job gets successfully completed, no data is moved to output.


Also when i try to do view data for this sequential file in server job i can see data.

But when i do view data on this sequential file in parallel job i get following error:


##W IIS-DSEE-TFIG-00184 10:16:33(000) <Product,0> Field "Record" with 'delim=end' did not consume entire input, at offset: 34
##W IIS-DSEE-TOIX-00154 10:16:33(001) <Product,0> Import warning at record 0.
##W IIS-DSEE-TOIX-00018 10:16:33(002) <Product,0> Import unsuccessful at record 0.
##I IIS-DSEE-TOIX-00163 10:16:33(003) <Product,0> Import complete; 0 records imported successfully, 1 rejected.



Appreciate help in reading the sequential file in parallel job.



2) Also if the source file to folder stage is very big, then also the parallel job is giving some error saying something like this:

Read 100000 characters no delim found.


Please help me with this 2 questions.
arunkumarmm
Participant
Posts: 246
Joined: Mon Jun 30, 2008 3:22 am
Location: New York
Contact:

Post by arunkumarmm »

Check if you have the same file format and the line terminators in both of them.
Arun
highpoint
Premium Member
Premium Member
Posts: 123
Joined: Sat Jun 19, 2010 12:01 am
Location: Chicago

Post by highpoint »

arunkumarmm wrote:Check if you have the same file format and the line terminators in both of them.

In both files i am using delimiter as comma.

But the parallel job sequential file has option of final delimiter =end
but there is no option is server job sequential file of "final delimiter"

Help is appreciated.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Please don't post the same question more than once. I'm locking this one.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Locked