Unable to view sequential file in parallel

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
wahi80
Participant
Posts: 214
Joined: Thu Feb 07, 2008 4:37 pm

Unable to view sequential file in parallel

Post by wahi80 »

Hi,

I have converted a fixed width file to a csv file using a server job. Then in the paralle job when I try to open the csv file I get the following error

Code: Select all

 ##W IIS-DSEE-TFIG-00186 11:03:32(000) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(001) <Sequential_File_29,0> Import warning at record 0.
 ##W IIS-DSEE-TOIX-00018 11:03:32(002) <Sequential_File_29,0> Import unsuccessful at record 0.
 ##W IIS-DSEE-TFIG-00186 11:03:32(003) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(004) <Sequential_File_29,0> Import warning at record 1.
 ##W IIS-DSEE-TOIX-00018 11:03:32(005) <Sequential_File_29,0> Import unsuccessful at record 1.
 ##W IIS-DSEE-TFIG-00186 11:03:32(006) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(007) <Sequential_File_29,0> Import warning at record 2.
 ##W IIS-DSEE-TOIX-00018 11:03:32(008) <Sequential_File_29,0> Import unsuccessful at record 2.
 ##W IIS-DSEE-TFIG-00186 11:03:32(009) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(010) <Sequential_File_29,0> Import warning at record 3.
 ##W IIS-DSEE-TOIX-00018 11:03:32(011) <Sequential_File_29,0> Import unsuccessful at record 3.
 ##W IIS-DSEE-TFIG-00186 11:03:32(012) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(013) <Sequential_File_29,0> Import warning at record 4.
 ##W IIS-DSEE-TOIX-00018 11:03:32(014) <Sequential_File_29,0> Import unsuccessful at record 4.
Sample data looks like this

Code: Select all

1101!10118051!Fxxxxxxx INsssssS!A/C Fsssss GLOBALBOND SERIES!US DOLLAR MONTHLY INCOME!OKsdfIKK HOUSE 130 TOCCCCCE RD!HILVVVVVVVUGH TOCCCCCGE KENT!TN11 9DZ UNITED KINGDOM!HiCCCCCCugh ToCCCCCge KCCt!HilCCCCCCCugh ToCCCCCCge KCCt!!!
The field is Varchar, delimiter is !

I have seen some posts, and tried out the solutions but none worked
srini.dw
Premium Member
Premium Member
Posts: 186
Joined: Fri Aug 18, 2006 1:59 am
Location: Chennai

Re: Unable to view sequential file in parallel

Post by srini.dw »

do initial verification how many no.of columns in the source file and how many no.of columns specified in the job.

It's looks columns mismatch....

wahi80 wrote:Hi,

I have converted a fixed width file to a csv file using a server job. Then in the paralle job when I try to open the csv file I get the following error

Code: Select all

 ##W IIS-DSEE-TFIG-00186 11:03:32(000) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(001) <Sequential_File_29,0> Import warning at record 0.
 ##W IIS-DSEE-TOIX-00018 11:03:32(002) <Sequential_File_29,0> Import unsuccessful at record 0.
 ##W IIS-DSEE-TFIG-00186 11:03:32(003) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(004) <Sequential_File_29,0> Import warning at record 1.
 ##W IIS-DSEE-TOIX-00018 11:03:32(005) <Sequential_File_29,0> Import unsuccessful at record 1.
 ##W IIS-DSEE-TFIG-00186 11:03:32(006) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(007) <Sequential_File_29,0> Import warning at record 2.
 ##W IIS-DSEE-TOIX-00018 11:03:32(008) <Sequential_File_29,0> Import unsuccessful at record 2.
 ##W IIS-DSEE-TFIG-00186 11:03:32(009) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(010) <Sequential_File_29,0> Import warning at record 3.
 ##W IIS-DSEE-TOIX-00018 11:03:32(011) <Sequential_File_29,0> Import unsuccessful at record 3.
 ##W IIS-DSEE-TFIG-00186 11:03:32(012) <Sequential_File_29,0> Field "PS_Extra1" delimiter not seen, at offset: 54
 ##W IIS-DSEE-TOIX-00154 11:03:32(013) <Sequential_File_29,0> Import warning at record 4.
 ##W IIS-DSEE-TOIX-00018 11:03:32(014) <Sequential_File_29,0> Import unsuccessful at record 4.
Sample data looks like this

Code: Select all

1101!10118051!Fxxxxxxx INsssssS!A/C Fsssss GLOBALBOND SERIES!US DOLLAR MONTHLY INCOME!OKsdfIKK HOUSE 130 TOCCCCCE RD!HILVVVVVVVUGH TOCCCCCGE KENT!TN11 9DZ UNITED KINGDOM!HiCCCCCCugh ToCCCCCge KCCt!HilCCCCCCCugh ToCCCCCCge KCCt!!!
The field is Varchar, delimiter is !

I have seen some posts, and tried out the solutions but none worked
wahi80
Participant
Posts: 214
Joined: Thu Feb 07, 2008 4:37 pm

Re: Unable to view sequential file in parallel

Post by wahi80 »

There are supposed to be 13 columns.
If you see my sample data there are 12 '!', so the columns map out correctly
wahi80
Participant
Posts: 214
Joined: Thu Feb 07, 2008 4:37 pm

Re: Unable to view sequential file in parallel

Post by wahi80 »

After doing further checks I see that my metadata is defined as follows:
D1 - Varchar-4
D2 - Varchar-8
PS_Extra1 - Varchar -40

4+8+40=52 + 2 delimiters = 54

But my second field is Varchar and will never reach 54 as I trim spaces.
Why would sequential file look for 54, it is not fixed width?
wahi80
Participant
Posts: 214
Joined: Thu Feb 07, 2008 4:37 pm

Re: Unable to view sequential file in parallel

Post by wahi80 »

Re-created job from scratch.
Imported the file again, ensure everything was Varchar and then it worked
Post Reply