Sequential Files in PX

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mc_harsha
Premium Member
Premium Member
Posts: 32
Joined: Mon Mar 06, 2006 5:44 am
Location: bangalore

Sequential Files in PX

Post by mc_harsha »

Hi,

Error Message:
S1A3_ITEM_LOC_WK,0: Import consumed only 24bytes of the record's 25 bytes (no further warnings will be generated from this partition)

Any info why we will get above type of error?

with regards,
harsha
harshakumar mc
Maveric
Participant
Posts: 388
Joined: Tue Mar 13, 2007 1:28 am

Post by Maveric »

Do an exact search on "Import consumed only". This has been answered a lot of time.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

With just a 1 byte difference my guess would be line terminators in UNIX - they probably were not specified in the file format.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

... or that the file came from Windows, and has a two-character record terminator string. As noted, this question has been answered before.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
mc_harsha
Premium Member
Premium Member
Posts: 32
Joined: Mon Mar 06, 2006 5:44 am
Location: bangalore

Post by mc_harsha »

You are right..... Windows Seq file...

File End Delimiter : None
harshakumar mc
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Use Record Delimiter String property, set to "DOS-style", rather than Record Delimiter property.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
mc_harsha
Premium Member
Premium Member
Posts: 32
Joined: Mon Mar 06, 2006 5:44 am
Location: bangalore

Post by mc_harsha »

Thanks for you response.

What i did:
From Oracle Table Imported into Excel using sql developer, then converted into CSV file.(Windows operating system)

Now here using as source file.

Using Record delimiter string=Dos format, getting the following warning

S1A2_ITEM_LOC_DC_NONWK1,0: Input buffer overrun at field "ITEM"
S1A2_ITEM_LOC_DC_NONWK1,0: Import warning at record 0:
S1A2_ITEM_LOC_DC_NONWK1,0: Import unsuccessful at record 0:

Now unable to view the data itself in the seq stage.

Previously using final delimiter = none, able to view the data.

-In my mind, Because of the final delimiter, i am getting the above error.

What could be the problem?
harshakumar mc
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Not final delimiter - this appears between the data and the record delimiter.

Now read my previous post again.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
mc_harsha
Premium Member
Premium Member
Posts: 32
Joined: Mon Mar 06, 2006 5:44 am
Location: bangalore

Post by mc_harsha »

thanks buddy....

Got you....working fine :D
harshakumar mc
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Time to mark the thread as Resolved, then?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply