Consumed more than 100000 bytes looking for record delimiter

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
soportesis
Premium Member
Premium Member
Posts: 21
Joined: Thu May 31, 2007 8:58 am

Consumed more than 100000 bytes looking for record delimiter

Post by soportesis »

I have a similar issue to what is in this post, my metadata is a sequential file and looks like this:

Code: Select all

10030000005|S|23928.00     |                                   
     ?10030000005|S|23231.04     |        
            ?10030000005|H|9720.00     |     
                    ?10030000005|S|19119.36     |  
                           ?10030000005|S|17423.28     |
                                  ?10030000005|S|147292.08     |
                                         ?10030000005|S|9740.00     |
the question mark represent a rare character
y need to past to a dataset with that format

Code: Select all

IDD(varchar 11)  Value(varchar 1)   Quantity (Decimal 10)
10030000005         S                       23928.00
10030000005         S                       23231.04 
i put the the pipe (|) as a delimiter and do a derivation on a tranformer to clear the rare characters and trim the blankspaces but when i run the job i have this:

Sequential filexx:Consumed more than 100000 bytes looking for record delimiter; aborting

what i can do in this case?
Last edited by soportesis on Mon Jun 06, 2011 6:29 pm, edited 1 time in total.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

:!: First thing you should always do is start your own post. I've done it for you this time by splitting the topics and changed your wording slightly to link to the post you decided to jump on the end of. I also added

Code: Select all

[/b] tags to preserve all of your lovely formatting, otherwise the forum software strips all "extra" whitespace from your text.

Since I created this topic, that means I had to [i]guess[/i] at your particulars - version, O/S - please edit your post if I got them wrong.
-craig

"You can never have too many knives" -- Logan Nine Fingers
soportesis
Premium Member
Premium Member
Posts: 21
Joined: Thu May 31, 2007 8:58 am

Post by soportesis »

oh tnks chulett!! my OS is windows server 2003 i work in datastage parallel 8.5 and is important to remark that i have the same job on server 8.5 and its work fine, i think the proble is cause by the delimiter, on the server job the delimiter was 003 but in parrallel i only can put one digit character, somebody knows how can i solve this problem.
Post Reply