Datastage PX Warning: Import consumed only 27bytes of the re

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
hemanthakumar
Participant
Posts: 34
Joined: Mon May 05, 2008 1:31 am

Datastage PX Warning: Import consumed only 27bytes of the re

Post by hemanthakumar »

Hi,
My source is sequential file .txt formate,while loading to the target sequential file iam getting some contol characters in source file.How to remove the control characters in source sequential file.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What "control characters" are you getting in your data?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

You need to determine what that character actually is - the ASCII value. Do you have a hex editor/viewer on your server? Can you do an "od -x" (or something similar) on the file?

Also, where do you see this "control character"? End of every record? Once at the end of the file? Something else entirely?
-craig

"You can never have too many knives" -- Logan Nine Fingers
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Ok, now how about the rest of it?
-craig

"You can never have too many knives" -- Logan Nine Fingers
mahadev.v
Participant
Posts: 111
Joined: Tue May 06, 2008 5:29 am
Location: Bangalore

Post by mahadev.v »

Using a "tr" command in external source stage would help.
See if this post helps:

viewtopic.php?t=113640
"given enough eyeballs, all bugs are shallow" - Eric S. Raymond
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Don't get hung up on control characters. Look at the message. Import (read) consumed only 27 bytes. This means either that your metadata only describes a 27-byte record, or that there is a line terminator (record delimiter) in your data.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply