Unable to read some special characters in seq file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
bollinenik
Participant
Posts: 111
Joined: Thu Jun 01, 2006 5:12 am
Location: Detroit

Unable to read some special characters in seq file

Post by bollinenik »

Hi,

I am not able to read data from seq.file whcih was loaded from SAP R/3
Input data is in format:
FV A 0001 6999
FV A 8001 9099
FV A 9101 9299
FV A 9301 9999
and Output in Seq File is:A0001-A6999,A8001-A9099,A9101-A9299.
we are able to see this output data in TextPad/EditPlus but same is not readable throgh DataStage
.
Kirtikumar
Participant
Posts: 437
Joined: Fri Oct 15, 2004 6:13 am
Location: Pune, India

Post by Kirtikumar »

Sometimes due to special char, DS do not show proper data in View data option.
To confirm if there are any special chars or not, use the command cat -tv <filenamecan be used.

There is no way to solve this view related problem for special chars. But first make sure there is a special char there.
BTW whats the error you are getting after view data.
Regards,
S. Kirtikumar.
Kirtikumar
Participant
Posts: 437
Joined: Fri Oct 15, 2004 6:13 am
Location: Pune, India

Post by Kirtikumar »

In PX, sometimes if the properties of seq file (like length) are not properly defined, you get errors while viewing the data.

If you post the error you are getting during the View data, it will be useful for us to get the error.
Regards,
S. Kirtikumar.
bollinenik
Participant
Posts: 111
Joined: Thu Jun 01, 2006 5:12 am
Location: Detroit

Post by bollinenik »

Kirtikumar wrote:In PX, sometimes if the properties of seq file (like length) are not properly defined, you get errors while viewing the data.

If you post the error you are getting during the View data, it will be useful for us to get the error.

Hi Kumar,

I am not getting any error and i am not getting any data just with whitespace it's showing under the column names, here view data is not only problem we are not able to read data just it's reading first char only out of 50
in seqfile data is like this :A0001-A6999,A8001-A9099,A9101-A9299.
i need to populate same data in oracle just it's populateing A,A,A like that only

pls help me if any body has idea
pankajg
Participant
Posts: 39
Joined: Mon Jun 05, 2006 5:24 am
Location: India

Post by pankajg »

What is your data flow in the job, can you let us know.

I believe you must be using some transformation to get the output.

Try using a dataset and check if you can get the desired output.
Failures push you towards Success.
bollinenik
Participant
Posts: 111
Joined: Thu Jun 01, 2006 5:12 am
Location: Detroit

Post by bollinenik »

pankajg wrote:What is your data flow in the job, can you let us know.

I believe you must be using some transformation to get the output.

Try using a dataset and check if you can get the desired output.
My input is 4 fields like this
FV A 0001 6999
FV A 8001 9099
FV A 9101 9299
FV A 9301 9999
and required outputs is 2 fields like this
FV A0001-A6999,A8001-A9099,A9101-A9299.

for this ia m using transformer and concatenteing the data...and at the same time ia m ableto populate data in file or some thing but ia m not able to read data properly and i am not able to write data in DATASET BUT I AM ABLE TO WRITE IN SEQ.FILE but by using of text pad or something i can see data but i am not able to read that file for next job....

this is my requirement.......pls
Kirtikumar
Participant
Posts: 437
Joined: Fri Oct 15, 2004 6:13 am
Location: Pune, India

Post by Kirtikumar »

bollinenik wrote:My input is 4 fields like this
FV A 0001 6999
FV A 8001 9099
FV A 9101 9299
FV A 9301 9999
and required outputs is 2 fields like this
FV A0001-A6999,A8001-A9099,A9101-A9299.
From the above it seems that in your input you have 4 rows each having 4 fields. Then in the output of these 4 records you are creating only one record.

Now can you confirm the above and also tell us how you are converting 4 records in single record using transformer?
Regards,
S. Kirtikumar.
bollinenik
Participant
Posts: 111
Joined: Thu Jun 01, 2006 5:12 am
Location: Detroit

Post by bollinenik »

Kirtikumar wrote:
bollinenik wrote:My input is 4 fields like this
FV A 0001 6999
FV A 8001 9099
FV A 9101 9299
FV A 9301 9999
and required outputs is 2 fields like this
FV A0001-A6999,A8001-A9099,A9101-A9299.
From the above it seems that in your input you have 4 rows each having 4 fields. Then in the output of these 4 records you are creating only one record.

Now can you confirm the above and also tell us how you are converting 4 records in single record using transformer?
yes you are right and i am using tranformer only if assume there are four fields called A,B,C,D OK.....so i am doing first B:C-B:D this is the thing i am doing in transformer and populateing to file but i am not able to read that file....and later i am doing group by on field A is the logic i implemented....ok....
Kirtikumar
Participant
Posts: 437
Joined: Fri Oct 15, 2004 6:13 am
Location: Pune, India

Post by Kirtikumar »

Will be a bit tough unless you mentioned the job design!!!

Is there any warning generated in DS logs?
Try one more thing, store the data in a dataset in addition to the file. See you are able to view data there.

What are the properties defined for the seq file? like format of the file, datatype of this column etc.
Regards,
S. Kirtikumar.
Post Reply