csv file issue

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Sudheer,

could you explain the problem a bit more. You said you have a comma delimiter and that is working. What is the format of the rows that are different? Do the rows have the value "..." for just one column?
shepli
Participant
Posts: 79
Joined: Fri Dec 17, 2004 9:56 am

Post by shepli »

One possibility is that you have incomplete rows (rows with delimiters less than expected. If this is the case, when you try to view data on the csv file, you'll get an error message. The problem can be solved by setting (double click on the sequential file / outputs / format) the Missing Column Action as "Pad with empty string".
sudheer05
Participant
Posts: 30
Joined: Sun Oct 02, 2005 1:36 pm

Post by sudheer05 »

Thanks for the reply,
I am getting some junk data in a csv file.
I am cleaning the file in unix and then calling it in datastage.

thanks,
Sudheer
rasi
Participant
Posts: 464
Joined: Fri Oct 25, 2002 1:33 am
Location: Australia, Sydney

Post by rasi »

Sudheer

What you can do is read your csv file record as one single string and then inside your transformer check the total commas you expect for good records. Have two links as ouput. One being the good ones which you wanted to use and the other for the rejected records.
Regards
Siva

Listening to the Learned

"The most precious wealth is the wealth acquired by the ear Indeed, of all wealth that wealth is the crown." - Thirukural By Thiruvalluvar
Post Reply