problem with loading sequential file of DB2 table

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
kirankota79
Premium Member
Premium Member
Posts: 315
Joined: Tue Oct 31, 2006 3:38 pm

problem with loading sequential file of DB2 table

Post by kirankota79 »

I have connected to a db2 database from datastage and taken the output of a table to a sequential file. Now iam using this sequential file as an input for another job. But iam geeting lot of warning saying that some data is rejected.
The errors iget look like the following:

Personnel,0: Field "WFAC_PASSWORD" with 'delim=end' did not consume entire input, at offset: 382
Personnel,0: Import warning at record 1105:
Personnel,0: Import unsuccessful at record 1105:
Personnel,0: Trailing quote for field "COMMENTS" not found, at offset: 202
Personnel,0: Import warning at record 2080:
Personnel,0: Import unsuccessful at record 2080:
Personnel,0: Input buffer overrun at field "HOME_PHONE"
Personnel,0: Import warning at record 2081:
Personnel,0: Import unsuccessful at record 2081:
Personnel,0: Trailing quote for field "COMMENTS" not found, at offset: 216
Personnel,0: Import warning at record 2124:
Personnel,0: Input buffer overrun at field "HOME_PHONE"
Personnel,0: Import warning at record 2125:
Personnel,0: Import unsuccessful at record 2125:

etc........

Iam using all the data types as varchar and nullable as "NO".

Please help me to sort out this.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

You will need to check the delimiter for the file and specify the same in the stage. If there is no Quote found in file, mention the Quote as none (000),
Last edited by kumar_s on Mon Dec 18, 2006 9:16 pm, edited 1 time in total.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You have quote characters in the COMMENTS and HOME_PHONE fields that match the quote character specified in the Format properties. Change the format as kumar_s suggests.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kirankota79
Premium Member
Premium Member
Posts: 315
Joined: Tue Oct 31, 2006 3:38 pm

Post by kirankota79 »

I have 55 columns in the file and only 2 columns have the problem. i.e., they are getting rejected. how can i set the delimiter for these two columns. delimiter is used for the whole file.
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Fix the quote character (not the delimiter) for the entire file, you cant do it for a portion of the file.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
us1aslam1us
Charter Member
Charter Member
Posts: 822
Joined: Sat Sep 17, 2005 5:25 pm
Location: USA

Post by us1aslam1us »

The problem seems to be with Quote character not the Delimiter. You need to fix the quote character of entire file. Also check the final delimiter.

Sam
kirankota79
Premium Member
Premium Member
Posts: 315
Joined: Tue Oct 31, 2006 3:38 pm

Post by kirankota79 »

should i do it manually?....In datastage i have set the quote as double.
us1aslam1us
Charter Member
Charter Member
Posts: 822
Joined: Sat Sep 17, 2005 5:25 pm
Location: USA

Post by us1aslam1us »

In the first job change the quote character to '000' and use the same settings in reading the file in next job.

sam
samythiru
Participant
Posts: 13
Joined: Tue Feb 28, 2006 3:55 pm

Post by samythiru »

Hi ,

Check the data type and data in the database by querying directly in the database for those two columns, View the data through some editor you will get some idea.

Thanks
Thiru

kirankota79 wrote:I have 55 columns in the file and only 2 columns have the problem. i.e., they are getting rejected. how can i set the delimiter for these two columns. delimiter is used for the whole file.
naren
Premium Member
Premium Member
Posts: 5
Joined: Mon Jul 17, 2006 8:30 am

Re: problem with loading sequential file of DB2 table

Post by naren »

check record 2080,record 2081,record 2124,record 2125 in bd2 and tell me the check the metadata and let me if the metadata is fine,
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Hi kirankota79,
If you got a solution, you can mark the topic as resolved. Also add up with the method you solve the issue, so that, the other enthusiastic participants can work on other post rather than a post posted a month back.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
Post Reply