Delimiter for field "COL_NAME" not found;

DS_MJ · Post by **DS_MJ** » Mon Sep 11, 2006 12:40 pm

Hello:

Source - DB2 AIX
Target - Sequential File

When I run my job I get the following Error message:

Jobname: Delimiter for field "COL_NAME" not found; input: {A S S E M B L Y , 20 T O 20 T E S T 20 T H E 20 F U E L 20 H O S E 20 ( T O 20 P U M P 20 C O N N E C T I O N 20 O F 20 E F I 20 B I K E S ) 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20}, at offset: 0

This colum on
Source DB2 table is a Decimal 9 with "No Scale defined". On the source I am converting this Decimal field to a Integer since this column is a Key field. If I do not convert it to a Integer field then this field outputs the value as 000000001. instead of just 1

Would appreicate if somebody could tell me what this warning means?

Krazykoolrohit · Post by **Krazykoolrohit** » Mon Sep 11, 2006 12:43 pm

what is the delimiter you are using. please also sketch the job flow

DS_MJ · Post by **DS_MJ** » Mon Sep 11, 2006 12:50 pm

Krazykoolrohit wrote:what is the delimiter you are using. please also sketch the job flow

Hello Krazykoolrohit:

Delimiter is a "|" (Pipe)

Code: Select all

Job 1
DB2 ---> Transform ---> SeqFile1

JOB 2
              SeqFile0
                  |
                 \|/
SeqFile1  ---> Lookup -----> SeqFile2

This error is occurring when I run Job 2.

DS_MJ · Post by **DS_MJ** » Mon Sep 11, 2006 12:55 pm

In Addition:

The job runs successfully but the log is filled with the above warning. This warning message is happening for a few records only.

What I dont understand is why its happening for only a few records and not all the records...?

Krazykoolrohit · Post by **Krazykoolrohit** » Mon Sep 11, 2006 12:55 pm

Can you do a "view data" on sequential file 1? please try and do it and check if you get any warnings there.

DS_MJ · Post by **DS_MJ** » Mon Sep 11, 2006 12:56 pm

Krazykoolrohit wrote:Can you do a "view data" on sequential file 1? please try and do it and check if you get any warnings there.

I am able to do a view data on the source as well as the target file. The job runs successfully. But in the director I get the warning that I mentioned above.

Jay · Post by **Jay** » Mon Sep 11, 2006 1:02 pm

most likely in some of the rows one of the columns is a null and DataStage is not able to figure it out...you may check the output to verify the result of your job...

Krazykoolrohit · Post by **Krazykoolrohit** » Mon Sep 11, 2006 1:08 pm

Is it possible that the warning is for seq file 0 instead of 1. You said that the column is the key.

can you view data in seq file 0 as well?

DS_MJ · Post by **DS_MJ** » Mon Sep 11, 2006 2:21 pm

Krazykoolrohit wrote:Is it possible that the warning is for seq file 0 instead of 1. You said that the column is the key.

can you view data in seq file 0 as well?

Yes I can view the data from that file too.

ray.wurlod · Post by **ray.wurlod** » Mon Sep 11, 2006 3:42 pm

Since the error occurs at row zero, I would hazard the guess that your "first line is column names" property is set to False when it should be set to True. The raw data string also suggests that this is the case.

DS_MJ · Post by **DS_MJ** » Mon Sep 11, 2006 4:11 pm

ray.wurlod wrote:Since the error occurs at row zero, I would hazard the guess that your "first line is column names" property is set to False when it should be set to True. The raw data string also suggests that this ...

Hello Ray:

I am unable to read your complete message. But....
I am pulling the data from DB2 table directly to a sequential file. This sequential file is not set to have 1st line as column name. I am able to view the data from both the Db2 Table as well as the sequential file without having to specify that the 1st. line is column names.

ray.wurlod · Post by **ray.wurlod** » Mon Sep 11, 2006 4:18 pm

Please post the full error message, so you (we) can determine in which stage it is being reported.

Code: Select all

A S S E M B L Y ,  T O  T E S T  T H E  F U E L  H O S E  ( T O  P U M P  C O N N E C T I O N  O F  E F I  B I K E S )

is the data from the beginning of the first row in whichever file is generating the problem; check that this really does have "|" (rather than ",") as the field delimiter property, since this string contains a comma.

DS_MJ · Post by **DS_MJ** » Mon Sep 11, 2006 4:34 pm

Hello Ray:

I am not getting any "errors" when I run my job. My job successfully completes.

I am copying some of the lines from the director.

conv_FA_001_0804_2006_4,0: Delimiter for field "AXASS" not found; input: {20 L I N E 20 I T E M 20 1 : 20 P R O D U C T I O N 20 T O O L I N G 20 D I E S 20 F O R 20 0d}, at offset: 0

conv_FA_001_0804_2006_4,0: Import warning at record 4354.

conv_FA_001_0804_2006_4,0: Import unsuccessful at record 4354.

conv_FA_001_0804_2006_4,0: Delimiter for field "AXASS" not found; input: {20 S T A M P I N G , 20 B L A N K 20 & 20 T R I M , 20 P / N 20 6 4 9 2 9 - 0 1 A , 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20}, at offset: 0

conv_FA_001_0804_2006_4,0: Import warning at record 4355.

conv_FA_001_0804_2006_4,0: Import unsuccessful at record 4355.

conv_FA_001_0804_2006_4,0: Delimiter for field "AXASS" not found; input: {P / N 20 # 20 5 9 4 1 5 - 0 3 , 5 8 8 8 1 - 0 3 , 5 8 9 1 3 - 0 3 , 5 8 9 7 9 - 0 3 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20}, at offset: 0

conv_FA_001_0804_2006_4,0: Import warning at record 4362.

conv_FA_001_0804_2006_4,0: Import unsuccessful at record 4362.

conv_FA_001_0804_2006_4,0: Progress: 40 percent.

conv_FA_001_0804_2006_4,0: Delimiter for field "AXASS" not found; input: {O F F 20 L O A D 20 C O N V E Y O R 20 F O R 20 E X I S T I N G 20 P I C O 0d}, at offset: 0

conv_FA_001_0804_2006_4,0: Import warning at record 4601.

conv_FA_001_0804_2006_4,0: Import unsuccessful at record 4601.

conv_FA_001_0804_2006_4,0: No further reports will be generated from this partition.
conv_FA_001_0804_2006_4,0: Progress: 70 percent.
conv_FA_001_0804_2006_4,0: Progress: 80 percent.
conv_FA_001_0804_2006_4,0: Progress: 90 percent.
conv_FA_001_0804_2006_4,0: Import complete; 11395 records imported successfully, 37 rejected.
FAPAK_FAPAF,0: Progress: 10 percent.
FAPAK_FAPAF,0: Progress: 90 percent.
MF_FAPAX,0: Export complete; 10933 records exported successfully, 0 rejected.
Reject,0: Export complete; 22927 records exported successfully, 0 rejected.
main_program: Step execution finished with status = OK.
main_program: Startup time, 0:01; production run time, 0:04.
Parallel job reports successful completion

Please let me know if this info suffices..?

Thanks.

DS_MJ · Post by **DS_MJ** » Mon Sep 11, 2006 4:41 pm

Hello:

I am sorry when I mentioned it was a "error". But these are just "WARNING messages" in the director.

us1aslam1us · Post by **us1aslam1us** » Mon Sep 11, 2006 4:48 pm

As jay has suggested collect the rejected rows in a flat file and check what exactly is happening with the data. It might be Nulls or just a bad records and check the AXASS record in particular what data it is having in the reject file.

Sam