Schema for sequential file
Posted: Fri Jul 08, 2005 9:41 am
Hi
I am trying to develop a single job which will load data from one sequential file to another without any transformation, while the file names and the schema will be parametrized.
I am using runtime column propagation and have already developed the job (I am not importing metadata ... I am only specifying the schema file).
Now, when I test the job, first i tested with a input and output file with two columns, I am giving the same schema file for both input and output sequential file stage, it works. Here is the schema ...
record
( NAME: nullable string[max=10];
SURNAME: nullable string[max=10];
)
Next I am testing with files which have three columns and i am specifying the following schema
record
( NAME: nullable string[max=10];
SURNAME: nullable string[max=10];
AGE: nullable string[max=10];
)
I am getting the following warnings :
Sequential_File_0,0: Delimiter for field "SURNAME" not found; input: <empty>, at offset: 15
Sequential_File_0,0: Import warning at record 0.
Sequential_File_0,0: Import unsuccessful at record 0.
Sequential_File_0,0: Import complete; 0 records imported successfully, 1 rejected.
The funny thing is that, even with the first job I am getting the same warnings but it is importing and writing records properly whereas here it is rejecting.
Please help me out here !!
Thanks in advance!!
I am trying to develop a single job which will load data from one sequential file to another without any transformation, while the file names and the schema will be parametrized.
I am using runtime column propagation and have already developed the job (I am not importing metadata ... I am only specifying the schema file).
Now, when I test the job, first i tested with a input and output file with two columns, I am giving the same schema file for both input and output sequential file stage, it works. Here is the schema ...
record
( NAME: nullable string[max=10];
SURNAME: nullable string[max=10];
)
Next I am testing with files which have three columns and i am specifying the following schema
record
( NAME: nullable string[max=10];
SURNAME: nullable string[max=10];
AGE: nullable string[max=10];
)
I am getting the following warnings :
Sequential_File_0,0: Delimiter for field "SURNAME" not found; input: <empty>, at offset: 15
Sequential_File_0,0: Import warning at record 0.
Sequential_File_0,0: Import unsuccessful at record 0.
Sequential_File_0,0: Import complete; 0 records imported successfully, 1 rejected.
The funny thing is that, even with the first job I am getting the same warnings but it is importing and writing records properly whereas here it is rejecting.
Please help me out here !!
Thanks in advance!!