Rejecting Null values during file import
Posted: Fri Jan 14, 2011 11:23 am
Hi all,
my job is reading the data from sequential file and then loading it into a database.
I need to reject the record if the incoming column is null at the source sequential file stage itself.
The stage is rejecting the records if null is found in Integer type column but not for string type columns even if the column property is not nullable. by default it is replacing Null with ''(empty) value and reading the data into the job.
Can you please share if you have an example of how to reject null values for string data type columns?
the schema of the file is
record
{final_delim=end, delim=',' quote=none}
(
Col_One:nullable int32;
Col_two:string[10];
Col_Three:string[15];
)
my job is reading the data from sequential file and then loading it into a database.
I need to reject the record if the incoming column is null at the source sequential file stage itself.
The stage is rejecting the records if null is found in Integer type column but not for string type columns even if the column property is not nullable. by default it is replacing Null with ''(empty) value and reading the data into the job.
Can you please share if you have an example of how to reject null values for string data type columns?
the schema of the file is
record
{final_delim=end, delim=',' quote=none}
(
Col_One:nullable int32;
Col_two:string[10];
Col_Three:string[15];
)