My load job is a generic job that uses Column Import stage, a schema file (passed as a parameter) and RCP to load the data from a source file into the target table.
The test schema file contains the following definition:
Code: Select all
record { final_delim=end, delim='|', quote=none, null_field='' } (
abc:nullable string[max=4];
xyz:nullable string[max=120];
)
If a source file contains strings that exceed the size of the columns, my job jus happily truncates and loads the data.There is no error or warning reported.
Is it possible to make Datastage to complain when the source data does not match the schema, in case of trsings?