Need to Implement Null Handling in a RCP job
Posted: Tue Jun 12, 2012 4:04 am
I have a job wherein the RunTime Column Propagation is enabled.
The job is designed as under:
Dataset -----> Fileset.
The Dataset, Fileset names are path passed as parameters.
And the metadata is propagated at runtime using RCP.
Now the Dataset passed have four columns
A (Integer 5)
B (Integer 5)
C (Decimal 9)
D (Decimal 9)
among which A and B are not null while C and D are nullable.
The dataset has zero rows. When i execute the job get the following warnings on the not null fields as shown below.
Fileset: When checking operator: When validating export schema: At field "C": "null_field" length (1) must match field's fixed width (9)
Fileset: When checking operator: When validating export schema: At field "C": "null_field" length (1) must match field's fixed width (9)
In the RCP Job I have defined the Null Field value as ' ' and padding char as space in the fileset format properties.
Please let me know how to get rid of the warnings. The job is intended to read different files with varying metadata.
The job is designed as under:
Dataset -----> Fileset.
The Dataset, Fileset names are path passed as parameters.
And the metadata is propagated at runtime using RCP.
Now the Dataset passed have four columns
A (Integer 5)
B (Integer 5)
C (Decimal 9)
D (Decimal 9)
among which A and B are not null while C and D are nullable.
The dataset has zero rows. When i execute the job get the following warnings on the not null fields as shown below.
Fileset: When checking operator: When validating export schema: At field "C": "null_field" length (1) must match field's fixed width (9)
Fileset: When checking operator: When validating export schema: At field "C": "null_field" length (1) must match field's fixed width (9)
In the RCP Job I have defined the Null Field value as ' ' and padding char as space in the fileset format properties.
Please let me know how to get rid of the warnings. The job is intended to read different files with varying metadata.