Null field handling within Schema file ?

[benny.lbs]

I have a simple job contain only one Dataset stage and one Sequential File stage, what I want to do is DS --> SF. And I would like to make this job reuseable for all file layout. So I use the "Schema File" property to setup the schema in Sequential File stage.

However, there is no null field handling in Sequential File stage because of no specific column was loaded, when the input Dataset has null value, then the sequential file stage will reject all the records that with null value.

How to solve the problem ? Can we specify the null field handling within Schema File ?

Thanks in advance !

[roy]

Hi,
You can try solving this in the sequential file's stage configuration.
this was covered extensivly please search this forum.
IHTH,

[benny.lbs]

in which keyword should I search ? There are lots of doc about sequential file stage in this forum. Would you please show me some links.

Thanks a lot !

Hi,
You can try solving this in the sequential file's stage configuration.
this was covered extensivly please search this forum.
IHTH,

[ray.wurlod]

The word "nullable" would be a good start.

Code: Select all

record
(
  lastname: string[max=16];
  middlename: nullable string[max=16];
  firstname: string[max=16];
)

[benny.lbs]

That means "Null Field Value" can be setup within Schema file ? If yes, that is great.

I got the answer.

Code: Select all

record
(
  lastname: string[16];
  middlename: nullable string[3] {null_field='\xFF\xFF\xFF'};
  firstname: string[16];
)

The word "nullable" would be a good start.

Code: Select all

record
(
  lastname: string[max=16];
  middlename: nullable string[max=16];
  firstname: string[max=16];
)

[ray.wurlod]

Congratulations of the success of your research! :D