Field delimiter missing for null data

[ds_infy]

Hi,

We have a job which reads data from legacy tables and create a xml file.

Xml payload part is a concatenation of all the input columns with pipeline as field delimiter. Also we are using NullToEmpty() function in transformer stage before xml output stage to convert all the nulls to empty string.

The problem which we are facing is whenever the last two consecutive column values are null, job is skipping the field delimiter.

Please let us know how handle this situation.

Thanks in advance.

[robjones]

I've seen a similar issue before when reading sequential files where the last two columns are 'null'.

Can you try setting the datatype of the problematic columns to varchar?

That was the workaround I found.

[ds_infy]

Thanks Rob. we will try this option.