DSXchange

In a server job you could make columns in sequential files optional in the metadata (columns) tab by converting them to nulls with the "INCOMPLETE COLUMN" property. Is there an equivalent in the PX Sequential stage. I have a delimted file that has some optional columns at the end of each record.

u can use SetNull() in the transformer for optional columns and make their value null

I can't even get to the transformer since the Sequential file stage gives me errors on reading the source data. These optional columns at the end have no delimeters at this point. So for example record 1 could have 10 columns but record 2 has only 5. But after the fifth column there isn't any delimeters. So the sequential file stage doesn't know how to handle the record so it ignores it and doesn't even bring it in.

I don't think you can do it with properties. You can read the entire record as a VarChar, parsing it subsequently using a Transformer stage.

I thinnk you need to set the "INCOMPLETE COLUMN" of all the optional columns to "replace".

Please advise where to find the "Incomplete Column" property in a parallel job's Sequential File stage.

Please advise where to find the "Incomplete Column" property in a parallel job's Sequential File stage.

My fault. I thought we are talking about server jobs. Sorry, Ray.