In a server job you could make columns in sequential files optional in the metadata (columns) tab by converting them to nulls with the "INCOMPLETE COLUMN" property. Is there an equivalent in the PX Sequential stage. I have a delimted file that has some optional columns at the end of each record.
I can't even get to the transformer since the Sequential file stage gives me errors on reading the source data. These optional columns at the end have no delimeters at this point. So for example record 1 could have 10 columns but record 2 has only 5. But after the fifth column there isn't any delimeters. So the sequential file stage doesn't know how to handle the record so it ignores it and doesn't even bring it in.