DSXchange

getting error in transformer as

Transformer: Error when checking operator: Could not find input field "INPUT_COLUMN".

while field is present in input.

one more observation if this transformer stage is moved to someother part in same job then still give same error on same column and all previous stages gives warning as


Lookup: When checking operator: On input data set 0: When binding input schema variable "inputData": A transfer adapter is renaming the non-existent field "INPUT_COLUMN".
Lookup: When checking operator: The modify operator keeps field "INPUT_COLUMN_1" which is not present in the output interface.

Looks like you have a field on the input link that is not transferred to the output link. Do you really need this field?

Yes need that field , what can be the reason for not reading one particular field and any workaround?

The error is telling you that the input column does not exist in the in the incoming virtual record's schema. You're seeing this happening with both the transformer and the lookup (when you move the transformer elsewhere), so it's not an issue with the transformer. There is no "workaround" as the column obviously doesn't exist at point.

Somewhere upstream of that location the column has either been dropped (unexpectedly?), or it never really existed in the first place. Is your input source a dataset or database? Maybe the source doesn't contain the column...

Set the environment variable OSH_PRINT_SCHEMAS to display the schemas of all datasets and stages and scan the resulting output in the job log for your missing column.

Regards,