NULL Handling

srao · Post by **srao** » Wed Jun 22, 2011 2:30 pm

If a column is nullable from oracle source and loading in to target data set is also nullable but still the records were dropping . Why are the records were dropping if the column is set as nullable?

APT_CombinedOperatorController,0: Field 'PUR_DATE' from input dataset '0' is NULL. Record dropped.

jwiles · Post by **jwiles** » Wed Jun 22, 2011 2:39 pm

Disable operator combination so that you can determine which operator is actually dropping the row. From there you can determine why.

Regards,

srao · Post by **srao** » Thu Jun 23, 2011 8:56 am

Please could you explain in detail?

jwiles · Post by **jwiles** » Thu Jun 23, 2011 9:27 am

Set environment variable $APT_DISABLE_COMBINATION to 1 so that operators will NOT be combined into a single process. It's documented and mentioned here in the forums many times as part of debugging problems.

APT_CombinedOperatorController,0: Field 'PUR_DATE' from input dataset '0' is NULL. Record dropped.

The operator name APT_CombinedOperatorController indicates that two or more operators (i.e. stages) are combined into a single process. Unfortunately you can't tell which of the combined operators dropped the record, hence the recommendation to disable operator combination and rerun the job.

Regards,