Page 1 of 1
NULL Handling
Posted: Wed Jun 22, 2011 2:30 pm
by srao
If a column is nullable from oracle source and loading in to target data set is also nullable but still the records were dropping . Why are the records were dropping if the column is set as nullable?
APT_CombinedOperatorController,0: Field 'PUR_DATE' from input dataset '0' is NULL. Record dropped.
Posted: Wed Jun 22, 2011 2:39 pm
by jwiles
Disable operator combination so that you can determine which operator is actually dropping the row. From there you can determine why.
Regards,
Posted: Thu Jun 23, 2011 8:56 am
by srao
Please could you explain in detail?
Posted: Thu Jun 23, 2011 9:27 am
by jwiles
Set environment variable $APT_DISABLE_COMBINATION to 1 so that operators will NOT be combined into a single process. It's documented and mentioned here in the forums many times as part of debugging problems.
APT_CombinedOperatorController,0: Field 'PUR_DATE' from input dataset '0' is NULL. Record dropped.
The operator name APT_CombinedOperatorController indicates that two or more operators (i.e. stages) are combined into a single process. Unfortunately you can't tell which of the combined operators dropped the record, hence the recommendation to disable operator combination and rerun the job.
Regards,