DSXchange

Hi,

Initially my job was running. Then I wanted eliminate operator combination and then I received below error,

Lookup_EffDate,3: Fatal Error: Virtual data set.; output of "APT_LUTProcessOp in Lookup_EffDate": the record is too big to fit in a block; the length requested is: 139228, the max block length is: 131072.

I tried using below parameters to handle this issue,
$APT_LATENCY_COEFFICIENT = 5
$APT_MIN_TRANSPORT_BLOCK_SIZE = 8192
$APT_MAX_TRANSPORT_BLOCK_SIZE = 1048576
$APT_AUTO_TRANSPORT_BLOCK_SIZE = True

This caused job to fail with below error,

APT_CombinedOperatorController,1: Internal Error: (size <= blocksize_): iomgr/iocomm.C: 1778
Traceback: Could not obtain stack trace; check that 'dbx' and 'sed' are installed and on your PATH

The original error was handled by below parameter
$APT_DEFAULT_TRANSPORT_BLOCK_SIZE = 200000

But I would like to know what went wrong when above error was generated. i.e.

APT_CombinedOperatorController,1: Internal Error: (size <= blocksize_): iomgr/iocomm.C: 1778
Traceback: Could not obtain stack trace; check that 'dbx' and 'sed' are installed and on your PATH

Thanks,

Shashank

I personally refuse to attempt to diagnose any error thrown by APT_CombinedOperatorController. Disable operator combination, find out which particular stage is throwing the error, then get back to us.

Thanks Ray,

as the issue no longer exists, I would prefer to skip this for now.

Thanks,

Shashank

please describe the fix for this issue

Please start a new post. Document for us your error.