Job aborting due to block size
Moderators: chulett, rschirm, roy
Job aborting due to block size
One of my job is aborting with the following error message "Join,0: Fatal Error: Virtual data set.; output of "APT_JoinSubOperatorNC in Join": the record is too big to fit in a block; the length requested is: 4147970, the max block length is: 3002368.".I set the APT_DEFAULT_TRANSPORT_SIZE to "3002368".What other parameter do I need to set so that it never fails and what should be the value of it.
Let's see, you set the maximum block size to a value of 3,002,368 and are wondering why you get an error on a block size of 4,147,970? Since we don't know the maximum block size your application can create, we cannot answer your question as to what size you need to set your $APT_MAX_TRANSPORT_BLOCK_SIZE. Note that the actual sizes used internally are the next lower power-of-two from whatever parameter value is used.
-
- Premium Member
- Posts: 278
- Joined: Wed Oct 03, 2007 8:45 am
I looked at lot of posts and found that if we set the APT_DEFAULT_TRANSPORT_BLOCK_SIZE=1048576 but still I am getting the error Seq_Main1,0: Fatal Error: File data set, file "E:/DataStage/Data/in/PNP/Main_Test_All.ds".; output of "Seq_Main1": the record is too big to fit in a block; the length requested is: 2104822, the max block length is: 131072.Do I need to stop/start the engine to take the effect as it still shows 131072.
Try to increase APT_PHYSICAL_DATASET_BLOCK_SIZE.RK72 wrote:I looked at lot of posts and found that if we set the APT_DEFAULT_TRANSPORT_BLOCK_SIZE=1048576 but still I am getting the error Seq_Main1,0: Fatal Error: File data set, file "E:/DataStage/Data/in/PNP/Main_Test_All.ds".; output of "Seq_Main1": the record is too big to fit in a block; the length requested is: 2104822, the max block length is: 131072.Do I need to stop/start the engine to take the effect as it still shows 131072.
131072=8192*16
You need 4194304 to resolve your trouble