the record is too big to fit into block

thumati.praveen · Post by **thumati.praveen** » Tue Jun 23, 2009 7:42 am

chulett wrote:There are other APT variables that may help, check this post to see if anything there works for you. ...

APT_AUTO_TRANSPORT_BLOCK_SIZE = False
APT_DEFAULT_TRANSPORT_BLOCK_SIZE = 400000
APT_MAX_TRANSPORT_BLOCK_SIZE = 1048576
APT_LATENCY_COEFFICIENT = 5

I have set all the variables in Project level But the APT_DEFAULT_TRANSPORT_BLOCK_SIZE is more than 400000.

Thanks,
Praveen.

thumati.praveen · Post by **thumati.praveen** » Wed Jun 24, 2009 5:26 am

Hi,

I have resolved issue some what.But I have issue with single record.

my toatl number of records id 224400.In this only one record is giving problem because this records is bigger five times then all other.But the record I can able to write into sequential file but i am not able to write into Dataset.

Could you please suggest me on the same?

Thanks,
Praveen.

miwinter · Post by **miwinter** » Wed Jun 24, 2009 5:45 am

How did you "resolve the issue somewhat"? Have you made changes which resolved it for the most part (as more than one record was causing a problem) or are you saying that there was only ever an issue with this single record?

thumati.praveen · Post by **thumati.praveen** » Wed Jun 24, 2009 9:25 am

miwinter wrote:How did you "resolve the issue somewhat"? Have you made changes which resolved it for the most part (as more than one record was causing a problem) or are you saying that there was only ever an issue with this single record?

Finding the couse of issue means some what resolve.

thumati.praveen · Post by **thumati.praveen** » Wed Jun 24, 2009 9:27 am

miwinter wrote:How did you "resolve the issue somewhat"? Have you made changes which resolved it for the most part (as more than one record was causing a problem) or are you saying that there was only ever an issue with this single record?

It is aborting due to not a single record.But for some couple of records which exceds the length then only aborting.

thumati.praveen · Post by **thumati.praveen** » Wed Jun 24, 2009 9:55 am

Hi,

Can I resolve this issue by converting the data into binary format by using the column export stage?

Thanks,
Praveen.

thumati.praveen · Post by **thumati.praveen** » Wed Jun 24, 2009 9:59 am

Hi,

Can I resolve this issue by converting the data into binary format by using the column export stage?

Thanks,
Praveen.

tjr · Post by **tjr** » Wed Sep 23, 2009 8:09 am

I guess you cannot write records to a datasets which have bigger length than the blocksize of the dataset which is by default 128K. You can change that though by setting APT_PHYSICAL_DATASET_BLOCK_SIZE