MQ Connector Payload size limit

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
hondaccord94
Participant
Posts: 46
Joined: Tue Aug 10, 2004 11:07 am
Location: Mclean VA

MQ Connector Payload size limit

Post by hondaccord94 »

I am using MQ Connector on DataStage 8.1 to read an xml message.

I am getting this error " WebSphere_MQ_Connector_0,0: Fatal Error: Virtual
data set.; output of "WebSphere_MQ_Connector_0": the record is too big to
fit in a block; the length requested is: 1646578, the max block length is:
131072."

Is there a parameter, I need to tweak to handle this error?

Please advise.
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

Here are some things to try....

Increase the APT_DEFAULT_TRANSPORT_BLOCK_SIZE. I have had success with that when needing a larger size to support XML stages, albeit not with the MQ Connector....

Try a Server Job. It may not be what you need, but it might offer clues as to the issue, as Server sometimes is less finicky about large columns.

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
hondaccord94
Participant
Posts: 46
Joined: Tue Aug 10, 2004 11:07 am
Location: Mclean VA

Post by hondaccord94 »

Changing the variable default to 2000000 and it worked.
Thanks a lot for your suggestion.
eostic wrote:Here are some things to try....

Increase the APT_DEFAULT_TRANSPORT_BLOCK_SIZE. I have had success with that when needing a larger size to support XML stages, albeit not with the MQ Connector....

Try a Server Job. It may not be what you need, but it might offer clues as to the issue, as Server sometimes is less finicky about large columns.

Ernie
Post Reply