Page 1 of 1

Reduce the links to use 9MB APT_DEFAULT_TRANSPORT_BLOCK_SIZE

Posted: Mon Feb 03, 2014 3:45 pm
by kennyapril
I used 4 MB of block size and now due to a very big length column it is asking me to give 9MB which could cause the job to use more memory than needed since all the links would use a 9 MB transport block size. Any idea how to use that 9MB for only particular links to reduce the memory usage?


Thank you

Posted: Wed Feb 05, 2014 11:18 am
by asorrell
I don't have access to DataStage at the moment, but I believe you can set buffering on a per-stage basis on the advanced tab of the stage.

However, unless you have gazillions of stages on the canvas, this is really not worth the effort. If you have 10 stages and 8 nodes, then you'll need about 72 buffers (or less due to combinations). This is roughly 700 mb of memory, which should be negligible on practically any datastage system.

Remember - unless the large column goes away at some point, you'll need to increase the block size on ALL the stages downstream anyway, since they'll need to handle it as well.

Posted: Wed Feb 05, 2014 11:48 pm
by kennyapril
Thank you Andy!

Actually the large column will be only upto two stages, so I will give the buffer size to 9mb only to that particular stages in advanced tab and remove the parameter default transport size....Does that work?