Number of input links supported on DTS stage ?

g.santhosh · Post by **g.santhosh** » Wed Dec 26, 2012 3:40 am

When i tried connecting 23 input links to DTS stage i am getting below error "main_program: Internal Error: (inputDataSetNum < m_inputLinkObjArraySize): pxbridge.C: 2186
Traceback: Could not obtain stack trace; check that 'dbx' and 'sed' are installed and on your PATH".

But job is running fine with 20 input links. Is there any max limit on number of input links supported?. If so how can i increase this limit?. Thanks in advance.

abhijain · Post by **abhijain** » Wed Dec 26, 2012 4:05 am

There is no maximum input links for the DTS Stage, but it is observed that the performance will be degraded after having more than 32 links in a single DTS.

g.santhosh · Post by **g.santhosh** » Wed Dec 26, 2012 6:35 am

any ideas on which issues may lead to this error?

chulett · Post by **chulett** » Wed Dec 26, 2012 7:03 am

Based on that "internal error" you posted, I would imagine you'd need to involve your official support provider to find out what's going on. Unless there is a property in the stage where you can adjust the "array size"? Doubt it, somehow.

What exact version are you on? Are you current on your fixpacks?

g.santhosh · Post by **g.santhosh** » Wed Dec 26, 2012 7:05 am

And also to what extent it ll reduce the performance as we are planning for nearly 50 links

oacvb · Post by **oacvb** » Wed Dec 26, 2012 10:00 am

We are currently using DataStage Version 8.5 with Fix Pack 1.

abhijain · Post by **abhijain** » Thu Dec 27, 2012 5:12 am

50

links will be too much, the performance will not be good.

I would suggest to play a little with your job design, use 2 DTS Stages and distribute the links among them.

mujeebrahman · Post by **mujeebrahman** » Thu Dec 27, 2012 5:31 am

If we use 2 DTS stages, can we use same work queue for both. In case of job failure, do you know how the roll back and replay will happen if we use 2 DTS stages?

Your help of this is much appreciated.

Thanks

ray.wurlod · Post by **ray.wurlod** » Thu Dec 27, 2012 2:03 pm

oacvb wrote:We are currently using DataStage Version 8.5 with Fix Pack 1.

As far as I can recall version 8.5 is up to Fix Pack 4.

abhijain · Post by **abhijain** » Fri Dec 28, 2012 12:46 am

If we use 2 DTS stages, can we use same work queue for both.

Yes, you can use 2 DTS stage using single work queue.

In case of job failure, do you know how the roll back and replay will happen if we use 2 DTS stages?

In case of job failure, your message will reside into work queue. About rollback and other, It all depends on your job design.

Below is the normal flow for processing MQ messages:

1. Source Queue --> Message will arrive into this queue for processing.

2. When the job is kicked off, it start processing the messages. For processing the messages, it move the message into the work queue.

Source Queue --> Messaged moved for processing --> Work Queue

3. Message will reside into the work queue, until message has been processed successfully by DTS.

4. If any error arrived or Reject queue has been set properly then the message has been moved to reject queue.

5, In case, if we want to archive the successful message after processing, and archive queue is set. then the message will be moved to archival queue.

Hope this will help.