Arraysize

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
raj4756
Participant
Posts: 17
Joined: Thu Feb 26, 2004 9:07 am

Arraysize

Post by raj4756 »

Hi All,

I'm reading about 6 million rows from an Oracle partitoned table in an OCI stage. What is the optimum number for the arraysize to set.

Thanks.

Raj
tonystark622
Premium Member
Premium Member
Posts: 483
Joined: Thu Jun 12, 2003 4:47 pm
Location: St. Louis, Missouri USA

Post by tonystark622 »

The easiest way that I've seen to do this is to experiment and see which value is correct for your situation. You may have to redo this, if you change the number of columns returned from Oracle.

Tony
jseclen
Participant
Posts: 133
Joined: Wed Mar 05, 2003 4:19 pm
Location: Lima - Peru. Sudamerica
Contact:

Re: Arraysize

Post by jseclen »

Hi Raj,

You must to considerate 2 items:

1) Read all records using 1 query
2) Use partitioned query using key ranges

Depending the choice you will have:

1) The Array size to define will have to be a value that allows to read the greater record number without degrading the process throughout.
2) To consider the amount of querys simultaneous and the ranges that one will have each, in such a way that the amount of registries by each query is equitable. To apply the consideration of point 1.

:lol:
Saludos,

Miguel Seclén
Lima - Peru
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It's a function of row size; effectively it's how many rows of data to move in one hit, for example to make best use of internal buffers, network packets, and so on. It's only an exact science if you know the exact and unvarying values of every possible variable in the mix (which you don't and can't).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply