what is the optimal sizes for array ?

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
lory
Participant
Posts: 21
Joined: Tue Apr 13, 2004 9:05 am

what is the optimal sizes for array ?

Post by lory »

Hi experts!
what is the optimal sizes for array? AND transaction? Is There any criteria to decide array sizes ....to load a table with 15 million of record?

Thanks very much :)
ogmios
Participant
Posts: 659
Joined: Tue Mar 11, 2003 3:40 pm

Re: what is the optimal sizes for array ?

Post by ogmios »

viewtopic.php?t=88454

Array Size is known to cause problems with rejects occur (you may not have the actual row causing the reject on your rejet link), I usually put this to one.

Transaction is maximum 9999 in most stages. I always put this at 9999 or 0 for small amounts of data (only commit at end).

For 15 million rows I would not use a DataStage to load the data. Either:
- Shell out to a script and do the transformations and loads using the database load utilities
- Write the data to a file using a Sequential Stage and then shell out and do the load via the database load utilities.

Also don't use the DataStage bulk loaders, they're much slower than using the database load utilities straight away.

Ogmios
In theory there's no difference between theory and practice. In practice there is.
lory
Participant
Posts: 21
Joined: Tue Apr 13, 2004 9:05 am

Post by lory »

Thanks for your help! :)
Post Reply