Page 1 of 1

what is the optimal sizes for array ?

Posted: Fri Dec 31, 2004 4:22 am
by lory
Hi experts!
what is the optimal sizes for array? AND transaction? Is There any criteria to decide array sizes ....to load a table with 15 million of record?

Thanks very much :)

Re: what is the optimal sizes for array ?

Posted: Fri Dec 31, 2004 5:11 am
by ogmios
viewtopic.php?t=88454

Array Size is known to cause problems with rejects occur (you may not have the actual row causing the reject on your rejet link), I usually put this to one.

Transaction is maximum 9999 in most stages. I always put this at 9999 or 0 for small amounts of data (only commit at end).

For 15 million rows I would not use a DataStage to load the data. Either:
- Shell out to a script and do the transformations and loads using the database load utilities
- Write the data to a file using a Sequential Stage and then shell out and do the load via the database load utilities.

Also don't use the DataStage bulk loaders, they're much slower than using the database load utilities straight away.

Ogmios

Posted: Fri Dec 31, 2004 5:30 am
by lory
Thanks for your help! :)