Read 4.5 GB data

arshi · Post by **arshi** » Sat Sep 06, 2008 12:42 am

Hi,

In some of my jobs I need to take a lookup of file (Text file) with around 4 GB of data.
(1) Hashed file stage wonot accept 4GB of data .So,I am going to Table lookup option instead of Hashed file.Is there any other way to do the lookup?

(2) What is the solution for performance issue.

We are using,
Datastage : Server Edition 7.5.1.A
DB : Oracle

Can any one tell which one is the best option to read the 4GB of data ?

Regards,
Arshi

ray.wurlod · Post by **ray.wurlod** » Sat Sep 06, 2008 1:13 am

Hashed file can be resized to use 64-bit addressing, then it will accept 4GB data, indeed up to 0.19 PB of data if the O/S permits.

chulett · Post by **chulett** » Sat Sep 06, 2008 7:08 am

As noted, a hashed file can accept that much data. However, for that volume, you would probably be better off loading it into a work table and joining in your source database, if that's possible.