Size limitation on DataSets & Lookup File Sets

[poorna_76]

Hi All,


We are trying to store large volumes of data (> 9 Million records) in either a DataSet or in a Lookup File Set for doing a lookup.


Is there any Size limitations with DataSets & Lookup File Sets?

Are there any known issues appending data to DataSets?


Thanks in Advance.

[ray.wurlod]

20TB x #partitions (approximately).

You're much more likely to run out of disk space than to hit this limit.

9 million records poses no problem at all, even if they're very wide records.

[poorna_76]

20TB x #partitions (approximately).

You're much more likely to run out of disk space than to hit this limit.

9 million records poses no problem at all, even if they're very wide records.

Thanks Ray.

[poorna_76]

20TB x #partitions (approximately).

You're much more likely to run out of disk space than to hit this limit.

9 million records poses no problem at all, even if they're very wide records.

Is it 20TB or 20GB?

20TB seems to be very huge.

Thanks in Advance.

[DSguru2B]

Yup, in other words, just load 'em datasets without worrying about size limit. Your disk might burn out

[ray.wurlod]

20 Terabytes. Per partition. (I think there's a limit of 1 million partitions, too, but not totally certain on that one.)