DSXchange

Hi All,


We are trying to store large volumes of data (> 9 Million records) in either a DataSet or in a Lookup File Set for doing a lookup.


Is there any Size limitations with DataSets & Lookup File Sets?

Are there any known issues appending data to DataSets?


Thanks in Advance.

20TB x #partitions (approximately).

You're much more likely to run out of disk space than to hit this limit.

9 million records poses no problem at all, even if they're very wide records.

ray.wurlod wrote:20TB x #partitions (approximately).

You're much more likely to run out of disk space than to hit this limit.

9 million records poses no problem at all, even if they're very wide records.

Thanks Ray.

ray.wurlod wrote:20TB x #partitions (approximately).

You're much more likely to run out of disk space than to hit this limit.

9 million records poses no problem at all, even if they're very wide records.

Is it 20TB or 20GB?

20TB seems to be very huge.

Thanks in Advance.

Yup, in other words, just load 'em datasets without worrying about size limit. Your disk might burn out

20 Terabytes. Per partition. (I think there's a limit of 1 million partitions, too, but not totally certain on that one.)