Storage Space w.r.t. Datasets

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
urahul
Participant
Posts: 9
Joined: Tue Dec 07, 2004 12:44 pm

Storage Space w.r.t. Datasets

Post by urahul »

Hi,
we are about to define our Scratch and Disk space for DS EE 71r1 on Solaris 5.8.
We have quite a few DataSet jobs creating persistant datasets.

It is observed that datasets tend to occupy a lot more space then oracle does. Accourding to the statistics i have accumulated, following storage requirements seem to be astonishingly high for datasets.

Table1:
DATEs : 7 (No of Date Fields)
NUMBERs: 38 (No of Number Fields)
VARCHAR2s: 21 (No of Varchar2 Fields)
TotalRecs: 9417112
ORACLE_STORAGE : 2.416015625 GB DataSets: 35.9234314 GB

Table2:
DATEs : 6
NUMBERs: 13
VARCHAR2s: 27
TotalRecs: 28945419
ORACLE_STORAGE : 4.192382813GB DataSets: 176.6688171 GB

Table3:
DATEs : 3
NUMBERs: 3
VARCHAR2s: 4
TotalRecs: 7038421
ORACLE_STORAGE : 0.649414063 GB DataSets: 11.94263329 GB

Table4:
DATEs : 7
NUMBERs: 9
VARCHAR2s: 59
TotalRecs: 35001827
ORACLE_STORAGE : 10.24314883 GB DataSets: 267.0427475 GB

I would, very much, like to know whether thats normal for datasets; Or something is terribly wrong with my machines/configuration.

Can anyone help please?

Thanks
Rahul
lakshman_gk
Participant
Posts: 7
Joined: Thu Oct 14, 2004 12:48 pm

Post by lakshman_gk »

How do you calculate this comparison? I would like to do the same kind of observation for our files. How can I go about it?
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

urahul,

what kind of data types do you have in these datasets? Do you have a lot of CHAR type data which might be stored as VARCHAR in Oracle?
urahul
Participant
Posts: 9
Joined: Tue Dec 07, 2004 12:44 pm

DataSets Data Storage

Post by urahul »

The calculations are based on the actual space occupied by the DataSets and respective oracle tables.

There are no CHARs in the database tables.
There are only NUMBERs, DATEs and VARCHAR2s.


Thanks
Rahul
Post Reply