Infra Sizing for a new Datastage initiative
Posted: Mon Aug 24, 2015 3:00 am
Hi Experts
Would appreciate your thoughts on this.
Background:
We are doing infrastructure sizing.This happens before the requirements phase.
The mandate is to find out if the current instance of Datastage can handle the data and if any changes are required in the hardware.
We use DS 8.5
There are other Datastage projects up and running.
Details known:
The Daily load needs to load 200 Million rows per day.The time window available is 6 hours
Input format .txt/.csv files.
The input files would come from 3 source systems.Each source system would split the data into multiple files.
Output format is .txt files.
Transformations: Simple to Medium consisting of generating new columns and a couple of lookups
It is estimated that on an average the source columns will have around 120 odd columns.
In effect,
There are no extracts,loads from Databases.
Simple -Medium transformations.
Have never had the need to do Infra sizing before.
Would appreciate if you can give me any pointers about how to work out the sizing for this project.
Would appreciate your thoughts on this.
Background:
We are doing infrastructure sizing.This happens before the requirements phase.
The mandate is to find out if the current instance of Datastage can handle the data and if any changes are required in the hardware.
We use DS 8.5
There are other Datastage projects up and running.
Details known:
The Daily load needs to load 200 Million rows per day.The time window available is 6 hours
Input format .txt/.csv files.
The input files would come from 3 source systems.Each source system would split the data into multiple files.
Output format is .txt files.
Transformations: Simple to Medium consisting of generating new columns and a couple of lookups
It is estimated that on an average the source columns will have around 120 odd columns.
In effect,
There are no extracts,loads from Databases.
Simple -Medium transformations.
Have never had the need to do Infra sizing before.
Would appreciate if you can give me any pointers about how to work out the sizing for this project.