ADS as ETL tool for Telecom sector DWH
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 15
- Joined: Wed Aug 01, 2007 5:23 am
- Location: Islamabad
ADS as ETL tool for Telecom sector DWH
Hi,
I need to know about use of ADS as ETL tool for telecom sector DWH. What forced me to ask this question specific to telecom dwh is the huge data size and very tight data warehouse ETL Time Window.
Please, share your experience...
Thanks and Regards,
I need to know about use of ADS as ETL tool for telecom sector DWH. What forced me to ask this question specific to telecom dwh is the huge data size and very tight data warehouse ETL Time Window.
Please, share your experience...
Thanks and Regards,
Shahid.
So... "ADS" is "Ascential DataStage" I assume? There is no longer an "Ascential" here, it's "IBM Websphere DataStage". And were you forced to ask this question strictly regarding the Server product as you've marked the post or is the Enterprise Edition / PX a valid option as well?
I'd wager anyone here doing "huge data size tight ETL window telecom sector DWH" is using PX.![Wink :wink:](./images/smilies/icon_wink.gif)
I'd wager anyone here doing "huge data size tight ETL window telecom sector DWH" is using PX.
![Wink :wink:](./images/smilies/icon_wink.gif)
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 15
- Joined: Wed Aug 01, 2007 5:23 am
- Location: Islamabad
Hi Chullett,
you are right 'ADS' is for Ascential Data Stage and also you are right in mentioning that its no more Ascential. My question was specific to Server Edition as it is what currently I have available with us. But, same question stands valid for Enterprise Edition/PX.
What I am interested to know is if this packaged ETL tool can be used for ETL purpose in telecom DWH!
Regards,
you are right 'ADS' is for Ascential Data Stage and also you are right in mentioning that its no more Ascential. My question was specific to Server Edition as it is what currently I have available with us. But, same question stands valid for Enterprise Edition/PX.
What I am interested to know is if this packaged ETL tool can be used for ETL purpose in telecom DWH!
Regards,
Shahid.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
There is a telco in India using a server-only DataStage implementation, relying upon multi-instance jobs to achieve scalability. They are processing crores of records per day, and the Data Warehouse is many tens of TB in size. Could be approaching 100TB by now. They're happy with it.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
I am currently helping to implement a data warehouse for a very large Telco. The scalability is provided by a grid based approach - able to grow up to hundreds of servers. Parallel version and grid management software makes this possible. There are design techniques for faster throughput such as shadow tables, ETL surrogate keys, changed data capture etc.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
-
- Participant
- Posts: 15
- Joined: Wed Aug 01, 2007 5:23 am
- Location: Islamabad
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
I don't think you missed anything, most of the answers were short enough not to get filtered. It's straight forward - DataStage handles high volumes of data and is scalable using a grid architecture, this makes it ideal for Telco data.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn