Search found 15 matches

by sh.bangash
Wed Sep 26, 2007 2:08 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ADS as ETL tool for Telecom sector DWH
Replies: 9
Views: 2829

Fellows,
I still don't have a to the point reply over here. May be more details be inside 'Premium content' but since am not a member and don't see it becoming in next few months, so, from tehre too am not able to see the response...



Regards,
by sh.bangash
Fri Sep 21, 2007 9:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ADS as ETL tool for Telecom sector DWH
Replies: 9
Views: 2829

Hi Chullett, you are right 'ADS' is for Ascential Data Stage and also you are right in mentioning that its no more Ascential. My question was specific to Server Edition as it is what currently I have available with us. But, same question stands valid for Enterprise Edition/PX. What I am interested t...
by sh.bangash
Fri Sep 21, 2007 6:39 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ADS as ETL tool for Telecom sector DWH
Replies: 9
Views: 2829

ADS as ETL tool for Telecom sector DWH

Hi,

I need to know about use of ADS as ETL tool for telecom sector DWH. What forced me to ask this question specific to telecom dwh is the huge data size and very tight data warehouse ETL Time Window.

Please, share your experience...

Thanks and Regards,
by sh.bangash
Thu Sep 06, 2007 8:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequential file Loading 5Million Rows of Size 544 MB.
Replies: 11
Views: 3234

Hi, sorry for mentioning 26 columns its acutally 32 and yes it not a fixed column instead its a '|' separated 32 columns file. I verified the metadata, it exactly matches the column definition for the data file. But, I did found the source of this error, while browsing the actual data, I recalled th...
by sh.bangash
Thu Sep 06, 2007 3:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequential file Loading 5Million Rows of Size 544 MB.
Replies: 11
Views: 3234

Hi, refferint to last thread details; I made sure that I used same file to import meta data definition into table definitions; then I used same file as source for the sequential file. If the issue was with metadata, I wonder why ADS is displaying me only one record from the file after giving the err...
by sh.bangash
Thu Sep 06, 2007 12:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequential file Loading 5Million Rows of Size 544 MB.
Replies: 11
Views: 3234

Hi, Thank you for the valueable inputs. This time I made it more simple by just dropping a sequential file stage and linking it to a transformer stage. I imported the table definition from the same source file which contains the actual data. it imported the definition perfectly, and showed the data ...
by sh.bangash
Wed Sep 05, 2007 7:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequential file Loading 5Million Rows of Size 544 MB.
Replies: 11
Views: 3234

:-) Well, thats one of the files that I have to load daily to our Data Warehouse staging area. Yes I tried to view the data; it first gives a warning and then shows only the first row of the data. Job design is pretty simple; I used sequential file stage and transsfomer stage to write the same data ...
by sh.bangash
Wed Sep 05, 2007 6:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequential file Loading 5Million Rows of Size 544 MB.
Replies: 11
Views: 3234

Sequential file Loading 5Million Rows of Size 544 MB.

Hi All,
I tried to transform a sequential file of sizze 544 MB into another sequential file with different delimiter character; but the transformation returns after transforming only first row of the data file; can you please guide as what could be reason for it?

Regards,
Shahid.
by sh.bangash
Wed Sep 05, 2007 1:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: performance comparison of custom SQL vs ADS stage's SQL
Replies: 5
Views: 1828

Hi, Thank you for the response. Actually, while asking this question I have in mind the delta size of a source table(s). For example one source one day call detail records are of approx. 35 GB per day and if i load and transform it using ADS stages, what ETL time performance impact it will have as c...
by sh.bangash
Tue Sep 04, 2007 10:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: performance comparison of custom SQL vs ADS stage's SQL
Replies: 5
Views: 1828

Hi,
Can Any one who have done ETL through scripting and latter on moved to ADS give his experiened response?

Regards,
by sh.bangash
Tue Sep 04, 2007 9:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: performance comparison of custom SQL vs ADS stage's SQL
Replies: 5
Views: 1828

performance comparison of custom SQL vs ADS stage's SQL

Hi Gurus, I have just started using ADS for ETL, before I used to do all the ETL scripting in SQL/PLSQL, Shell scripting etc. I have a pipe separated ascii file of about 546 MB that needs to be ETLed to our data warehouse for recharges subject area. There are two approaches to it 1. write a custom s...
by sh.bangash
Thu Aug 30, 2007 7:08 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using Hashed Files
Replies: 8
Views: 3227

Hi Kumar, Thank you for the guidance; It worked! I did create a hashed file; used it to lookup country name based on country-code and wrote results to target odbc table. While working on this I oberved following: 1. When I created a hashed file; it resulted in creation of a directory which contained...
by sh.bangash
Thu Aug 30, 2007 5:32 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using Hashed Files
Replies: 8
Views: 3227

Hi, Here i list steps that I have taken to create a server job that uses hashed files, but is not working properly. 1. I dropped an ODBC-stage and cofigured it to get data from sql-server database table authors. 2. Linked it to a transformer which is actually to do a lookup of author contry code and...
by sh.bangash
Thu Aug 30, 2007 5:10 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using Hashed Files
Replies: 8
Views: 3227

Re: Using Hashed Files

Hi Kumar, Thank you for the response; but my question is what steps do I need to take to convert/make a text file to hashed file; and then using it as a source for doing lookups? Thanks, Shahid. You need to create the hash file for populating it with data. Once the hash file is created you can use t...
by sh.bangash
Thu Aug 30, 2007 4:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using Hashed Files
Replies: 8
Views: 3227

Using Hashed Files

Hi Gurus, This may sound very basic one to you; but as it is said a thousand miles journey starts with a single leap, so is case with me: By now, I know what hashed files are; for what purpose we use these. But, I need to know, 1.How do we populate these hashed files first time, for example If i hav...