Fellows,
I still don't have a to the point reply over here. May be more details be inside 'Premium content' but since am not a member and don't see it becoming in next few months, so, from tehre too am not able to see the response...
Regards,
Search found 15 matches
- Wed Sep 26, 2007 2:08 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: ADS as ETL tool for Telecom sector DWH
- Replies: 9
- Views: 2829
- Fri Sep 21, 2007 9:59 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: ADS as ETL tool for Telecom sector DWH
- Replies: 9
- Views: 2829
Hi Chullett, you are right 'ADS' is for Ascential Data Stage and also you are right in mentioning that its no more Ascential. My question was specific to Server Edition as it is what currently I have available with us. But, same question stands valid for Enterprise Edition/PX. What I am interested t...
- Fri Sep 21, 2007 6:39 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: ADS as ETL tool for Telecom sector DWH
- Replies: 9
- Views: 2829
ADS as ETL tool for Telecom sector DWH
Hi,
I need to know about use of ADS as ETL tool for telecom sector DWH. What forced me to ask this question specific to telecom dwh is the huge data size and very tight data warehouse ETL Time Window.
Please, share your experience...
Thanks and Regards,
I need to know about use of ADS as ETL tool for telecom sector DWH. What forced me to ask this question specific to telecom dwh is the huge data size and very tight data warehouse ETL Time Window.
Please, share your experience...
Thanks and Regards,
- Thu Sep 06, 2007 8:18 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sequential file Loading 5Million Rows of Size 544 MB.
- Replies: 11
- Views: 3234
Hi, sorry for mentioning 26 columns its acutally 32 and yes it not a fixed column instead its a '|' separated 32 columns file. I verified the metadata, it exactly matches the column definition for the data file. But, I did found the source of this error, while browsing the actual data, I recalled th...
- Thu Sep 06, 2007 3:46 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sequential file Loading 5Million Rows of Size 544 MB.
- Replies: 11
- Views: 3234
Hi, refferint to last thread details; I made sure that I used same file to import meta data definition into table definitions; then I used same file as source for the sequential file. If the issue was with metadata, I wonder why ADS is displaying me only one record from the file after giving the err...
- Thu Sep 06, 2007 12:26 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sequential file Loading 5Million Rows of Size 544 MB.
- Replies: 11
- Views: 3234
Hi, Thank you for the valueable inputs. This time I made it more simple by just dropping a sequential file stage and linking it to a transformer stage. I imported the table definition from the same source file which contains the actual data. it imported the definition perfectly, and showed the data ...
- Wed Sep 05, 2007 7:22 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sequential file Loading 5Million Rows of Size 544 MB.
- Replies: 11
- Views: 3234
:-) Well, thats one of the files that I have to load daily to our Data Warehouse staging area. Yes I tried to view the data; it first gives a warning and then shows only the first row of the data. Job design is pretty simple; I used sequential file stage and transsfomer stage to write the same data ...
- Wed Sep 05, 2007 6:50 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sequential file Loading 5Million Rows of Size 544 MB.
- Replies: 11
- Views: 3234
Sequential file Loading 5Million Rows of Size 544 MB.
Hi All,
I tried to transform a sequential file of sizze 544 MB into another sequential file with different delimiter character; but the transformation returns after transforming only first row of the data file; can you please guide as what could be reason for it?
Regards,
Shahid.
I tried to transform a sequential file of sizze 544 MB into another sequential file with different delimiter character; but the transformation returns after transforming only first row of the data file; can you please guide as what could be reason for it?
Regards,
Shahid.
- Wed Sep 05, 2007 1:46 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: performance comparison of custom SQL vs ADS stage's SQL
- Replies: 5
- Views: 1828
Hi, Thank you for the response. Actually, while asking this question I have in mind the delta size of a source table(s). For example one source one day call detail records are of approx. 35 GB per day and if i load and transform it using ADS stages, what ETL time performance impact it will have as c...
- Tue Sep 04, 2007 10:45 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: performance comparison of custom SQL vs ADS stage's SQL
- Replies: 5
- Views: 1828
- Tue Sep 04, 2007 9:48 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: performance comparison of custom SQL vs ADS stage's SQL
- Replies: 5
- Views: 1828
performance comparison of custom SQL vs ADS stage's SQL
Hi Gurus, I have just started using ADS for ETL, before I used to do all the ETL scripting in SQL/PLSQL, Shell scripting etc. I have a pipe separated ascii file of about 546 MB that needs to be ETLed to our data warehouse for recharges subject area. There are two approaches to it 1. write a custom s...
- Thu Aug 30, 2007 7:08 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using Hashed Files
- Replies: 8
- Views: 3227
Hi Kumar, Thank you for the guidance; It worked! I did create a hashed file; used it to lookup country name based on country-code and wrote results to target odbc table. While working on this I oberved following: 1. When I created a hashed file; it resulted in creation of a directory which contained...
- Thu Aug 30, 2007 5:32 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using Hashed Files
- Replies: 8
- Views: 3227
Hi, Here i list steps that I have taken to create a server job that uses hashed files, but is not working properly. 1. I dropped an ODBC-stage and cofigured it to get data from sql-server database table authors. 2. Linked it to a transformer which is actually to do a lookup of author contry code and...
- Thu Aug 30, 2007 5:10 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using Hashed Files
- Replies: 8
- Views: 3227
Re: Using Hashed Files
Hi Kumar, Thank you for the response; but my question is what steps do I need to take to convert/make a text file to hashed file; and then using it as a source for doing lookups? Thanks, Shahid. You need to create the hash file for populating it with data. Once the hash file is created you can use t...
- Thu Aug 30, 2007 4:44 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using Hashed Files
- Replies: 8
- Views: 3227
Using Hashed Files
Hi Gurus, This may sound very basic one to you; but as it is said a thousand miles journey starts with a single leap, so is case with me: By now, I know what hashed files are; for what purpose we use these. But, I need to know, 1.How do we populate these hashed files first time, for example If i hav...