Search found 47 matches
- Mon Dec 21, 2009 6:26 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Letting People Run ETL without needing to know the Passwords
- Replies: 2
- Views: 1526
- Mon Dec 21, 2009 6:09 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Letting People Run ETL without needing to know the Passwords
- Replies: 2
- Views: 1526
Letting People Run ETL without needing to know the Passwords
When I hit Run in Director in our production environment, the default parameters are those I used in my dev environment so I have to type in the production parameter values. I don't like this because: 1. Sometimes I mistype and my job fails. 2. Not everybody who can kick off the ETL will know what t...
- Mon Dec 21, 2009 6:03 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Kicking off ETL from another app
- Replies: 1
- Views: 1142
Kicking off ETL from another app
I'm not sure where to go for this question or what keywords to search on. When we kick off ETL, we've done it in one of three ways: 1. Click the run button either in Designer or Director, enter the parameters, let it run. 2. Schedule it in Director. 3. One of our jobs that needs look for a file ever...
- Wed Dec 09, 2009 5:37 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hashed / Universe Performance
- Replies: 8
- Views: 4290
Thanks again for the help, chulett. I didn't have much luck with it if I didn't at least rebuild the index each time. So to play it safe, I deleted, created, and rebuild the indexes each time. I think I'm all set now and am setting the status to resolved. I've applied the same technique to my other ...
- Mon Dec 07, 2009 1:02 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hashed / Universe Performance
- Replies: 8
- Views: 4290
- Mon Dec 07, 2009 1:32 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hashed / Universe Performance
- Replies: 8
- Views: 4290
I haven't had any luck with these Indexes yet. One of the things I saw while looking through other posts was using the Universe Stage to join by some but not all of the keys. Could I use this technique as a workaround to my issue? For instance, if I just joined on the CODE and not the dates, would I...
- Tue Dec 01, 2009 12:23 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hashed / Universe Performance
- Replies: 8
- Views: 4290
Thanks! There's lots of stuff out there for me to review. So far, I've done this in Administrator: CREATE.INDEX HASHED_FILE CODE START_DATE END_DATE BUILD.INDEX HASHED_FILE ALL It seems to have done it successfully, but now my job is running even slower. Before I saw 2 rows per second. Now it's just...
- Mon Nov 30, 2009 6:18 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hashed / Universe Performance
- Replies: 8
- Views: 4290
Hashed / Universe Performance
My data in a Sequential file looks something like this: A 05/18/2009 100 A 06/03/2009 50 B 08/01/2009 40 C 07/01/2009 5 I've got a lookup table that looks something like this: A 05/01/2009 06/30/2009 B 07/01/2009 12/31/2009 C 01/01/2010 12/31/2012 I've loaded this into a Hashed File where all three ...
- Thu Nov 05, 2009 11:03 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Joining to Hashed File using "like" or "conta
- Replies: 4
- Views: 2114
Actually, once I gave up on that method and was able to start thinking of alternatives, I decided to do it with SQL in the After SQL tab after I load the data into the database. I'm doing something like this (where SEQUENTIALFILE and HASHEDFILE are now used as Oracle tables instead of DataStage obje...
- Thu Nov 05, 2009 10:29 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Joining to Hashed File using "like" or "conta
- Replies: 4
- Views: 2114
- Wed Nov 04, 2009 8:31 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Joining to Hashed File using "like" or "conta
- Replies: 4
- Views: 2114
Joining to Hashed File using "like" or "conta
I've got a Transformer stage that has an incoming Sequential file and an incoming Hashed file. For instance, let's suppose my Sequential File has the following data: Product|Quantity AA1234|10 AA3423|50 AB3988|44 AB3099|30 My hashed file may have this: Product|Flag AA|Y AB3|N I want my output to be:...
- Wed Oct 14, 2009 2:30 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Twisting the data
- Replies: 6
- Views: 2559
- Mon Oct 12, 2009 1:37 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Processing First Record Differently Than Others
- Replies: 5
- Views: 2189
- Fri Oct 09, 2009 7:08 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Twisting the data
- Replies: 6
- Views: 2559
Twisting the data
I'm not sure what the terminology is for this situation, so I'm not sure how to search for a solution. I've got a data file where a record looks like this: 09/09/2009|Tracy|Red|Green|Blue|Orange I want to insert that into my database as 4 records like this: 09/09/2009 Tracy Red 09/09/2009 Tracy Gree...
- Fri Oct 09, 2009 6:20 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Processing First Record Differently Than Others
- Replies: 5
- Views: 2189
Processing First Record Differently Than Others
I've got a data file being sent to me that has various Record Types. For instance: RecordType1|10 RecordType2|09/09/2009|Tracy|3 RecordType2|09/08/2009|Tracy|5 RecordType2|09/10/2009|Tracy|2 Record Type 1 is a validation record. I need to add up the numbers in all Record Type 2's and make sure it ma...