Search found 47 matches

by tracy
Mon Dec 21, 2009 6:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Letting People Run ETL without needing to know the Passwords
Replies: 2
Views: 1526

Thanks! It's the simple things that elude me... and make me happy. Thanks for pointing that out. We'll definitely use it.
by tracy
Mon Dec 21, 2009 6:09 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Letting People Run ETL without needing to know the Passwords
Replies: 2
Views: 1526

Letting People Run ETL without needing to know the Passwords

When I hit Run in Director in our production environment, the default parameters are those I used in my dev environment so I have to type in the production parameter values. I don't like this because: 1. Sometimes I mistype and my job fails. 2. Not everybody who can kick off the ETL will know what t...
by tracy
Mon Dec 21, 2009 6:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Kicking off ETL from another app
Replies: 1
Views: 1142

Kicking off ETL from another app

I'm not sure where to go for this question or what keywords to search on. When we kick off ETL, we've done it in one of three ways: 1. Click the run button either in Designer or Director, enter the parameters, let it run. 2. Schedule it in Director. 3. One of our jobs that needs look for a file ever...
by tracy
Wed Dec 09, 2009 5:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hashed / Universe Performance
Replies: 8
Views: 4290

Thanks again for the help, chulett. I didn't have much luck with it if I didn't at least rebuild the index each time. So to play it safe, I deleted, created, and rebuild the indexes each time. I think I'm all set now and am setting the status to resolved. I've applied the same technique to my other ...
by tracy
Mon Dec 07, 2009 1:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hashed / Universe Performance
Replies: 8
Views: 4290

Thanks again, chulett! I didn't know about the "multi-row result set" link property. I toggled that and it appears to be working to give me multiple records on the output. But the more I start working with it, the less I'm comfortable with the output. So I'm thinking this isn't a great opt...
by tracy
Mon Dec 07, 2009 1:32 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hashed / Universe Performance
Replies: 8
Views: 4290

I haven't had any luck with these Indexes yet. One of the things I saw while looking through other posts was using the Universe Stage to join by some but not all of the keys. Could I use this technique as a workaround to my issue? For instance, if I just joined on the CODE and not the dates, would I...
by tracy
Tue Dec 01, 2009 12:23 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hashed / Universe Performance
Replies: 8
Views: 4290

Thanks! There's lots of stuff out there for me to review. So far, I've done this in Administrator: CREATE.INDEX HASHED_FILE CODE START_DATE END_DATE BUILD.INDEX HASHED_FILE ALL It seems to have done it successfully, but now my job is running even slower. Before I saw 2 rows per second. Now it's just...
by tracy
Mon Nov 30, 2009 6:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hashed / Universe Performance
Replies: 8
Views: 4290

Hashed / Universe Performance

My data in a Sequential file looks something like this: A 05/18/2009 100 A 06/03/2009 50 B 08/01/2009 40 C 07/01/2009 5 I've got a lookup table that looks something like this: A 05/01/2009 06/30/2009 B 07/01/2009 12/31/2009 C 01/01/2010 12/31/2012 I've loaded this into a Hashed File where all three ...
by tracy
Thu Nov 05, 2009 11:03 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Joining to Hashed File using "like" or "conta
Replies: 4
Views: 2114

Actually, once I gave up on that method and was able to start thinking of alternatives, I decided to do it with SQL in the After SQL tab after I load the data into the database. I'm doing something like this (where SEQUENTIALFILE and HASHEDFILE are now used as Oracle tables instead of DataStage obje...
by tracy
Thu Nov 05, 2009 10:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Joining to Hashed File using "like" or "conta
Replies: 4
Views: 2114

I was afraid of that. Thanks for the response. At least I can stop trying to do it more cleanly now.
by tracy
Wed Nov 04, 2009 8:31 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Joining to Hashed File using "like" or "conta
Replies: 4
Views: 2114

Joining to Hashed File using "like" or "conta

I've got a Transformer stage that has an incoming Sequential file and an incoming Hashed file. For instance, let's suppose my Sequential File has the following data: Product|Quantity AA1234|10 AA3423|50 AB3988|44 AB3099|30 My hashed file may have this: Product|Flag AA|Y AB3|N I want my output to be:...
by tracy
Wed Oct 14, 2009 2:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Twisting the data
Replies: 6
Views: 2559

This worked! I should've been able to figure that out on my own. Thanks for answering my stupid question. :wink:
by tracy
Mon Oct 12, 2009 1:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Processing First Record Differently Than Others
Replies: 5
Views: 2189

Thanks! I used the "head -1" in the Filter option of the stage since it was the first and easiest suggestion. Works like a charm.

I wasn't aware of this feature. It's going to come in really handy. Thanks![/u]
by tracy
Fri Oct 09, 2009 7:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Twisting the data
Replies: 6
Views: 2559

Twisting the data

I'm not sure what the terminology is for this situation, so I'm not sure how to search for a solution. I've got a data file where a record looks like this: 09/09/2009|Tracy|Red|Green|Blue|Orange I want to insert that into my database as 4 records like this: 09/09/2009 Tracy Red 09/09/2009 Tracy Gree...
by tracy
Fri Oct 09, 2009 6:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Processing First Record Differently Than Others
Replies: 5
Views: 2189

Processing First Record Differently Than Others

I've got a data file being sent to me that has various Record Types. For instance: RecordType1|10 RecordType2|09/09/2009|Tracy|3 RecordType2|09/08/2009|Tracy|5 RecordType2|09/10/2009|Tracy|2 Record Type 1 is a validation record. I need to add up the numbers in all Record Type 2's and make sure it ma...