Search found 178 matches

by RodBarnes
Wed May 03, 2006 3:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Shared containers in parallel -- multiple instances?
Replies: 7
Views: 1881

Can they run in parallel? Yes Without conflicting one another? Depends on what you are doing in the container. Fair enough. My question is more along the general line of "does each instance get its own thread and/or variables? Or are the variables shared?" To be more specific: I have an u...
by RodBarnes
Wed May 03, 2006 2:31 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Shared containers in parallel -- multiple instances?
Replies: 7
Views: 1881

Shared containers in parallel -- multiple instances?

If I create a shared container and then use that in four separate jobs, can those jobs run in parallel without conflicting one another? Asked another way, does each job get its own instance of the shared container? I've skimmed through the posts on "shared containers" and haven't found a d...
by RodBarnes
Fri Apr 28, 2006 9:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: BEST UPSERT TECHNIC
Replies: 15
Views: 6540

Spooling, old slang for extracting the rows from a data source and writing to a target... So, it would be something like this: 1) Insert extracted keys into temp table in DB. 2) Inner join to get list of existing keys and output from DB to hash file. 3) Process extracted rows using hash file to upd...
by RodBarnes
Fri Apr 28, 2006 9:28 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: BEST UPSERT TECHNIC
Replies: 15
Views: 6540

Spooling to a hash file

If you take the natural keys in your source data, load them into a work table in your target database, then inner join those keys to your target table and spool those rows to the hashed lookup file, your hashed file will only contain those rows found in the database... Inner join spooling is faster...
by RodBarnes
Tue Apr 18, 2006 4:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Project structure
Replies: 5
Views: 2784

Project structure

I'm at a point where I am considering a change in our project structures. I'm curious what others may be doing -- what "best practices" there may be that have proven helful. Maybe someone has a document somewhere they'd be willing to share on the ins and outs, pros and cons of particular m...
by RodBarnes
Wed Dec 21, 2005 1:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filling date mark in dynamic query
Replies: 19
Views: 5182

That should be because you'be enable to option to 'automatically handle things that fail'... I tried both your methods -- disabled the "Automatically handle activities that fail" in the sequence properties; added a trigger to handle the "failure" case -- and they both allowed pr...
by RodBarnes
Wed Dec 21, 2005 12:22 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filling date mark in dynamic query
Replies: 19
Views: 5182

A follow up question, since I have never used the Routine Activity -- and the docs basically suck with regard to explaining much about the type of routine or its contents. Though my routine is returning the right value from the file, the job log is giving me this error: seqTest..JobControl (@ReadMar...
by RodBarnes
Wed Dec 21, 2005 11:34 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filling date mark in dynamic query
Replies: 19
Views: 5182

Hi Rod, What version of DataStage are you using? Is it 7.5 and above? The Sequence can be designed as... After reading a couple of other posts (thread 97354), I realized I didn't really understand your suggestion. It helped me to see what you meant. I have never used a Routine Activity but it seems...
by RodBarnes
Wed Dec 21, 2005 11:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filling date mark in dynamic query
Replies: 19
Views: 5182

I can succesfully read a value from a file and pass that along from within a transform. I can successfully replace a job parameter in a query (e.g., a date) so that I can have a dynamic query. What I can't seem to do is take that value I obtain from the file and put it into a job parameter so that i...
by RodBarnes
Wed Dec 21, 2005 11:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filling date mark in dynamic query
Replies: 19
Views: 5182

chulett wrote:You can also take advantage of the User Status area each job has...
I am not familiar with this and a search through the docs doesn't seem to come up with anything. Can you elaborate?
by RodBarnes
Wed Dec 21, 2005 11:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filling date mark in dynamic query
Replies: 19
Views: 5182

Hi Rod, What version of DataStage are you using? Is it 7.5 and above? The Sequence can be designed as... Yes, v7.5. The method you specified was the only way I could come up with, also, and this works. I just thought there may be a more elegant way to actually read the value from the file once and ...
by RodBarnes
Wed Dec 21, 2005 10:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filling date mark in dynamic query
Replies: 19
Views: 5182

Thanks for the help but my problem isn't getting data from the file. I can do that. I am just missing something about how to get a value into a job parameter -- probably something really obvious I am just stumbling over. I tried simply doing an assignment in a transform: jpMarkTime = GetParamFromFil...
by RodBarnes
Tue Dec 13, 2005 6:12 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filling date mark in dynamic query
Replies: 19
Views: 5182

Thanks for all the replys. I can successfully replace the parameter in a dynamic query. Now I am struggling to get a date from a file (or other external, automated source) into the parameter <sigh>. I'm trying to set up a situation where I can read the date of the last good run and use that as a fil...
by RodBarnes
Mon Dec 12, 2005 5:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filling date mark in dynamic query
Replies: 19
Views: 5182

Filling date mark in dynamic query

I am sure someone has already needed to do this and come up with a way to accomplish it. Here's the situation: We have a need to pull data from a large table with 5M records and growing. We can limit this by adding a where clause that limits based upon a particular timestamp. So, with each run, I wo...
by RodBarnes
Wed Sep 14, 2005 4:14 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error viewing data in Oracle9i stage
Replies: 8
Views: 4446

I don't know if I have the answer for you but here are some thoughts: 1) At one point, I was getting a similar error (DSD.Browse) and I ended up fixing it by reinstalling the plug-in. The only thing I could figure out was that we had recently reinstalled the Oracle drivers and so maybe something in ...