Search found 251 matches

by rleishman
Thu Jan 12, 2006 1:13 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Pivot Stage Performance
Replies: 3
Views: 1570

Pivot Stage Performance

I have a bunch of jobs where I want to convert financial transactions into journals. ie. For each transaction coming in, I generate 2 transactions with mostly the same column vals except the amount column where the sign is reversed. Being a newbie (and not knowing about the Pivot stage, which was no...
by rleishman
Mon Dec 12, 2005 6:57 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Duplicates/Sorting question
Replies: 17
Views: 9189

Since my earlier post, I have made some changes to the code of this routine. The new code is below. The unix command goes to the directory where the hash files are stored, removes the hash file if it exists (ie. from a previous run) and re-creates it. It sould be pretty simple to do in DOS, but you ...
by rleishman
Tue Dec 06, 2005 5:35 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: OCI_INVALID_HANDLE with Link Collector
Replies: 0
Views: 854

OCI_INVALID_HANDLE with Link Collector

I'm trying to do a UNION ALL of 3 SQL statements on the same database. Rather than have one big&nasty user-defined SQL, I have written the 3 statements separately as a Column Generated SQL, and concatenated them with a Round Robin Link Collector. Furthermore, since they are all run on the same O...
by rleishman
Wed Nov 23, 2005 7:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Parameter Compilation Error
Replies: 8
Views: 2211

Haven't got the error happening right now, but I tried what you suggested on a seq that was getting the error earlier, and it compiled fine; no "correct" error. I have found that simply closing Designer and Reopening it solves this problem. Looks like I went in a bit hard bringing down the...
by rleishman
Wed Nov 23, 2005 7:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Validating all fields of a row & send errors to ErrFile/
Replies: 7
Views: 2359

I have seen an idea posted in this forum whereby you concatenate the messages with a line feed character (ASCII 10) between each one, and them write them directly to a sequential file. So, if a single input row has 4 errors, a single "row" is written to the output but it actually comes out...
by rleishman
Wed Nov 23, 2005 1:00 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to handle different DB schemas for Dev, Test and Prod
Replies: 6
Views: 2276

Are you using 7.5.1A? Is, read this.
by rleishman
Mon Nov 21, 2005 5:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Parameter Compilation Error
Replies: 8
Views: 2211

I seem to be opening a lot of old threads lately.... Normal apologies apply, but this too is a relevant followup (since there was no other followup on this thread). I too had the same problem as kab123. It happened after I exported/imported/compiled all jobs: sequences that used Env Vars in trigger ...
by rleishman
Sun Nov 20, 2005 8:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Clearing Logs
Replies: 6
Views: 3018

Sorry to reopen an old thread, but there was an unanswered thought that was useful to me, and possibly will be to others. Something else you can try. Export all of your jobs. Reimport all of the jobs. They should now have the new defaults. I think. (try it with one first) :wink: Tried it (with one f...
by rleishman
Thu Nov 17, 2005 8:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Lookup Problem
Replies: 1
Views: 919

Have a look at the SQL generated by the lookup. It will probably be something like WHERE address1 = :1 AND address2 = :2 AND address3 = :3 Replace :3 with a NULL value, and this won't work even from your DB2 client. NULL is never "equal" to anything. If address2 and 3 are nullable, then yo...
by rleishman
Thu Nov 17, 2005 8:15 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Wildcards in output sequential file...
Replies: 12
Views: 6413

It worked a lot better in my head. Is it my fault DataStage can't keep up? It seems that DS somehow switches globbing off !?! Even if you try to expand a * in a shell script it doesn't expand. So, if DS can't/won't glob, get someone else to do it for you; like my old friend Perl. Sequential File Sta...
by rleishman
Thu Nov 17, 2005 12:31 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error
Replies: 16
Views: 7253

You have an error in a Server Routine called GetNextElemSequence(). Go to Routines in the Navigator pane of Developer, and look for this routine. Look in the vicinity of Line 22 - this is where the error is occurring. I think I've had this error before trying to do a hash file lookup with a NULL key...
by rleishman
Thu Nov 17, 2005 12:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Wildcards in output sequential file...
Replies: 12
Views: 6413

Technically, if you didn't care about elegant coding, and you hated the support guys, and they hated you, you could:

- Put /dev/null in the File Name
- Put cat /path/*.txt in the Filter Command
by rleishman
Wed Nov 16, 2005 7:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Load Problem
Replies: 9
Views: 4089

Well, if the measure of achievement is that "You learn something new every day", I can go home early. Which is convenient, because I have a crore stuff to do. :)
by rleishman
Wed Nov 16, 2005 7:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How does DS use /tmp?
Replies: 10
Views: 4808

Perfect. Thanks Ken, thanks Ray.
by rleishman
Wed Nov 16, 2005 5:14 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How does DS use /tmp?
Replies: 10
Views: 4808

How does DS use /tmp?

We are approaching implementation of our DW in a few months, and have just been advised by the hardware mob that their standard Linux build includes a 500Mb /tmp. Our Unix SysAdmin tells us that is pretty small for a DW, and I'm inclined to agree. Normally I would just ask for 10Gb or so (disk is ch...