Search found 251 matches

by rleishman
Tue Sep 27, 2005 4:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Oracle Performance Tuning - Bulk / Direct / OCI / Updates
Replies: 14
Views: 31469

Oracle Performance Tuning - Bulk / Direct / OCI / Updates

There's quite a few interesting posts in this forum that deal with performance issues writing data to Oracle. I've done some benchmarking lately, and thought I'd drag together all that old info and bring it up to date. Ideally, I'd like this to become the go-to thread for Oracle loading performance ...
by rleishman
Mon Sep 26, 2005 10:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Encrypted Environment variables
Replies: 14
Views: 11448

Jet, Try this: * Open Job JOB1 * Set the value of encrypted Env Var $Password (or whatever..) to $PROJDEF * Save and compile JOB1 * Create Job Sequence JS1 * Do NOT include $Password in the parameter page for JS1. * Drag JOB1 into JS1 as a Job Activity * Open up the Job Activity JOB1, and set the en...
by rleishman
Mon Sep 26, 2005 6:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Encrypted Environment variables
Replies: 14
Views: 11448

For the uninitiated pre-7.5'ers out there: This all works perfectly in 7.5 and 7.5.1a. You type in the Encrypted Environment Variable in Administrator and it appears as *******. Only the person who types it in need know what it is. The only risk of letting others into Administrator is that they will...
by rleishman
Mon Sep 26, 2005 4:55 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job has finished, status = 96 (Crashed)
Replies: 3
Views: 2067

OK. So you have the log file and the STDOUT, so I am assuming that you have checked them both and found: - sqlldr finished successfully without error - ALL rows were successfully loaded into the database Sounds like something a bit more sinister is going on. Depending on the flavour of Unix you are ...
by rleishman
Mon Sep 26, 2005 4:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Encrypted Environment variables
Replies: 14
Views: 11448

Ahhh. Victim of my own inexperience. I've never used pre-7.5.
by rleishman
Mon Sep 26, 2005 4:22 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating folders dynamically on Unix via DataStage
Replies: 10
Views: 6734

4. Write a job that transforms the directory names one per row to a dummy Sequential File stage (the file name is not important - you won't even use it), and place a filter on the Sequential Stage of

Code: Select all

xargs mkdir -p
by rleishman
Mon Sep 26, 2005 3:10 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Encrypted Environment variables
Replies: 14
Views: 11448

Not to my knowledge. You have to get the DBA to come around to your desk and type the password into DS Administrator. Alternatively you could install the DS Administrator client on the DBA's PC. That is how we are doing it.

You could always go with OS level authentication...
by rleishman
Mon Sep 26, 2005 1:42 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Encrypted Environment variables
Replies: 14
Views: 11448

Jet, Is it possible that you initially set it up as String and only later changed it to Encrypted? If so, then you must delete the parameter from each job where it is used and add it back in again. When you add it back in it should have type Encrypted rather than String. Overtype the default value w...
by rleishman
Mon Sep 26, 2005 12:28 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job has finished, status = 96 (Crashed)
Replies: 3
Views: 2067

Arun, For a job to finish successfully, the After-Job Subroutine must finish with a 0 error code (2nd arg of the routine). Make sure you have ErrorCode = 0, and are not inadvertently setting ErrorCode to something else. Even if this were the case, I suspect the problem goes deeper because DS should ...
by rleishman
Sun Sep 25, 2005 11:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to use oracle hints in datastage
Replies: 10
Views: 6275

Ahhhh. The veil has been withdrawn!!! Column Generated is my new best friend. :mrgreen: It even lets you slip a DISTINCT into the derivation of the first column.

The SQL Builder should come with compulsory public health warnings.

Thanks for your help guys.
by rleishman
Sun Sep 25, 2005 11:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Row locking problem in Hash File
Replies: 9
Views: 4134

Nice, 492 pages :x

I'll check with the client to see if they want to employ a UV DBA. Until I get a response from them, I think I'll just make sure I release my locks. :)
by rleishman
Sun Sep 25, 2005 10:58 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to use oracle hints in datastage
Replies: 10
Views: 6275

Has anyone tried Craig's technique of including the Hint in the expression for the first column using Designer 7.5.1.A. They've upgraded the OCI SQL-builder tool and it's a bit of a syntax-Nazi. I actually wanted to use the same technique to place a DISTINCT before the first column name, but I canno...
by rleishman
Sun Sep 25, 2005 10:11 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Row locking problem in Hash File
Replies: 9
Views: 4134

Kim, My sincerest apologies over the "Ken" thing :oops: - I'll get my glasses checked. The "run out of locks" thing sound promising! The routine does a readu and then just moves on to the next row if it exists - it does not release the row. The write is performed only when the re...
by rleishman
Sun Sep 25, 2005 9:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Row locking problem in Hash File
Replies: 9
Views: 4134

Ken, Advice noted: I should not write after a read because someone else may have locked/updated it in the meantime. In this instance I don't need the writeu because I never intend to update the row again. But what if I did want to update the row again? The SDK routine KeyMgtGetNextValue is an exampl...