DSXchange

I have templates for Server jobs thanks to Ken Bland. And if I am still to believe what he wrote almost 2 years ago, then I should try to stick with server jobs for all SCD processing. See post 'SCD In Parallel Jobs' from shivakumar on Mon Jul 31, 2006 11:58 pm Anyone want to give another opinion? :...

No one has replied to this message. I took another look and it seems I get these messages for any SQL where I join two or more tables. If I select from only one table the messages do not appear. I tried many things and the jobs actually run fine, but no matter what I tried (custom rather than genera...

To my knowledge, this is a pure vanilla installation of DB2 and DataStage. I am surprised if no one else has seen this behavior before. Anybody out there used DB2 bulk load and experienced similar results?

We are using the IBM DB2 UDB Bulk Loader stage and it works OK, but when there are messages in the log which should be warnings or fatal errors they are not handled correctly. Has anyone written code to inspect the logs? Or is there a better way to handle this? Here is my latest example: We are load...

thanks - the problem was indeed that each of the two rows was being processed by a different partition (8 node cfg)

The job only processes 2 rows, so I simply changed it to run in sequential mode.

I am having trouble with the values of Stage variables being retained from one row to the next. In Server this always worked, but in PX the variables all seem to be reset to zero or null as each row is processed. example 2 varables: VarSave integer(10) initial value 0 Var1 integer(10) initial value ...

the problem here is that I haven't any idea which stage much less which column is causing this error. We're getting more than 50 and the job aborts. I'm afraid to let it run with maybe a million warnings.

I get a bunch of these warnings from my Parallel job and I don't have a clue which stage they are coming from: APT_CombinedOperatorController(3),2: APT_Decimal::ErrorBase: From: the source decimal has even precision, but non-zero in the leading nybble, or is too large for the destination decimal..Re...

I have a job which is using the DB2 UDB API (non-parallel) stage in a Parallel job. The job works just fine but the following warning messages come out (all three, just once per run) and they sure make no sense to me. join_STG_REBATE_CLAIM_REJECT_to_PHARMACY_DATA_FACT,0: Invalid character(s) ([xFC])...

I find this all very strange when used to server of course, but I did determine that the Merge Stage caused the padding with x'00' on the key fields. I managed to work around the problem by putting a transform stage with a Convert(from_Merge.column_name, char(00), ' '). This turned all the nulls to ...

I have written my first Parallel jobs and when I look at the data loaded to the DB2 table, the CHAR fields are padded with 'low values' (x'00') not spaces. I create a dataset in the first job and merge it with a seq file in the second and send the rejects (no match for the seq file) to a data set an...

You should avoid using anything but a hash file for lookups. Since you are using Oracle as a lookup, a separate SELECT query is done for each and every lookup. So you should actually consider yourself very lucky getting 13 queries returned every second. That's not 13 rows from a query that's 13 sepa...

I would like to access all the ENVIRONMENT VARIABLES and their values within a DataStage BASIC Routine. There is an API function called "DSListEnvVars" which can give me what I need. There is no corresponding DS basic function (closest one is "DSGetProjectInfo"). I am not afraid ...

It took me a while to decifer what the solution was but I finally got it. I thought I'd summarize: We wanted to call a stored procedure to TRUNCATE A TABLE prior to inserting new rows. I wanted to put it in the Before SQL tab of the Oracle OCI - sorry no way. So I read and re-read these posts. I fin...

Also try "ps -ef |grep phantom" to show UNIX processes running with "phantom" in the name