Search found 8 matches

by newsaur
Wed Jun 28, 2006 7:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 Enterprise Stage - Insert Into UNION ALL View
Replies: 4
Views: 3357

To Eric: Yep, DB2 allows inserting to a view under some conditions. Better yet the SQL optimizer will determine which underlying table is the target by looking at the predefined table column constraint, and therefore is able to prune the DML. This is a typical technique in DB2 to implement something...
by newsaur
Wed Jun 28, 2006 2:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 Enterprise Stage - Insert Into UNION ALL View
Replies: 4
Views: 3357

DB2 Enterprise Stage - Insert Into UNION ALL View

We have implemented pseudo range-partitioning in DB2 with UNION ALL views across multiple tables each capturing transactions of different months. To make the ETL job less dependent on the underlying range-partitioning scheme, we wanted to insert records directly into the UNION ALL view using a DB2 E...
by newsaur
Thu Jun 15, 2006 12:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Estimating memory usage requirement of a DS Job
Replies: 2
Views: 1529

Estimating memory usage requirement of a DS Job

Is there any systematic way to estimate the memory usage requirement of a particular DS Job?

Thanks.
by newsaur
Thu Jun 15, 2006 12:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataStage OSH system process PID Tracking
Replies: 2
Views: 3076

DataStage OSH system process PID Tracking

We are facing memory contention problems. With SVMON we have identified the exact system processes that are eating up gigabytes of memories (which is not expected in our development memory with very little data). With the UNIX process ID (PID), is there any way to track exactly to which DataStage Jo...
by newsaur
Mon May 08, 2006 5:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help Needed - Job Compilation is extremely slow
Replies: 7
Views: 3577

Seems to be related to number of fields in link

It seems to me the performance is much more affected by the number of fields being passed in links (in our case > 40) as opposed to the number of stages. We had some jobs with many stages but only processing a few number of fields (<8) and they seem to compile reasonably fast. Having said that we st...
by newsaur
Wed Apr 12, 2006 10:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Column generator logics automatically removed by DataStage
Replies: 1
Views: 2538

Column generator logics automatically removed by DataStage

It has occured a number of times that my column generator logics (e.g. cycle, initial=0, increment=1....etc) have been removed automatically. This happens a number of times in vairous jobs, and there is no sign of this happening until we found out when the job failed in runtime. Has anyone had simil...
by newsaur
Fri Mar 31, 2006 3:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 Timestamp Problem
Replies: 2
Views: 1421

DB2 Timestamp Problem

My DataStage installation seems to have problem dealing with Timestamp datatype with DB2. I have a simple testing job with a DB2 Enterprise Stage selecting a single timestamp column, and output to a sequential file. The job failed during execution with error "main_program: Fatal Error: Invalid ...
by newsaur
Fri Mar 31, 2006 3:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help Needed - Job Compilation is extremely slow
Replies: 7
Views: 3577

Help Needed - Job Compilation is extremely slow

The compilation of my job is taking almost 4 mins to complete and this is becoming intolerable. A typical job has around 30 stages in total including those within containers. It has 1 transformer stage and others are simply Lookup's DB2 Enterprise Stages and etc. I notice that while the job is compi...