Search found 8 matches
- Wed Jun 28, 2006 7:21 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DB2 Enterprise Stage - Insert Into UNION ALL View
- Replies: 4
- Views: 3357
To Eric: Yep, DB2 allows inserting to a view under some conditions. Better yet the SQL optimizer will determine which underlying table is the target by looking at the predefined table column constraint, and therefore is able to prune the DML. This is a typical technique in DB2 to implement something...
- Wed Jun 28, 2006 2:23 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DB2 Enterprise Stage - Insert Into UNION ALL View
- Replies: 4
- Views: 3357
DB2 Enterprise Stage - Insert Into UNION ALL View
We have implemented pseudo range-partitioning in DB2 with UNION ALL views across multiple tables each capturing transactions of different months. To make the ETL job less dependent on the underlying range-partitioning scheme, we wanted to insert records directly into the UNION ALL view using a DB2 E...
- Thu Jun 15, 2006 12:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Estimating memory usage requirement of a DS Job
- Replies: 2
- Views: 1529
Estimating memory usage requirement of a DS Job
Is there any systematic way to estimate the memory usage requirement of a particular DS Job?
Thanks.
Thanks.
- Thu Jun 15, 2006 12:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataStage OSH system process PID Tracking
- Replies: 2
- Views: 3076
DataStage OSH system process PID Tracking
We are facing memory contention problems. With SVMON we have identified the exact system processes that are eating up gigabytes of memories (which is not expected in our development memory with very little data). With the UNIX process ID (PID), is there any way to track exactly to which DataStage Jo...
- Mon May 08, 2006 5:17 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Help Needed - Job Compilation is extremely slow
- Replies: 7
- Views: 3577
Seems to be related to number of fields in link
It seems to me the performance is much more affected by the number of fields being passed in links (in our case > 40) as opposed to the number of stages. We had some jobs with many stages but only processing a few number of fields (<8) and they seem to compile reasonably fast. Having said that we st...
- Wed Apr 12, 2006 10:41 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Column generator logics automatically removed by DataStage
- Replies: 1
- Views: 2538
Column generator logics automatically removed by DataStage
It has occured a number of times that my column generator logics (e.g. cycle, initial=0, increment=1....etc) have been removed automatically. This happens a number of times in vairous jobs, and there is no sign of this happening until we found out when the job failed in runtime. Has anyone had simil...
- Fri Mar 31, 2006 3:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DB2 Timestamp Problem
- Replies: 2
- Views: 1421
DB2 Timestamp Problem
My DataStage installation seems to have problem dealing with Timestamp datatype with DB2. I have a simple testing job with a DB2 Enterprise Stage selecting a single timestamp column, and output to a sequential file. The job failed during execution with error "main_program: Fatal Error: Invalid ...
- Fri Mar 31, 2006 3:46 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Help Needed - Job Compilation is extremely slow
- Replies: 7
- Views: 3577
Help Needed - Job Compilation is extremely slow
The compilation of my job is taking almost 4 mins to complete and this is becoming intolerable. A typical job has around 30 stages in total including those within containers. It has 1 transformer stage and others are simply Lookup's DB2 Enterprise Stages and etc. I notice that while the job is compi...