Search found 110 matches

by jasper
Tue May 27, 2008 12:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: primary key violation during install of DS8
Replies: 1
Views: 3855

primary key violation during install of DS8

Hi, we're trying to install DS8 on Solaris using Oracle for the metadata. The installation fails giving the error: (May 26, 2008 5:47:24 PM), Install_datastage, com.ascential.acs.installer.server.actions.InstallDSProjectsAction, err, ProductException: (error code = 601; message="The following p...
by jasper
Thu May 22, 2008 6:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: one project or multiple
Replies: 2
Views: 1511

one project or multiple

Hi, At this moment we have a 7.5 environment with one big production project (3000+ jobs and flows). Untill now we haven't had any issues with this size. I'm now planning a move to a datastage 8 environment (it will not be an upgrade, it's a new install on new hardware, new DB,...) and I thought thi...
by jasper
Thu May 22, 2008 12:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove duplicate Vs Upsert
Replies: 3
Views: 1450

I would focus more on the upsert to oracle part to find your fluctuations. Here the performance changes a lot depending on how many records are inserts and how many are updates. I once did a quick test on our environment where all inserts was 6 times faster then all updates. In most cases the job wi...
by jasper
Fri Nov 24, 2006 4:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Timed out while waiting for an event
Replies: 2
Views: 1318

Timed out while waiting for an event

Hi, Lately we're getting a lot of errors on wCleanupCBOAggregates..JobControl (@AGR_CBO_ORIGINATING): Controller problem: Error calling DSRunJob(CleanupAgrCBO), code=-14 [Timed out while waiting for an event] . Before anyone mentions this: I have did a search and found that this is because of an ove...
by jasper
Wed Oct 11, 2006 5:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem while using stage variables
Replies: 9
Views: 4464

don't know if it's relevant for the version of DS your using , but at one point I saw a patch about NULL values in stage variables.(some time ago, don't exactly remember the details or which version we were on at that moment)

Maybe best check if this bug is there in your version .
by jasper
Fri Sep 22, 2006 12:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: buffering parameters
Replies: 3
Views: 1430

correct forum, incorrect indication: It's a parallel job.
by jasper
Thu Sep 21, 2006 7:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: buffering parameters
Replies: 3
Views: 1430

update: It doesn't seem to be the numbers. The project is set to force buffer(APT_BUFFERING_POLICY) and all stages are left as buffering mode= default. I understood that changing this to buffering mode=buffer, without changing the params should actually do the same thing. However if I do this I get ...
by jasper
Thu Sep 21, 2006 7:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: buffering parameters
Replies: 3
Views: 1430

buffering parameters

Hi, we're sorting about 50GB of data. According to other posts unix sort should be better then datastage sort at these numbers. Now I wanted to tune further, I came along the buffering parameters, since we have a lot of IO-wait on the unix box. default these are in MB (3MB max, 1MB disk wirte increm...
by jasper
Mon Aug 21, 2006 3:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: routine to get value from hashed file
Replies: 1
Views: 1737

routine to get value from hashed file

Hi, from examples here and there I've created a routine to get data from a hashed file. This routine will be used in a workflow: -fillhash -startloop -read data from hash into variables -call some jobs for these variables -end loop As you will see in the code below, the routine now asks for the hash...
by jasper
Wed Jul 19, 2006 8:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: length of strings in jobparameters
Replies: 4
Views: 1416

I was actually thinking of looping inside datastage.

so:
job to get number of audits
LOOP for 1to number
get queries
run auditjob
END loop.
by jasper
Wed Jul 19, 2006 1:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: length of strings in jobparameters
Replies: 4
Views: 1416

length of strings in jobparameters

Hi, I'm now working on an internal audit system, that as always should be as generic as possible. It should show differences between our systems. eg: a customer that is in the sale system but not in the billing system, or that has important differences in both systems What I was planning to do: crea...
by jasper
Wed Jul 19, 2006 1:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ds takes fields from incorrect lookup
Replies: 10
Views: 2913

New virtual data set: I think this means first all data has to be processed for the lookup-file, before the real lookup can start. I think I'll go back a step then . the lookupfile is created from one oracle table and then used in multiple jobs. But if it has to be processed again, maybe it's better...
by jasper
Mon Jul 17, 2006 6:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ds takes fields from incorrect lookup
Replies: 10
Views: 2913

When I add a copy stage, will it then create a new workfile, or will it be able to work from the file as is? (or does this depend on the flag to force the copy stage or not?).
by jasper
Mon Jul 17, 2006 6:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ds takes fields from incorrect lookup
Replies: 10
Views: 2913

I cannot read your full text. But I can read the part about contact support. Case was opened before I made this post. I'll update here if I hear from IBM.
by jasper
Mon Jul 17, 2006 6:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ds takes fields from incorrect lookup
Replies: 10
Views: 2913

yes, indeed. But I have to do an update to my post, It seems this depends on the sequence of the links. When the lookup1 is defined as the first lookup it runs ok, when lookup1 is defined as second it takes the wrong value. In the constrains it states to 'continue' when lookup not found .Does this m...