Search found 110 matches

by jasper
Fri Mar 18, 2005 6:08 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: change data capture on oracle
Replies: 4
Views: 1306

if I look at this document it states that it compares a before image to an after image and the output are the changes you need to do to the before to get the after. This is not what I mean. I'm talking about a table with 100mlj+ rows . so what i need is what is provided in the Oracle change data cap...
by jasper
Fri Mar 18, 2005 4:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: change data capture on oracle
Replies: 4
Views: 1306

change data capture on oracle

by searching this forum I've found references about change data capture(CDC) on an oracle DB. Going trough the datastage documents I can only find the change capture stage which needs the before and after images. Is there a stage that really does change data capture? ifso is it a seperate product?wh...
by jasper
Wed Mar 09, 2005 3:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I count distinct rows in the aggregator?
Replies: 6
Views: 12027

Code: SELECT COUNT(DISTINCT COLUMN_01), COUNT(DISTINCT COLUMN_02) FROM TABLENAME Even oracle can do this, so it can't be hard. I'm also wondering why this is so hard, for me it's very standard in an aggregator to have something like select count(A),count(distinct A),count(B),count(distinct B) If th...
by jasper
Wed Mar 09, 2005 3:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: count distinct
Replies: 3
Views: 1862

count distinct

in an aggregation job we need to calculate a count distinct.
How do we do this, it is not a standard option in the aggregator-stage.
by jasper
Tue Mar 08, 2005 7:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: automatic job design
Replies: 6
Views: 2029

thanx,
after the hint from Sainath.Srinivasan I checked this and this is only a part of what I mean. as mentioned somewhere in this forum own creation of inteligent assistants is actually what I would need.
I'll see how far I can get with editing xml-files.
by jasper
Tue Mar 08, 2005 1:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: automatic job design
Replies: 6
Views: 2029

automatic job design

when starting with a new part in a dwh there's always some new jobs that are very simple, like copying tables from one DB to another, creating simple dimensions etc. For these we have some templates, but then still I find there's a lot of dumb effort, for filling out tablenames, colums and so on. Fo...
by jasper
Wed Feb 09, 2005 9:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: security
Replies: 6
Views: 2162

umask is set to 002 as said in the documentation. We've read all we could find in the DS-docs, without success. all unix-related security is correct. After some tests we found that the PDdtsuser can logon to a new project, as long as we didn't open the project with the PDdtsadm user trough datastage...
by jasper
Tue Feb 08, 2005 8:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: security
Replies: 6
Views: 2162

after the previous message we saw some other problems also, so we started with a fresh install. What happens now is that I'm able to log into director using the nonadmin user. But after opening the project trough administrator with the admin user, we again get access denie for the non-admin user. Wh...
by jasper
Tue Jan 18, 2005 1:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: security
Replies: 6
Views: 2162

security

hi, we've set up Datastage on a unix-box with the user PDdtsadm as datastage-admin (stands for production datastage admin). We've created a group in which we've also added a user PDdtsuser. Logging in to unix this user seems to have access to all datastage folders. When we connect trough director or...
by jasper
Mon Jan 10, 2005 6:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: cleaning up of diskspace
Replies: 1
Views: 1112

cleaning up of diskspace

We've been using DS now for some months and when we check the scratch-disks and the resource-disk dirs it seems that files from the first day are still there. (dirs as given in the configfile:node "node1" { fastname "serv" pools "" resource disk "dir/node01/disk00/...
by jasper
Tue Dec 28, 2004 3:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: lookup based on rules
Replies: 3
Views: 1765

T42,
thanx for the suggestion, this is however something I've allready tried. Since business rules require the opposite approach (first 8, then 7,...) This actually takes longer then doing all lookups in one lookup-stage and apply the logic later.


Ray,
I'll try your suggestion, thanx.
by jasper
Mon Dec 27, 2004 8:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: lookup based on rules
Replies: 3
Views: 1765

lookup based on rules

For an aggregation of (telephony)call-data I need to find the type of call. This is based on the first digits of the number being called(usually called the significant digits). Problem however is that the number of digits that matters is not always equal. sometimes first 2 is enough, but it can go u...
by jasper
Mon Nov 22, 2004 8:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: forwarding invocationid's to lower level-jobs
Replies: 5
Views: 1670

forwarding invocationid's to lower level-jobs

Hi, For our datawarehouse we have a standard set of small jobs that should be run at the beginning of each workflow. These jobs are combined in a workflow wsetparameters. wsetparameters is offcource defined to allow multiple instances. Also all jobs being called in this workflow are defined as multi...
by jasper
Fri Oct 29, 2004 1:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: unable to use job after abort
Replies: 6
Views: 4585

unable to use job after abort

hi, We just started production on our datastage based dwh and off cource the first day datastage starts acting up. We have a job that runs 60 times a day. first 30 runs went ok, but then it gave the error: Transform,1: dspipe_wait(12252): Writer(12279) process has terminated. and aborts. after reset...
by jasper
Thu Oct 07, 2004 6:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Oracle Stage
Replies: 3
Views: 2381

Raj, looks like a problem I've had. Also with oracle stage, but this actually had nothing to do with it. Check out : http://www.dsxchange.com/viewtopic.php?t=87373 which handles about problems with the monitor. the floating point not fully supported is a problem I'm also getting. I have this when I ...