Search found 104 matches

by algfr
Mon Jul 20, 2009 10:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup on which stage
Replies: 6
Views: 1948

Lookup on which stage

Hello guys, Just a very quick question ? I need to do a lookup on an Oracle database, is it worth loading the table into a dataset or not ? If I'm not wrong, it is no more possible to produce an output link out of an OCI stage that has an input link (except reject) which forces me to create an extra...
by algfr
Mon Jul 20, 2009 6:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CDC is capable without primary key
Replies: 13
Views: 9470

There are two options for processing Delta Data. These are CDC (Change Data Capture) and SCD (Slowly Changing Dimension). Both are almost same as per functionality but SCD is faster as far as processing speed is concerned. But there is a problem with both these stages. The input records must not ha...
by algfr
Mon Jul 20, 2009 2:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Nulls appear for business key columns on SCD Type1 update
Replies: 11
Views: 4967

Nobody has a clue ?

It really surprises me as this bug seems huge (no way to lookup on a varchar)...

I've opened a case at IBM so I'll let you know.
by algfr
Fri Jul 17, 2009 2:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Set stage; view data
Replies: 5
Views: 3658

Hi, Other than the file viewer there is not much you can use. Still, if you want to see the records in the log entries, you can use a peek stage. If you are looking for a specific record, you can use the find function in the file viewer. Or you can create a test table out of the file But what I woul...
by algfr
Fri Jul 17, 2009 8:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading a DWH using Surrogate Key Generator / SCD stage
Replies: 5
Views: 5262

The slowly changing dimension stage assumes that you maintain dimensions as you load a fact table. It is a rigid definition that is not always applicable, what about when you have conformed dimensions? How about referential integrity? The way we use the SCD stage is to load a single dimension in a ...
by algfr
Fri Jul 17, 2009 8:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading a DWH using Surrogate Key Generator / SCD stage
Replies: 5
Views: 5262

The slowly changing dimension stage assumes that you maintain dimensions as you load a fact table. It is a rigid definition that is not always applicable, what about when you have conformed dimensions? How about referential integrity? The way we use the SCD stage is to load a single dimension in a ...
by algfr
Fri Jul 17, 2009 8:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Nulls appear for business key columns on SCD Type1 update
Replies: 11
Views: 4967

It is a client patch not a server patch ?
by algfr
Fri Jul 17, 2009 8:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Nulls appear for business key columns on SCD Type1 update
Replies: 11
Views: 4967

Hello

I think I have this issue, it is a HUGE problem.

I have DS 8.01 FP1a

Could you tell me if this version has the issue or not ? I can't find it on the IBM site.
by algfr
Thu Jul 16, 2009 7:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD TYPE2 Implementation
Replies: 7
Views: 3986

Depends on the version I think.

If you use 7x, yeah, Change Capture should be the correct one as it allows you to compare new data with the old one.

Otherwise, if you're using the 8x version, you might think of using the SCD stage but only if you use surrogate keys.
by algfr
Thu Jul 16, 2009 6:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: compilation error in job using SCD stage having dbsequence
Replies: 3
Views: 7397

Try this

I had the same problem with the SCD stage.

In the step 2 out of 5, check the map. You should not have any derivation coming from the input flow except the business key !

Doing so removed the error for me.

Tell me if that works
by algfr
Fri Jul 10, 2009 11:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading a DWH using Surrogate Key Generator / SCD stage
Replies: 5
Views: 5262

Loading a DWH using Surrogate Key Generator / SCD stage

Hello guys, First I want to say that I have read the documentation, downloaded the red book and the example from IBM. I just need to know a few things that I cannot manage to clearly understand and I wuld just liek to know the general strategy. I use SK everywhere. I have a DWH to load with dimensio...
by algfr
Thu Jul 02, 2009 5:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slowly Changing Dimension stage : Quick explaination
Replies: 3
Views: 1694

Slowly Changing Dimension stage : Quick explaination

Hi people, I read all the documentation about SCD stage but I can't get to understand it. It seems I have to use it while loading the fact table. To me it should be done like this : 1) My product dim is SCD 2 so I'm using a job to compare new data to old data. if required i will generate extra rows ...
by algfr
Mon Oct 10, 2005 3:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error 11 in GCI Link initialisation
Replies: 1
Views: 1016

Re: Error 11 in GCI Link initialisation

Just make sure that no BASIC Transformer is used in your jobs. They tend to cause crashes in your jobs.

Open your transformers and check the kind of routines you can create to find out if these are Servers or Parallel.