Search found 95 matches

by evee1
Fri Aug 26, 2011 12:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD Type 1 - how to implement no change in some values
Replies: 10
Views: 3647

It marks the column with red and the compilation fails with the error message : A dimension update column REC_LOAD_DT does not have a derivation!
by evee1
Thu Aug 25, 2011 11:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD Type 1 - how to implement no change in some values
Replies: 10
Views: 3647

I realise I could override Update and Insert statements in the target Oracle connector, i.e. drop the REC_LOAD_DT column from the update statement,
but I was wondering whether I could handle it someone in SCD stage instead and use the generated upsert in the Ora connector.
by evee1
Thu Aug 25, 2011 10:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD Type 1 - how to implement no change in some values
Replies: 10
Views: 3647

The problem is that the only Pupose Code I could use here is Type 1, or <blank>. Together with setting derivation to sysdate (or in my case BATCH_DATE) it does not achieve my goal, i.e. leaving REC_LOAD_DT as it is.
by evee1
Thu Aug 25, 2011 10:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD Type 1 - how to implement no change in some values
Replies: 10
Views: 3647

SCD Type 1 - how to implement no change in some values

I am trying to build Type 1 dimension using SCD stage. The definition out the Update link contains the following columns, with their SCD purpose codes and derivations: Derivation Column Name Purpose NextSurrogateKey() REC_KEY Surrogate Key lnk_In.REC_IDNT REC_IDNT Business Key lnk_In.REC_DESC REC_DE...
by evee1
Thu Aug 25, 2011 9:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disappearing connection parameters in SCD stage
Replies: 0
Views: 1006

Disappearing connection parameters in SCD stage

Hi, I'm using SCD stage for the first time (previously I used Change Capture and Transformer to implement dimensions load). I am on version 8.5 with FP1 installed and having problem with disappearing connection parameters when I'm definining the DB seduence to be used for for generation of Surrogate...
by evee1
Tue Jul 05, 2011 8:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to make Oracle connector read source data in parallel
Replies: 3
Views: 6088

Hm, if this is the correct behaviour then it is not what I'm looking for - at the moment I'm loading 20000 records rather than 10000. I still would like to know whether I can just "split" rows between two processing nodes, so they are loaded faster. In the future this job needs to be able ...
by evee1
Mon Jul 04, 2011 6:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to make Oracle connector read source data in parallel
Replies: 3
Views: 6088

How to make Oracle connector read source data in parallel

I am having troubles with configuring parallel read in Oracle connector. The entire data is read twice - once per each node. Firstly, my source table is not partitioned in any way. My understanding is that I still should be able to read the data in parallel. I havce configured the Oracle connector i...
by evee1
Thu Jun 09, 2011 6:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem when calling SP stage
Replies: 12
Views: 7378

Just to close this topic off. It turned out that after I have installed FixPack 1 patch it all started to work.
by evee1
Wed Jun 08, 2011 12:02 am
Forum: General
Topic: Availability of Datastage BASIC routines
Replies: 2
Views: 1135

Thanks. It looks like I can call DSSetUserStatus in the routine, so it's fine.
I just thought (and I was wrong!) that I should be able to see the in Repository.
by evee1
Tue Jun 07, 2011 11:16 pm
Forum: General
Topic: Availability of Datastage BASIC routines
Replies: 2
Views: 1135

Availability of Datastage BASIC routines

We have a new installation of Datastage 8.5 and I would like to be able to use some DS routines, for example DSSetUserStatus, but I can only find a handful of DS routines, rather than a full set decribed here: http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r5/topic/com.ibm.swg.im.iis.ds.cliapi....
by evee1
Wed Jun 01, 2011 5:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dataset and schemas
Replies: 7
Views: 3087

Wrap it in Code tags.
I first thought it was a solution to my dataset/schema problem :oops: :lol:

James,
File sets work perfectly. Thanks for the suggestion!!
by evee1
Wed Jun 01, 2011 1:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dataset and schemas
Replies: 7
Views: 3087

Never used them and not sure what they are, but will try to find out.

Would you be able to point me to where I can read about it please. A generic heading will do.
Thanks!
by evee1
Wed Jun 01, 2011 12:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dataset and schemas
Replies: 7
Views: 3087

Re: Dataset and schemas

evee1 wrote: SeqFile --> ColumnImport -> Transformer --> Dataset
\
\--> SeqFileOut
Oops! The link to SeqFileOut should start in the Transformer stage.
by evee1
Wed Jun 01, 2011 12:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dataset and schemas
Replies: 7
Views: 3087

Dataset and schemas

I was wondering whether I can somehow use a schema to define the input from a data set. I was planning to use data sets to pass the data between my jobs, as the documentation suggests "using data sets wisely can be key to good performance in a set of linked jobs". However I can't find in t...
by evee1
Sun May 29, 2011 11:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: setting User Status in a parallel job
Replies: 16
Views: 27938

Hi Andy, What did you end up doing? I have a similar issue. I'm implementing a generic sequence to cater for various steps of file validation. One of them is a routine that verifies the total of a given source field in a file against the total given in a footer. I need to pass the result of a valida...