Search found 104 matches

by algfr
Fri Jul 24, 2009 10:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD - Effective Date - Do not always use currentTimeStamp()
Replies: 5
Views: 3486

SCD - Effective Date - Do not always use currentTimeStamp()

Hi, The SCD Type 2 design works fine but I have a requirement : When I load my fact tables, I will do a range lookup to check what was the correct reference at the time of the fact. To me, this range lookup can only work if, when the record is NEW, the effective date should be 01/01/1901 and not the...
by algfr
Fri Jul 24, 2009 3:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Range With Dates
Replies: 6
Views: 2418

I needed to convert to date using a modify stage first

Also had forgotten to trigger the 'a..z' range condition.

It works great, thanks a lot.
by algfr
Thu Jul 23, 2009 5:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Range With Dates
Replies: 6
Views: 2418

The range can work either way, two things to check (that spring to mind) 1) Have you got your >=/<= the right way round? 2) Are you getting warning messages in your log regarding duplicates? If so, you may find you are losing the range that you want, particularly an issue if you are working off ano...
by algfr
Thu Jul 23, 2009 2:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Range With Dates
Replies: 6
Views: 2418

This is the example I'm mentionning

This is the opposite of what I would like to do (start date and end date are on the main link, I want them on the ref link)
by algfr
Thu Jul 23, 2009 2:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fill the remaining spaces
Replies: 5
Views: 2296

PadString with 'A' as the pattern and 3 as the length I'd say
by algfr
Thu Jul 23, 2009 2:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Range With Dates
Replies: 6
Views: 2418

Lookup Range With Dates

Hello guys, I have trouble using the range lookup feature from the lookup stage. I've seen an example on the web but it is not what I would expect. My problem is easy 1) I have a main flow which contains a calendar_date (Date Format) out of a row generator (i create a calendar table). 2) I have a lo...
by algfr
Tue Jul 21, 2009 9:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple Lookup with a multiple reject strategy
Replies: 3
Views: 1409

That is the strategy that I have used too. The only other method I have come up with that makes it possible to determine which specific lookup failed is to have a series of lookup stages - with one reference link per lookup stage. The reduction in stages and the increased flexibility of using the '...
by algfr
Tue Jul 21, 2009 5:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: remove leading zeros in decimal field in sequential file
Replies: 26
Views: 79628

True, but maybe he could tell us how much he needs because 38 digits, man, that's a lot.
by algfr
Tue Jul 21, 2009 5:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slowly Changing Dimension stage : Quick explaination
Replies: 3
Views: 1700

I send the output lint to a copy stage.

Done.
by algfr
Tue Jul 21, 2009 4:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: remove leading zeros in decimal field in sequential file
Replies: 26
Views: 79628

Correct me if I'm wrong but cannot you use Integer type instead of decimal ?
by algfr
Tue Jul 21, 2009 3:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple Lookup with a multiple reject strategy
Replies: 3
Views: 1409

Multiple Lookup with a multiple reject strategy

Hello people, I would like to discuss with you the best strategy for having multiple lookup with multiple reject links. i think many of us have this issue so I found useful to discuss it. Here is what I have done and propose : I have a primary link with N keys that I have to check (on reference tabl...
by algfr
Tue Jul 21, 2009 2:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup on which stage
Replies: 6
Views: 1954

Thank you, this answer my question.

Then I don't have to bother to create a lookup directly from Oracle reference sources.

I suppose this is the main difference with previous versions where it was strongly recommended to insert intermediate datasets.

Good day all
by algfr
Mon Jul 20, 2009 11:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup on which stage
Replies: 6
Views: 1954

nagarjuna wrote:It depends on amount of data that you are handling ...How much data you will have in reference link ??
My biggest dim is about 150,00 records but the average is below 10,000.
by algfr
Mon Jul 20, 2009 10:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup on which stage
Replies: 6
Views: 1954

Have you actually tried? It is very possible to use an oracle stage directly as a referential input to a lookup. Hi ShaneMuir, Yes I have Just want to know if it takes down performance or not. In other words, is it compulsory to create the datasets to avoid performance drop ? I heard the wew versio...