Search found 10 matches

by metadata1
Tue Dec 30, 2008 12:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential file
Replies: 12
Views: 3782

Within a job you could apply Aggregator Stage to group/count records - Have you thought about using that option?

Not sure what your exact requirements are -
by metadata1
Sun Dec 28, 2008 1:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Verify before Insert into Target db
Replies: 10
Views: 4026

Thanks K - it sounds like a good idea - I will explore that option too - So if we design the job utilizing Change Capture stage, do you think it will be good idea to use the same Target as "Before" dataset for comparison then use the same Target database for Insert within the same job - Wi...
by metadata1
Sat Dec 27, 2008 3:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Audit File Log -
Replies: 8
Views: 2956

Hey mdbatra - I have recently started working on DS - I am aware of some existing functions/routines that we could use like DSgetjobinfo - however, I was not sure where to place them in a job design and capture their return values as needed - Should this be done on a Command prompt (unix/windows) af...
by metadata1
Sat Dec 27, 2008 1:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Verify before Insert into Target db
Replies: 10
Views: 4026

Thanks Ray - Actually there is a slight possibility that a duplicate invoice may be a part of another batch file later on (may be by some mistake) - So we need to still implement a check to ensure no duplicate record is loaded into the Target DB - Every invoice has a unique key so it can be easily i...
by metadata1
Fri Dec 26, 2008 6:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Verify before Insert into Target db
Replies: 10
Views: 4026

Thanks - So does it mean that I need to use the Target DB on a Reference link first to perform Lookup - And the records that do not find a key match should be Inserted later through Oracle EE stage into the same Target DB. Would it cause a lock-up as we are using the same table, in the pipeline para...
by metadata1
Fri Dec 26, 2008 4:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Verify before Insert into Target db
Replies: 10
Views: 4026

Thanks for your feed back. So the 3rd option (load) will automatically reject the records that Do already exist in the Target DB and channel them towards reject link - How about a simply Insert write option? Will it work the same way? I guess we are looking at about a few millions records loaded per...
by metadata1
Fri Dec 26, 2008 4:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Verify before Insert into Target db
Replies: 10
Views: 4026

Verify before Insert into Target db

I need to load customer invoices to the target oracle database, however, I only need to insert the records that do not already exist in the target database (based on Inv Id) and captures the ones that DO already exist (duplicates in reject link) - 1) Would an Upsert write option be sufficient in thi...
by metadata1
Thu Dec 25, 2008 9:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Audit File Log -
Replies: 8
Views: 2956

Audit File Log -

I am just starting out in DS so need some help - I am trying to figure out how the manage a basic Job Audit file. It seems that DSgetjobinfo (arg...) and DSgetLinkInfo (arg....) will get it done. I have looked up the forum however most of the searches resulted with some specific issues that members ...
by metadata1
Tue Dec 23, 2008 1:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DS Function to reformat SSN
Replies: 6
Views: 3111

DS Function to reformat SSN

Hello - Could you please guide me to figure out how to remove dashes (-) from the existing SSN number (999-99-9999) - Is there a specific function in DS to get this formatting done. I would like my result to be (999999999) with out any special characters. I tried running the Search query but did not...
by metadata1
Sun Dec 07, 2008 5:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Auto Increment Surrogate Key
Replies: 1
Views: 2350

Auto Increment Surrogate Key

Hi - I am new to DW/DataStage 8 and I found this forum as a great knowledge tool and a quick resource to learn, connect and help others - Hopefully soon I will be in a position to help others myself - My question is why can't we use DB auto increment function on the key column to create a surrogate ...