Within a job you could apply Aggregator Stage to group/count records - Have you thought about using that option?
Not sure what your exact requirements are -
Search found 10 matches
- Tue Dec 30, 2008 12:00 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sequential file
- Replies: 12
- Views: 3782
- Sun Dec 28, 2008 1:50 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Verify before Insert into Target db
- Replies: 10
- Views: 4026
- Sat Dec 27, 2008 3:17 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Audit File Log -
- Replies: 8
- Views: 2956
Hey mdbatra - I have recently started working on DS - I am aware of some existing functions/routines that we could use like DSgetjobinfo - however, I was not sure where to place them in a job design and capture their return values as needed - Should this be done on a Command prompt (unix/windows) af...
- Sat Dec 27, 2008 1:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Verify before Insert into Target db
- Replies: 10
- Views: 4026
Thanks Ray - Actually there is a slight possibility that a duplicate invoice may be a part of another batch file later on (may be by some mistake) - So we need to still implement a check to ensure no duplicate record is loaded into the Target DB - Every invoice has a unique key so it can be easily i...
- Fri Dec 26, 2008 6:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Verify before Insert into Target db
- Replies: 10
- Views: 4026
Thanks - So does it mean that I need to use the Target DB on a Reference link first to perform Lookup - And the records that do not find a key match should be Inserted later through Oracle EE stage into the same Target DB. Would it cause a lock-up as we are using the same table, in the pipeline para...
- Fri Dec 26, 2008 4:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Verify before Insert into Target db
- Replies: 10
- Views: 4026
Thanks for your feed back. So the 3rd option (load) will automatically reject the records that Do already exist in the Target DB and channel them towards reject link - How about a simply Insert write option? Will it work the same way? I guess we are looking at about a few millions records loaded per...
- Fri Dec 26, 2008 4:04 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Verify before Insert into Target db
- Replies: 10
- Views: 4026
Verify before Insert into Target db
I need to load customer invoices to the target oracle database, however, I only need to insert the records that do not already exist in the target database (based on Inv Id) and captures the ones that DO already exist (duplicates in reject link) - 1) Would an Upsert write option be sufficient in thi...
- Thu Dec 25, 2008 9:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Audit File Log -
- Replies: 8
- Views: 2956
Audit File Log -
I am just starting out in DS so need some help - I am trying to figure out how the manage a basic Job Audit file. It seems that DSgetjobinfo (arg...) and DSgetLinkInfo (arg....) will get it done. I have looked up the forum however most of the searches resulted with some specific issues that members ...
- Tue Dec 23, 2008 1:21 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DS Function to reformat SSN
- Replies: 6
- Views: 3111
DS Function to reformat SSN
Hello - Could you please guide me to figure out how to remove dashes (-) from the existing SSN number (999-99-9999) - Is there a specific function in DS to get this formatting done. I would like my result to be (999999999) with out any special characters. I tried running the Search query but did not...
- Sun Dec 07, 2008 5:02 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Auto Increment Surrogate Key
- Replies: 1
- Views: 2350
Auto Increment Surrogate Key
Hi - I am new to DW/DataStage 8 and I found this forum as a great knowledge tool and a quick resource to learn, connect and help others - Hopefully soon I will be in a position to help others myself - My question is why can't we use DB auto increment function on the key column to create a surrogate ...