Could you put through a Remove Duplicates stage. Sort and partition on The key field (ID). Then Sort by End_Dt Desc then by Start_Date Desc, then select to retain the first record.
I believe that should work.
Search found 15 matches
- Fri Mar 30, 2012 12:09 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Logic help
- Replies: 14
- Views: 8024
- Wed Mar 21, 2012 11:08 am
- Forum: IBM QualityStage
- Topic: Checking Phone number
- Replies: 4
- Views: 3667
- Thu Mar 08, 2012 11:44 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: how to find out what a partition a dataset uses
- Replies: 3
- Views: 2220
- Wed Mar 07, 2012 2:07 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hash lookup in parallel
- Replies: 7
- Views: 3954
- Wed Mar 07, 2012 2:06 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hash lookup in parallel
- Replies: 7
- Views: 3954
- Wed Mar 07, 2012 1:08 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hash lookup in parallel
- Replies: 7
- Views: 3954
- Wed Mar 07, 2012 12:27 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Deleting Datasets during Sequence run
- Replies: 8
- Views: 4327
- Wed Mar 07, 2012 9:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Deleting Datasets during Sequence run
- Replies: 8
- Views: 4327
- Wed Mar 07, 2012 9:18 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Deleting Datasets during Sequence run
- Replies: 8
- Views: 4327
- Wed Mar 07, 2012 8:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Deleting Datasets during Sequence run
- Replies: 8
- Views: 4327
Deleting Datasets during Sequence run
I was wondering if anyone had ever had the issue of having to delete datasets at the end of a sequence run? We created a large sequence for daily runs. At the end of the run we want part of the sequence to delete the datasets created during the sequence as we will just recrate them in the next days ...
- Mon Nov 07, 2011 7:53 am
- Forum: General
- Topic: Training for certification
- Replies: 11
- Views: 7154
I see that people keep referring to the practice test through prometric: http://www-03.ibm.com/certify/tests/sam421.shtml Every time I go to this link it takes me to the IBM site and the only option through the link is the study guide that contains 11 questions. I was wondering if there are any othe...
- Thu Jul 14, 2011 10:54 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Modify Stage
- Replies: 12
- Views: 8275
- Tue Jun 28, 2011 8:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Transfering Data to an Oracle Database
- Replies: 2
- Views: 1739
Transfering Data to an Oracle Database
I created a parallel job that is taking data from SQL Server doing some tranformations and such on the data but I am never changing data types. Once it goes into Oracle I can no longer see the Timestamp it is only a date in Oracle SQL Developer. Is this a problem in my job aka DataStage or is there ...
- Mon Apr 04, 2011 1:21 pm
- Forum: General
- Topic: Custom - (Conditional) -- How do I use this?
- Replies: 1
- Views: 2144
Custom - (Conditional) -- How do I use this?
I was wondering how to use the Custom - (Conditional) in a sequencer.
I am pretty new to DataStage and need my job to fail if there is a null found in out CurrentDate column.
Anyone know how I handle this requirement?
Thanks!
I am pretty new to DataStage and need my job to fail if there is a null found in out CurrentDate column.
Anyone know how I handle this requirement?
Thanks!
- Wed Mar 16, 2011 2:36 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to write Insert statement in ODBC going to SQL target
- Replies: 2
- Views: 2279
How to write Insert statement in ODBC going to SQL target
I am trying to write a SQL statement into SQL server by using ODBC. I was wondering what kind of format I would write the statement in. Normally Insert into [table] Values [xyz...]. I dont understand how you write that values part since they are coming from the job.