Search found 37 matches
- Tue Jun 09, 2009 4:38 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Assign key Values for duplicated records
- Replies: 4
- Views: 2237
If time is not an issue and then you could simply use a server job and hash file. 1. Read data 2. Lookup up key in hash file and pull back surrogate key, if there. Obviously will be empty to start 3. If not in lookup assign key and write Key field and surrogate key to hash file. 4. Output data. Just...
- Thu Oct 16, 2008 3:45 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Dataset Size
- Replies: 2
- Views: 1736
- Thu Oct 16, 2008 2:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Dataset Size
- Replies: 2
- Views: 1736
Dataset Size
I'm loading 4 million rows from oracle into a dataset. I find that the size of the dataset files tends to be 10s of Gigs but when I load the same data into a loojup fileset of simple a fileset its Megs. The load to the dataset aborts due to a space issue, but I estimate that it would require 80gb fo...
- Wed Sep 17, 2008 5:31 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Oracle stage
- Replies: 3
- Views: 1817
- Tue Sep 16, 2008 9:00 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: problem in keeping the order of rows same using aggrega
- Replies: 6
- Views: 2734
A couple of things spring to mind. 1. Add the @INROWNUM value to each record as it passes through the transformer and then sort on this in the sequential file. I suspect you'll need to execute the stage sequentially though. 2. Is the data in the input file sorted in anyway. If so you could just re-a...
- Tue Sep 16, 2008 8:49 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Creating directories
- Replies: 7
- Views: 3181
- Mon Sep 15, 2008 2:16 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: parameter for abort after n rows
- Replies: 2
- Views: 5673
- Mon Sep 15, 2008 1:59 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Stored Procedure
- Replies: 2
- Views: 1651
- Mon Sep 15, 2008 1:56 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Fileset Lookup failure - null column data
- Replies: 3
- Views: 2048
- Fri Sep 12, 2008 9:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: datstage
- Replies: 3
- Views: 2273
- Fri Sep 12, 2008 9:29 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Fileset Lookup failure - null column data
- Replies: 3
- Views: 2048
Fileset Lookup failure - null column data
I'm using a lookup fileset with about 10 columns and a single key. When the job runs the lookups appear to be successful with the key column coming through, but all remaining columns are mapped as null.
Any ideas?
Any ideas?
- Tue Sep 09, 2008 6:40 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to read a Sequential file /Hash fileand return the value
- Replies: 1
- Views: 1306
Is this related to
viewtopic.php?p=299560#299560
If so you should try and avoid multiple threads on the same problem
viewtopic.php?p=299560#299560
If so you should try and avoid multiple threads on the same problem
- Tue Sep 09, 2008 6:38 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Need to implement Incremental load logic
- Replies: 14
- Views: 13117
- Fri Sep 05, 2008 10:03 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Passing parameters in PX
- Replies: 3
- Views: 2973
- Fri Sep 05, 2008 9:44 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Unable to open Properties of Job Stages within a sequence
- Replies: 11
- Views: 6823