Where has it been set? It needs to be set to 'Clear' on the stage before the sequential stage ie on the transformer.The option for Preserve partioning - default(clear) has been set.
Search found 72 matches
- Wed Jun 11, 2008 4:17 am
- Forum: General
- Topic: sequential operator cannot preserve the partitioning
- Replies: 2
- Views: 5624
- Mon Jun 09, 2008 8:26 am
- Forum: General
- Topic: Arnd Hits 10K
- Replies: 13
- Views: 10857
Quality AND Quantity
I make that an average of > 7 posts a day (including holidays and weekends, naturally).
When do you sleep?
Well done, here's to the next 10K ...
Phil Clarke.
When do you sleep?
![Wink :wink:](./images/smilies/icon_wink.gif)
Well done, here's to the next 10K ...
Phil Clarke.
- Wed Jun 04, 2008 9:52 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sequential File Stage and Nulls
- Replies: 3
- Views: 3108
Thanks Arnd - So the short answer is 'No'. I should have mentioned that Null Field Value was set to ''. This is our default. By inconsistent I meant that an empty input column is treated differently depending on the nullability of the target column. The (online) documentation defines the Null Field ...
- Wed Jun 04, 2008 4:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sequential File Stage and Nulls
- Replies: 3
- Views: 3108
Sequential File Stage and Nulls
Given a pipe-delimited input sequential file something like this Row 1 Data1|Data2|Data3 Row 2 Data1||Data3 All fields, Varchar(6), say. What would you expect to happen to row 2 if Field 2 was defined as (a) Nullable and (b) Not nullable. The answer seems to be that (a) Datastage inserts a Null. (b)...
- Mon May 19, 2008 8:56 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: updating in oracle table which doesn't contain any key cols
- Replies: 14
- Views: 5190
Thanks for your reply....we can check for the duplicte rowids before updating and if there are no duplicates then we can go ahead. Is that OK? You don't need to check for duplicates, ROWIDs will always be unique within a table. You only need to be certain the ROWID will not change between reading a...
- Mon May 19, 2008 8:49 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: updating in oracle table which doesn't contain any key cols
- Replies: 14
- Views: 5190
When I said 'query' the db design I was using the word in the sense of to question or challenge the design of the table. It is one of the fundamental principles of relational table design that there should be an attribute in the table that uniquely identifies a row. http://en.wikipedia.org/wiki/Uniq...
- Mon May 19, 2008 8:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: updating in oracle table which doesn't contain any key cols
- Replies: 14
- Views: 5190
This will probably work in this scenario, but using ROWID may fail in some circumstances. Oracle ROWID is a psuedo-column, determined by the RDBMS rather than the data. It is unique within a table and is fixed in most but not all circumstances. For example exporting and reimporting a table will chan...
- Mon May 12, 2008 9:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Vertical Pivot Logic
- Replies: 10
- Views: 20971
Another method ...
Another way to skin the Vertical Pivot cat... Sort and add a KeyChange column as in previous suggestions. Add a transformer that increments a stage variable and resets on key change giving a Counter field in the output: If KeyChange=1 then svCOunt = 1 Else svCount = svCount + 1 Add a switch stage wi...
- Thu May 08, 2008 4:43 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Left Outer Join and Timestamps
- Replies: 2
- Views: 999
Left Outer Join and Timestamps
My understanding, based on a document from IBM, is that where I have a Left Outer join and a row in the 'Left' dataset does not find a match in the 'Right' dataset, any nullable columns from the right dataset will be nulled. But this does not seem to be the case for timestamps. I have a logical test...
- Thu May 08, 2008 4:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Change Data Capture stage
- Replies: 17
- Views: 5588
In that case the setting of APT_STRING_PADCHAR may well be the problem. This specifies the character that Datastage will use to pad out strings when you move a string to a longer CHAR field - for example a 4-character string to a CHAR(6) - it will add two of this character to the end of the field. T...
- Tue May 06, 2008 9:29 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: creating and executing a PX routine
- Replies: 3
- Views: 1474
- Thu May 01, 2008 9:47 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataSet Size
- Replies: 6
- Views: 2222
- Thu May 01, 2008 9:22 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataSet Size
- Replies: 6
- Views: 2222
Here is the storage required for each data type. Using these you can get a pretty good estimate of your dataset record size... Data Type: Size Integers: 4 bytes Small Integer: 2 bytes Tiny Integer: 1 byte Big Integer: 8 bytes Decimal: (precision+1)/2, rounded up Float: 8 bytes VarChar(n): n + 4 byte...
- Tue Apr 08, 2008 9:45 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Difference between Set and Propagate Partitioning?
- Replies: 4
- Views: 3454
- Thu Mar 20, 2008 10:13 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Difference between Set and Propagate Partitioning?
- Replies: 4
- Views: 3454
Difference between Set and Propagate Partitioning?
What is the difference between 'Set' and 'Propagate' in the 'Preserve Partitioning' Drop-Down box (usually on the Advanced Tab)? A colleague encountered the 'Partitioning despite the Preserve Paritioning Flag' warning. I advised to change the Propagate option to 'Clear', he pointed out that he wante...