Search found 72 matches

by SettValleyConsulting
Wed Jun 11, 2008 4:17 am
Forum: General
Topic: sequential operator cannot preserve the partitioning
Replies: 2
Views: 5624

The option for Preserve partioning - default(clear) has been set.
Where has it been set? It needs to be set to 'Clear' on the stage before the sequential stage ie on the transformer.
by SettValleyConsulting
Mon Jun 09, 2008 8:26 am
Forum: General
Topic: Arnd Hits 10K
Replies: 13
Views: 10857

Quality AND Quantity

I make that an average of > 7 posts a day (including holidays and weekends, naturally).

When do you sleep? :wink:

Well done, here's to the next 10K ...

Phil Clarke.
by SettValleyConsulting
Wed Jun 04, 2008 9:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential File Stage and Nulls
Replies: 3
Views: 3108

Thanks Arnd - So the short answer is 'No'. I should have mentioned that Null Field Value was set to ''. This is our default. By inconsistent I meant that an empty input column is treated differently depending on the nullability of the target column. The (online) documentation defines the Null Field ...
by SettValleyConsulting
Wed Jun 04, 2008 4:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential File Stage and Nulls
Replies: 3
Views: 3108

Sequential File Stage and Nulls

Given a pipe-delimited input sequential file something like this Row 1 Data1|Data2|Data3 Row 2 Data1||Data3 All fields, Varchar(6), say. What would you expect to happen to row 2 if Field 2 was defined as (a) Nullable and (b) Not nullable. The answer seems to be that (a) Datastage inserts a Null. (b)...
by SettValleyConsulting
Mon May 19, 2008 8:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: updating in oracle table which doesn't contain any key cols
Replies: 14
Views: 5190

Thanks for your reply....we can check for the duplicte rowids before updating and if there are no duplicates then we can go ahead. Is that OK? You don't need to check for duplicates, ROWIDs will always be unique within a table. You only need to be certain the ROWID will not change between reading a...
by SettValleyConsulting
Mon May 19, 2008 8:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: updating in oracle table which doesn't contain any key cols
Replies: 14
Views: 5190

When I said 'query' the db design I was using the word in the sense of to question or challenge the design of the table. It is one of the fundamental principles of relational table design that there should be an attribute in the table that uniquely identifies a row. http://en.wikipedia.org/wiki/Uniq...
by SettValleyConsulting
Mon May 19, 2008 8:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: updating in oracle table which doesn't contain any key cols
Replies: 14
Views: 5190

This will probably work in this scenario, but using ROWID may fail in some circumstances. Oracle ROWID is a psuedo-column, determined by the RDBMS rather than the data. It is unique within a table and is fixed in most but not all circumstances. For example exporting and reimporting a table will chan...
by SettValleyConsulting
Mon May 12, 2008 9:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Vertical Pivot Logic
Replies: 10
Views: 20971

Another method ...

Another way to skin the Vertical Pivot cat... Sort and add a KeyChange column as in previous suggestions. Add a transformer that increments a stage variable and resets on key change giving a Counter field in the output: If KeyChange=1 then svCOunt = 1 Else svCount = svCount + 1 Add a switch stage wi...
by SettValleyConsulting
Thu May 08, 2008 4:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Left Outer Join and Timestamps
Replies: 2
Views: 999

Left Outer Join and Timestamps

My understanding, based on a document from IBM, is that where I have a Left Outer join and a row in the 'Left' dataset does not find a match in the 'Right' dataset, any nullable columns from the right dataset will be nulled. But this does not seem to be the case for timestamps. I have a logical test...
by SettValleyConsulting
Thu May 08, 2008 4:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Data Capture stage
Replies: 17
Views: 5588

In that case the setting of APT_STRING_PADCHAR may well be the problem. This specifies the character that Datastage will use to pad out strings when you move a string to a longer CHAR field - for example a 4-character string to a CHAR(6) - it will add two of this character to the end of the field. T...
by SettValleyConsulting
Tue May 06, 2008 9:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: creating and executing a PX routine
Replies: 3
Views: 1474

Agree. Remember also that routine names are case-sensitive; I had the same error and traced it back to routine names spelled the same but with different capitalisation.
by SettValleyConsulting
Thu May 01, 2008 9:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataSet Size
Replies: 6
Views: 2222

Ooops :oops:

So you did. In case of conflicting advice, readers should believe Arnd over me every time :wink:
by SettValleyConsulting
Thu May 01, 2008 9:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataSet Size
Replies: 6
Views: 2222

Here is the storage required for each data type. Using these you can get a pretty good estimate of your dataset record size... Data Type: Size Integers: 4 bytes Small Integer: 2 bytes Tiny Integer: 1 byte Big Integer: 8 bytes Decimal: (precision+1)/2, rounded up Float: 8 bytes VarChar(n): n + 4 byte...
by SettValleyConsulting
Tue Apr 08, 2008 9:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Difference between Set and Propagate Partitioning?
Replies: 4
Views: 3454

Thanks Ray. That simple, huh? Is this documented anywhere?

DSGuru - the question you answered was not the question I asked.
by SettValleyConsulting
Thu Mar 20, 2008 10:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Difference between Set and Propagate Partitioning?
Replies: 4
Views: 3454

Difference between Set and Propagate Partitioning?

What is the difference between 'Set' and 'Propagate' in the 'Preserve Partitioning' Drop-Down box (usually on the Advanced Tab)? A colleague encountered the 'Partitioning despite the Preserve Paritioning Flag' warning. I advised to change the Propagate option to 'Clear', he pointed out that he wante...