Search found 137 matches

by dougcl
Fri Jan 21, 2011 1:58 pm
Forum:
Topic: Dev->Prod Migration of MW Content
Replies: 2
Views: 1549

Dev->Prod Migration of MW Content

Hi folks, currently we populate MW using the DataStage Connector Import Wizard. The orange database tables are created in MW automatically when we use this method to import Table Defs (blue) into DataStage. So this approach gets us set up nicely in the development environment. Our current plan is to...
by dougcl
Tue Dec 21, 2010 6:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Range Lookup
Replies: 1
Views: 1572

You can use a lookup stage to do a range lookup.
by dougcl
Mon Nov 29, 2010 7:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash partitioning in Oracle Connector
Replies: 3
Views: 5050

Hi folks, I am told that the modulus partitioning strategy is the same as hash if the hash key happens to be an integer. So in this special case, perhaps specifying modulus partitioned reads in the Oracle Connector will map directly to a hash partition in DataStage. I have not checked it.
by dougcl
Mon Nov 29, 2010 6:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reducing Swap Usage in Simple Jobs
Replies: 9
Views: 2786

Hi folks this appears to be a Solaris thing. IBM recommends doubling memory estimates for the Solaris platform.
by dougcl
Fri Nov 19, 2010 3:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: VarChar Memory Usage
Replies: 14
Views: 9549

in 8.1 there is a new environment variable which controls this and in 8.5 the behaviour is default. In 8.1 in order to use it you will need to add a copy prior to the write of a dataset and read of a dataset to allow for a modify adapter (so you cannot optimize out the copy). Great post but I have ...
by dougcl
Fri Nov 12, 2010 3:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reducing Swap Usage in Simple Jobs
Replies: 9
Views: 2786

Hi folks, is there a way to reduce the 30MB used per process? This seems like a huge amount of memory. It would be nice to get this down to 10K or so.

Thanks,
Doug
by dougcl
Thu Nov 11, 2010 4:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Cannot remove "will partition" warning
Replies: 3
Views: 2026

Okay I am adding the "will partition despite the preserve-partitioning flag" warning to my message handler.

Goodbye partitioning flag. Maybe you will be fixed someday.
by dougcl
Thu Nov 11, 2010 3:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Cannot remove "will partition" warning
Replies: 3
Views: 2026

Clear the preserve partitioning flag on the stages upstream on the input links to the Lookup stage. Use Entire partitioning on the reference input link unless you can be 100% certain that the stream input link uses identical Hash partitioning propagated from upstream by Same. Hi Ray, thanks. As I s...
by dougcl
Thu Nov 11, 2010 12:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Cannot remove "will partition" warning
Replies: 3
Views: 2026

Cannot remove "will partition" warning

Hi folks, I have a lookup stage doing nothing fancy. The stream link is set to SAME. The reference link is set to HASH. Both links have the preserve partitioning flag set to CLEAR. I still get the warning. Just for grins, I also cleared the flag on the lookup output . Still get the warning. Ideas? D...
by dougcl
Wed Nov 10, 2010 3:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Null value appeared as '0' for integer column
Replies: 4
Views: 2835

Make sure the column on your join input and output links says Nullable=Yes.
by dougcl
Wed Nov 10, 2010 10:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle OCI Stage vs Oracle Connector
Replies: 2
Views: 6027

Oracle OCI Stage vs Oracle Connector

Hi folks, I am using the OracleConnectorPX stage to bulk load into an Oracle table. This morning I starting digging for details in the help about how this stage is working and I stumbled upon the "Oracle OCI Stages." What is the difference between these and the OracleConnectorPX? Are they ...
by dougcl
Tue Nov 09, 2010 5:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NullToValue doesn't work
Replies: 1
Views: 2346

Found the problem. One of the input links (not output) to the join had Nullable set to no. Not sure why this would affect the output, but whatever.

Sorry for the bandwidth.

Doug
by dougcl
Tue Nov 09, 2010 4:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NullToValue doesn't work
Replies: 1
Views: 2346

NullToValue doesn't work

Hi folks, I have a transformer stage after a bunch of left outer joins in order to apply null defaults. This is typical. Each column in the transformer has a NullToValue call. Unfortunately it rarely works. The problem appears to be that DataStage join does not populate fields with data that NullToV...