Search found 520 matches

by mhester
Wed Jun 22, 2011 7:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: performance issue
Replies: 1
Views: 1605

Both ACCOUNT_ID columns will need to be of the same data type and length. The data will need to be partitioned and sorted into the join stage (by the same key column). The framework can do pretty well when set to Auto (if keys etc... are defined properly), but it might be better to do it in the join...
by mhester
Wed Jun 22, 2011 7:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to start ORCHESTRATE job
Replies: 7
Views: 3559

John, I might have IBM support focus on the dsdlockd process. This can cause hangs like what you are experiencing. This may not be your issue, but worth the time to investigate. We had this very issue and was related to the ownership of the dsdlockd process. We are Unix, but maybe this is a Windows ...
by mhester
Wed Jun 22, 2011 7:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to implement Change Data Capture in PX job
Replies: 19
Views: 28035

Bill, If you would like a datastage job (template) that can be used for change data capture then please pm me and I would be happy to send it to you. There is nothing proprietary in how this is accomplished using the parallel construct. It is different than what we used to do in the server world, bu...
by mhester
Fri Nov 12, 2010 1:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dataset Magic
Replies: 10
Views: 4810

mike - I'm a bit chagrined by your response since the FAQ that I wrote explains exactly how to locate such orphaned files. ... I guess if I paid the premium membership I would have seen your response and not responded in the first place :lol: Sorry to trump your answer - did not mean too. And Craig...
by mhester
Thu Nov 11, 2010 9:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dataset Magic
Replies: 10
Views: 4810

Ray,

I get it :D

This can be a problem and I have asked one of the framework developers at IBM if there is a way to find orphaned resource data.

I will let you know what I hear.
by mhester
Wed Nov 10, 2010 4:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: datastage warnings
Replies: 1
Views: 1893

That would likely mean the jobmonapp is not running. Check by executing the following -

Code: Select all

ps -ef|grep JobMonApp
If it is not running then you can start it by navigating to $PXHOME/java and executing -

Code: Select all

sh jobmoninit start
This takes care of both the resource tracker and px job monitor app.
by mhester
Wed Nov 10, 2010 4:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_CombinedOperatorController,0: *** glibc detected ***
Replies: 3
Views: 2786

disable combination and see what operator is throwing the error. You can do some things to disable the framework from checking memory before allocating which may silence this error, but generally these things come from the player level.
by mhester
Wed Nov 10, 2010 4:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dataset Magic
Replies: 10
Views: 4810

I believe you are approaching this incorrectly. You should not attempt to automate the cleanup / purge by identifying the dataset header and then identifying the dataset data partitions, rather you should identify the headers and then use the tools (orchadmin) to handle the cleanup/archive/purge. Th...
by mhester
Wed Nov 10, 2010 4:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Null value appeared as '0' for integer column
Replies: 4
Views: 2808

That is the default behavior when going from a nullable input to a not nullable output and the input value is null.

Same in the lookup, merge etc...

Has nothing to do with your sequential stage.
by mhester
Mon Nov 08, 2010 2:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Transformer expecting entire paritioning
Replies: 4
Views: 1717

"tfmProfitMeas2: Input dataset 0 has a partitioning method other than entire specified; disabling memory sharing." I think this is simply alerting you to the fact that you have not chosen Entire partitioning so memory sharing will be disabled. This is standard since with Entire memory sha...
by mhester
Fri Nov 05, 2010 3:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to add thousand-separator comma's to decimal field
Replies: 7
Views: 8335

Create a routine and use the following code - Handles numbers of any size. Snippet #include <iostream> #include <string> using namespace std; // Non-recursive method of adding commas to numbers as C++ strings ... // s is string passed in, ns is new string returned by ref. with commas inserted void a...
by mhester
Thu Nov 04, 2010 12:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 Connector load problems Job aborting
Replies: 2
Views: 3204

Within the DB2 Connector - click on the reject link to get to the properties. Next make sure that both "SQL Error" and "Row not updated" are checked. These are the two (2) options on the left. On the right choose what you want in your output - "ERRORCODE" and/or "E...
by mhester
Thu Nov 04, 2010 8:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to highlight text?
Replies: 8
Views: 2199

You might be able to use xml?
by mhester
Thu Nov 04, 2010 8:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: This is about CDC stage
Replies: 3
Views: 3374

Have you verified in Unix that the 2 files are the same? Here are some things that I try when stuff like this happens - Change to a single node configuration (take partitioning out of the equation) Ensure that column types are the same that are being compared If using seq files and the expected resu...
by mhester
Wed Nov 03, 2010 3:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Special Character in the EXTRACT file created (Fixed Width)
Replies: 3
Views: 1911

In the administrator client what is the value of the environment variable APT_STRING_PADCHAR? If it is 0x0 then you can have this type of behavior. Set it to 0x20