Search found 6 matches
- Mon Jan 12, 2009 3:16 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Issue: Surrogate Key Generator
- Replies: 4
- Views: 2652
Re: Issue: Surrogate Key Generator
Maybe because your data is unevenly partitioned? If you had two nodes, and surrogate keys on the first node were being assigned as 1,3,5,... and surrogate keys on the second node were being assigned as 2,4,6,... then as long as the data was balanced evenly between the nodes it would appear that the ...
- Mon Jan 12, 2009 2:50 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Clearing Resource directory?
- Replies: 10
- Views: 5107
You will need to check ALL your configuration files (particularly default.apt), and all those who might have used them. Are the data files recent? Something I found on the Internet that might explain why we're having trouble with datasets: 'When you create a data set or file set, you specify where ...
- Tue Aug 05, 2008 2:11 pm
- Forum: Enhancement Wish List
- Topic: Interactive Debugger for QualityStage Pattern-Action Files
- Replies: 0
- Views: 2111
Interactive Debugger for QualityStage Pattern-Action Files
QualityStage 8 could really use an interactive debugger for pattern-action files that would let you step through the code and see how and where an input string is affected. An integrated editor with syntax highlighting would be nice, too. Actually, I'd be happy if I just didn't have to re-start the ...
- Tue Apr 08, 2008 8:39 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Requirement to run the perl script in between parallel jobs
- Replies: 3
- Views: 1649
The external filter stage will pass the data stream to your perl script through STDIN. Your perl script will then process the input data stream in memory and write it to STDOUT, from which the external filter stage will pick up the processed data stream and pass it on to the next DataStage stage. Yo...
- Thu Oct 11, 2007 8:59 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: partitioning
- Replies: 2
- Views: 1298
Re: partitioning
If you are joining two (or more) data sources using a Join or Merge stage, sort and then hash-partition all the data sources on the join key. Doing this will ensure that all the records from all the data sources that share common join key values will end up in the same partition. For performance rea...
- Tue Aug 28, 2007 2:50 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataTypeEbcdicToAscii in Parallel jobs
- Replies: 5
- Views: 2755