Search found 6 matches

by jamach
Mon Jan 12, 2009 3:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue: Surrogate Key Generator
Replies: 4
Views: 2652

Re: Issue: Surrogate Key Generator

Maybe because your data is unevenly partitioned? If you had two nodes, and surrogate keys on the first node were being assigned as 1,3,5,... and surrogate keys on the second node were being assigned as 2,4,6,... then as long as the data was balanced evenly between the nodes it would appear that the ...
by jamach
Mon Jan 12, 2009 2:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Clearing Resource directory?
Replies: 10
Views: 5107

You will need to check ALL your configuration files (particularly default.apt), and all those who might have used them. Are the data files recent? Something I found on the Internet that might explain why we're having trouble with datasets: 'When you create a data set or file set, you specify where ...
by jamach
Tue Aug 05, 2008 2:11 pm
Forum: Enhancement Wish List
Topic: Interactive Debugger for QualityStage Pattern-Action Files
Replies: 0
Views: 2111

Interactive Debugger for QualityStage Pattern-Action Files

QualityStage 8 could really use an interactive debugger for pattern-action files that would let you step through the code and see how and where an input string is affected. An integrated editor with syntax highlighting would be nice, too. Actually, I'd be happy if I just didn't have to re-start the ...
by jamach
Tue Apr 08, 2008 8:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Requirement to run the perl script in between parallel jobs
Replies: 3
Views: 1649

The external filter stage will pass the data stream to your perl script through STDIN. Your perl script will then process the input data stream in memory and write it to STDOUT, from which the external filter stage will pick up the processed data stream and pass it on to the next DataStage stage. Yo...
by jamach
Thu Oct 11, 2007 8:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: partitioning
Replies: 2
Views: 1298

Re: partitioning

If you are joining two (or more) data sources using a Join or Merge stage, sort and then hash-partition all the data sources on the join key. Doing this will ensure that all the records from all the data sources that share common join key values will end up in the same partition. For performance rea...
by jamach
Tue Aug 28, 2007 2:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataTypeEbcdicToAscii in Parallel jobs
Replies: 5
Views: 2755

If you write to a sequential file, you can also convert from EBCDIC to ASCII. On the sequential file stage Input tab, select the Columns tab. Right-click on the column you want to convert, and select "Edit Row..." On the Properties: field of the Edit Column Meta Data screen that appears, s...