Search found 1274 matches

by jwiles
Wed Jul 03, 2013 3:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to get unique records ?
Replies: 2
Views: 2695

One possible solution, assuming you are using IS 8.5 or later: Add a column with 1, 2 or 3 to identify which source the record belongs to EDITED Partition the combined records on the key columns Sort on the key columns and source column In a transformer: - identify key changes by comparing the incom...
by jwiles
Wed Jul 03, 2013 8:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Partitioning
Replies: 19
Views: 13128

Chandra, I didn't see anything that necessitated a comment or correction :) What you stated is correct. The Advanced DataStage class is beneficial as it is more in-depth than the DataStage Essentials class in how the engine works. Do you need to take it? I don't know that you need to, but I consider...
by jwiles
Wed Jul 03, 2013 12:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Partitioning
Replies: 19
Views: 13128

xinhuang: 1) I've personally not heard of this issue from support, but I'll defer to them and engineering. It sounds as if it's something specific to your situation, as I have not encountered it before. 2-4) The requirement for key partitioning DOES NOT mean that the developer has to explicitly spec...
by jwiles
Tue Jul 02, 2013 10:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Perform join with OR condition
Replies: 4
Views: 3127

Not with the join stage.

What would/needs to happen if there is more than one row in T2 with column a = 0?
Is the row with 0 meant to be a "default" value for c if there is no match on a?

Regards,
by jwiles
Tue Jul 02, 2013 8:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Partitioning
Replies: 19
Views: 13128

To all who are questioning: The "Auto" partitioning method simply instructs the parallel engine (i.e. Orchestrate) to choose an appropriate partition method at runtime , provided that Auto Partitioning has not been overridden or disabled by "Preserve Partitioning", $APT_NO_PART_I...
by jwiles
Mon Jul 01, 2013 9:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Partitioning
Replies: 19
Views: 13128

You are reasonably correct. Auto partitioning will guarantee that the partitioning method chosen (if necessary) will meet the needs of the stage requiring said partitioning. As part of job performance tuning, your job may be able to take advantage of specific key partitioning techniques (which auto ...
by jwiles
Tue Jun 25, 2013 10:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data initialization
Replies: 10
Views: 3915

I always forget about that one....
by jwiles
Thu Jun 20, 2013 8:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue in using @INROW function
Replies: 9
Views: 5302

As Ray suggested earlier in the thread, use the Monitor tool in Director to see how the data has been distributed among the nodes at the points in your job you are assigning the sequence number. If the distribution varies by more than one row from min to max, you will see gaps. If it varies by only ...
by jwiles
Wed Jun 19, 2013 8:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with complex flat file output when integrated to MF
Replies: 7
Views: 5908

In our layout we are having some columns as comp-3 decimal and some are character We are generating that files in binary mode and the mainframes is ftp in ascii mode Generate the file so that character data is using the EBCDIC character set and there are no record delimiters (Complex Flat File can ...
by jwiles
Tue Jun 18, 2013 11:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with complex flat file output when integrated to MF
Replies: 7
Views: 5908

Are all of your data columns binary (comp-3, comp, etc.) or do you also have some that are character data? If you are using FTP in ASCII-mode to transfer a file from a system that is ASCII-based (Unix/Windows) to a system that is EBCDIC-based (z/OS), FTP will attempt to convert, on a byte-by-byte ba...
by jwiles
Mon Jun 17, 2013 8:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help required in Transformer stage 8.7
Replies: 2
Views: 1963

In a transformer stage, link ordering simply describes the order in which the output links (constraints and derivations) are processed. If you are using the "otherwise" constraint option for only one of the output links (to capture any records that did not get written to any other links), ...
by jwiles
Fri Jun 14, 2013 1:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Row Generator Stage
Replies: 4
Views: 1905

No. If RG is executing sequentially, that means that it is executing on ONE node.

1 row * 1 node = 1 total rows
by jwiles
Fri Jun 14, 2013 1:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Row Generator Stage
Replies: 4
Views: 1905

The number of rows you provide is per-node.

Total Rows Generated = Number of Rows Requested * Number of Nodes that RG executes on.

If RG is sequential (which is the default):
1 * 1 = 1

Regards,
by jwiles
Fri Jun 14, 2013 1:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Row Generator Stage
Replies: 4
Views: 1905

The number of rows you provide is per-node.

Total Rows Generated = Number of Rows Requested * Number of Nodes that RG executes on.

If RG is sequential (which is the default):
1 * 1 = 1

Regards,
by jwiles
Fri Jun 14, 2013 12:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue in using @INROW function
Replies: 9
Views: 5302

ONLY if you are round-robin partitioning a sequential source. If you round-robin an already-partitioned data source, you can get gaps in the assignment.

Regards,