Search found 376 matches

by jerome_rajan
Wed Oct 08, 2014 11:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ORCHESTRATE reference in SQL File
Replies: 2
Views: 2698

Thanks Ray.

Just tried it after your reply. It worked!
by jerome_rajan
Wed Oct 08, 2014 11:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ORCHESTRATE reference in SQL File
Replies: 2
Views: 2698

ORCHESTRATE reference in SQL File

Hi,

Is it possible to reference to a column in the DataStage metadata using ORCHESTRATE.column_name in a SQL file containing an insert statement in a target oracle connector stage?
by jerome_rajan
Mon Oct 06, 2014 6:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improving a large Join
Replies: 9
Views: 6114

I dont have any partition on the input flows of the join Why? I use the Balanced Optimization Tool to improve the performance in this job Is it possible that executing a simple "SELECT * FROM TABLE1 left join SELECT * FROM TABLE2" between this two large tables is faster than the same oper...
by jerome_rajan
Thu Sep 18, 2014 3:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: more than one final delimiter?
Replies: 8
Views: 4899

Are you saying that your file could look like this ?

Code: Select all

col1,col2,col3
a,b,c|
l,m,n
x,y,z~
or like this?

Code: Select all

col1,col2,col3
a,b,c|~
l,m,n|~
x,y,z|~
by jerome_rajan
Wed Sep 17, 2014 9:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Preserve Partitioning Flag Warning
Replies: 8
Views: 7570

Operator of type "APT_JoinSubOperatorNC": will partition despite the preserve-partitioning flag on the data set on input port 0. buffer(3): When checking operator: Operator of type "APT_BufferOperator": will partition despite the preserve-partitioning flag on the data set on inp...
by jerome_rajan
Wed Sep 17, 2014 3:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dynamic Vertical Pivot
Replies: 0
Views: 1784

Dynamic Vertical Pivot

Hi, I am faced with a situation where we may need to vertically pivot data from rows to columns but do not know for sure exactly how many columns it will need to be pivoted to. We do have an upper limit but the limit is 100 and the probability of getting more than 8-12 columns is very less. We want ...
by jerome_rajan
Mon Sep 15, 2014 10:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Preserve Partitioning Flag Warning
Replies: 8
Views: 7570

Wouldn't 'SET' try to force the next stage to preserve partitioning, thereby producing the same warning again? I've set the flag to 'CLEAR' to ensure that the stage is impervious to the partitioning of downstream stages
by jerome_rajan
Fri Sep 12, 2014 1:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Preserve Partitioning Flag Warning
Replies: 8
Views: 7570

All the stages upstream of the lookup, yes.
by jerome_rajan
Fri Sep 12, 2014 5:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Preserve Partitioning Flag Warning
Replies: 8
Views: 7570

And here's the output of APT_DUMP_SCORE main_program: This step has 30 datasets: ds0: {op0[1p] (parallel APT_CombinedOperatorController(0):APT_TransformOperatorImplV0S13_NestedTableEDI852_Delimted_Transformer_13 in Transformer_13) eOther(APT_HashPartitioner { key={ value=MasterKey, subArgs={ cs } } ...
by jerome_rajan
Fri Sep 12, 2014 5:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Preserve Partitioning Flag Warning
Replies: 8
Views: 7570

Changed lookup to join and receiving a warning on similar lines Operator of type "APT_JoinSubOperatorNC": will partition despite the preserve-partitioning flag on the data set on input port 0. buffer(3): When checking operator: Operator of type "APT_BufferOperator": will partitio...
by jerome_rajan
Fri Sep 12, 2014 5:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Preserve Partitioning Flag Warning
Replies: 8
Views: 7570

Lookup Preserve Partitioning Flag Warning

Hi, My lookup is throwing the warning Operator of type "APT_LUTCreateOp": will partition despite the preserve-partitioning flag on the data set on input port 0. I have set the preserver partitioning flag on both the stream as well as the reference links to 'clear' but I continue to receive...
by jerome_rajan
Tue Sep 09, 2014 11:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parent Child Load
Replies: 2
Views: 1687

Hi Ray,

I'm on DataStage 8.1 and I don't think the Oracle connector will accept multiple inputs.
by jerome_rajan
Tue Sep 09, 2014 11:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parent Child Load
Replies: 2
Views: 1687

Parent Child Load

We have a source file that contains hierarchical data. I'm using a DataStage jbo to separate the parent from the children and the grand children into 3 different links. The target is an Oracle table with the children going into nested tables within the parent table. What would be the best way to seq...
by jerome_rajan
Wed Sep 03, 2014 8:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup without a key column
Replies: 4
Views: 3154

Re: Lookup without a key column

I agree. I don't see the need for a look-up here. A column generator will suffice
by jerome_rajan
Tue Sep 02, 2014 6:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading Nested Tables
Replies: 10
Views: 3509

I wasn't able to use the DT stage due to lack of sufficient knowledge. But I managed to implement it using a sequence of oracle connectors with the parent/child approach. Thank you for your timely assistance.