Search found 102 matches

by iq_etl
Fri Nov 22, 2013 2:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Preserve Trailing Blanks Setting in Oracle Connector
Replies: 2
Views: 1863

Preserve Trailing Blanks Setting in Oracle Connector

Per the online DS documentation, it looks as if we are to set the 'Preserve Trailing Blanks' setting to 'No' in the Oracle Connector stage, then trailing blanks in a column would be removed. http://pic.dhe.ibm.com/infocenter/iisinfsv/v9r1/index.jsp?topic=%2Fcom.ibm.swg.im.iis.conn.oracon.usage.doc%2...
by iq_etl
Wed Nov 20, 2013 10:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue Reading in a Sequential File with trailing blanks
Replies: 7
Views: 9514

I owe an apology to Franklin. I was mistaken. The UNIX Newline comes after the last filled position, so the remaining fields seem to be truncated. I tried what you specified above (delimiter "None", quotes "None", Final Delimiter = "End") and I got the Input buffer over...
by iq_etl
Tue Nov 19, 2013 1:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue Reading in a Sequential File with trailing blanks
Replies: 7
Views: 9514

FranklinE wrote:I'm just a bit confused by your description. Are the "blank" fields actually filled with spaces to the length shown, are they null fields, or do they have only one space where more are expected?
Franklin, they are filled with spaces to the length shown.
by iq_etl
Tue Nov 19, 2013 12:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue Reading in a Sequential File with trailing blanks
Replies: 7
Views: 9514

Issue Reading in a Sequential File with trailing blanks

We are having issues reading in Sequential Files with blank values in the final columns. For example, lets say I have a Sequential File with 5 columns: Col_1 CHAR(5) Col_2 CHAR(5) Col_3 CHAR(1) Col_4 CHAR(2) Col_5 CHAR(6) If my record has values in Col_1, Col_2, and Col_3, but Col_4 and Col_5 are em...
by iq_etl
Mon Nov 18, 2013 6:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: slow execution of simple job using Oracle connector
Replies: 7
Views: 3006

Thanks. I've asked our DBA to look at this again, and will post the results.
by iq_etl
Mon Nov 18, 2013 1:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: slow execution of simple job using Oracle connector
Replies: 7
Views: 3006

I think so. The unique key is defined as the combination of CCYYS, SNAPSHOT, SRI, CLASS_UNIQUE, and PE_OCCURRENCE. As it happens, CLASS_UNIQUE is not really needed - the combination of the other four columns is still unique. I've tried it with and without 'AND CLASS_UNIQUE = :CLASS_UNIQUE' included ...
by iq_etl
Mon Nov 18, 2013 12:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: slow execution of simple job using Oracle connector
Replies: 7
Views: 3006

Absolutely. In the 'Properties' tab of the Oracle Connector stage, the write mode is set to PL/SQL and the following PL/SQL block is executed: declare change_code nchar(1); ccyys int(5); snapshot nvarchar2(3); sri int(9); class_unique nvarchar2(5); pe_occurrence nchar(3); dept_abbr nvarchar2(3); cou...
by iq_etl
Fri Nov 15, 2013 5:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: slow execution of simple job using Oracle connector
Replies: 7
Views: 3006

slow execution of simple job using Oracle connector

I have a very simple job which reads a dataset of changes with eight columns plus a change code, and uses a PL_SQL CASE statement to apply the changes using an Oracle connector. To process UPDATEs to about 230,000 records, it's taking about 3 1/2 hours. By contrast, a very similar job that actually ...
by iq_etl
Wed Oct 30, 2013 6:40 am
Forum: General
Topic: Multiple Instance Job in Sequence
Replies: 2
Views: 773

Looking at the Invocation ID input in Director it appears as if this is a hardcoded value. When you say to type in the parameter reference, we do have to create multiple instance via hardcoding, as the running of the sequence won't dynamically generate an Invocation ID. Say, append the job name to t...
by iq_etl
Tue Oct 29, 2013 12:46 pm
Forum: General
Topic: Default Values in Parameter Set
Replies: 5
Views: 37657

We are using value files to create default values for testing.

Thanks, Ray!
by iq_etl
Tue Oct 29, 2013 12:45 pm
Forum: General
Topic: Multiple Instance Job in Sequence
Replies: 2
Views: 773

Multiple Instance Job in Sequence

I've got a sequence that collects pre-row counts on a table prior to loading a table. This sequence has been set up execute whatever parallel job the scheduler sends it. In the Job Properties of this PreCount job, I've checked 'Allow Multiple Instance'. What I'm hoping to see in Director is the resu...
by iq_etl
Fri Oct 25, 2013 8:47 am
Forum: General
Topic: Default Values in Parameter Set
Replies: 5
Views: 37657

Great suggestion, Andy, and we do this with server info parameters.

Here I'm looking more at a series of generic parameter defaults. So say, JOB_A will have PARAM01 as a year of 2013, but JOB_B may have PARAM01 as some code like D12.

Thanks!
by iq_etl
Fri Oct 25, 2013 8:42 am
Forum: General
Topic: Default Values in Parameter Set
Replies: 5
Views: 37657

The value files look like a good approach. As I add new value files, will I need to re-compile all of the jobs that use the parameter set whether they use the new value file or not? Also, to get these values from the value files to show up, how are they assigned within a job? It looks like they're a...
by iq_etl
Thu Oct 24, 2013 9:34 am
Forum: General
Topic: Default Values in Parameter Set
Replies: 5
Views: 37657

Default Values in Parameter Set

We've got 8 generic parameters in a parameter set and each DS job has its own, unique values it may or may not use, is it possible to set up a parameter in the Job Properties that can serve as a default value for one of the generic 8 parameters in the parameter set? I'm wondering something like if i...
by iq_etl
Thu Oct 24, 2013 9:02 am
Forum: General
Topic: Parameter Limit in Job Activities?
Replies: 12
Views: 6359

Thanks, all, we've got our one sequencer now executing our DS jobs whether they have parameters or not.

I added the 8 parameters to a parameter set that all of our jobs use, made sure they were being referenced correctly (thanks for the tip, Andy!), and all is good.