Search found 102 matches

by iq_etl
Mon Jun 02, 2014 9:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: row merger function in parallel edition?
Replies: 7
Views: 4076

Thanks! I will give it a try.
by iq_etl
Fri May 30, 2014 5:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: row merger function in parallel edition?
Replies: 7
Views: 4076

row merger function in parallel edition?

Hi all, I'm wanting to combine rows like this: row1 key1 keyword1 row2 key1 keyword2 row3 key1 keyword3 row4 key2 keyword1 row5 key2 keyword2 into row1 key1 keywords (contains keyword1 + keyword2 + keyword3) row2 key2 keywords (contains keyword1 + keyword2) It seems that there was a stage for this i...
by iq_etl
Wed Mar 05, 2014 11:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Setting up RCP job
Replies: 5
Views: 3322

Ray, I believe I understand this. * open the Transformer stage * right click on the appropriate output like and select 'link properties' * this opens the Transformer Stage Properties window with the relevant output link tab opened * check 'Runtime column propagation' in the bottom left which should ...
by iq_etl
Tue Mar 04, 2014 2:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Setting up RCP job
Replies: 5
Views: 3322

Ray, I've got the RCP box checked on the columns tab of the Oracle Connector. In the Transformer, when I select 'stage properties' (upper left) the RCP option is checked on the Output links tab. _However_, when I go into the transformer pane and into the 'link properties' of the output link, the RCP...
by iq_etl
Mon Mar 03, 2014 11:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Setting up RCP job
Replies: 5
Views: 3322

Setting up RCP job

We don't have RCP set up for any of our projects or jobs, but since we've got a little downtime, we're interested in understanding the concept...but haven't had much success. So, in the Administrator I have a test project set to 'Enable Runtime Column Propagation for Parallel jobs'. In a test job fo...
by iq_etl
Sat Feb 22, 2014 9:49 am
Forum: General
Topic: Sequence Design Suggestion
Replies: 2
Views: 991

Bingo! I believe this is it. We had the sequence set up for multi-instance, but the 'load status table' job itself wasn't. I have corrected that.

The status for the job was '2 - compiled not running' or something like that.

Fantastic! This should be fixed now.
by iq_etl
Sat Feb 22, 2014 12:14 am
Forum: General
Topic: Sequence Design Suggestion
Replies: 2
Views: 991

Sequence Design Suggestion

Ok, let me see if I can lay out the scenario descriptively enough. We have a single sequence, designed to dynamically load hundreds of tables, that has the following Job Activities, in order: 0) Scheduler - passes along a DS project name, a job name and table name for the sequence to run. Sequence c...
by iq_etl
Tue Feb 18, 2014 1:19 pm
Forum: General
Topic: Write Exceptions to File
Replies: 1
Views: 1259

Write Exceptions to File

I've got a sequence with an Exception Handler in it that then leads to a Notification Activity. There's not a lot of data to go on with from just the Notification Activity, so serves more as a 'heads-up' only. However, I'd like it to be more useful than that. I'd like the Exception Handler to write ...
by iq_etl
Tue Feb 18, 2014 1:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup job hanging up
Replies: 5
Views: 2744

We have removed columns not referenced, rows not needed, and use outer joins to reference the tables that have millions of rows.

The job no longer hangs up and takes only about a minute to execute.
by iq_etl
Mon Feb 17, 2014 9:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Shared Table Definitions?
Replies: 3
Views: 2308

Our DBA applied the appropriate grants and now all is well.
(It's possible the grants script wasn't initially run or perhaps not successful)

Thanks all!
by iq_etl
Mon Feb 17, 2014 8:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Shared Table Definitions?
Replies: 3
Views: 2308

Thanks for clarifying that this is unrelated to table definitions. I'm still confused as to what is going on. The two tables are in the same schema that as the other tables used in this job. Again, I can see these tables and their data in the correct schema in SQL developer, I can even load the colu...
by iq_etl
Fri Feb 14, 2014 8:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup job hanging up
Replies: 5
Views: 2744

Lookup job hanging up

I've got a job that starts by reading a table via Oracle Connector. This table has 171217 rows. There are then about 15 tables of various sorts used as lookups. Two have about 500,000 rows and two have about 6.5 million. The job is hanging up whether I'm reading 200 or 20 records from the source tab...
by iq_etl
Mon Feb 03, 2014 4:12 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: "ORA-00942: table or view does exist" but it does.
Replies: 11
Views: 5833

Can you break this down just a bit more? Qualifying the table name with the schema, connects us as an owner? I thought those auths were in the user/server/password permissions (that, we do parameterize). If I understand correctly, where we've got the schema name, you'd put that in a parameterized ID?
by iq_etl
Mon Feb 03, 2014 2:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: "ORA-00942: table or view does exist" but it does.
Replies: 11
Views: 5833

So, what's the best practice? As we've got it now, or having the scheduler pass in the schema qualification along with the table name to the sequence (which passes the\ose along to the DS jobs)?
by iq_etl
Mon Feb 03, 2014 9:32 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: "ORA-00942: table or view does exist" but it does.
Replies: 11
Views: 5833

Ok, I've got all jobs in the sequence working. In the pre-row count job, I'm now qualifying the table name with the schema. example below: SELECT COUNT(*) BeforeRowCount FROM [SCHEMA].#TABLE_NAME# What has thrown me off is that in the initial project we built (we have about 4 projects, one for each ...