Search found 46 matches

by Neil C
Tue Jan 17, 2006 9:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance issue of a job
Replies: 3
Views: 1630

Re: Performance issue of a job

aakashmalu wrote: ps:Target table has indexes.
Did you get this sorted? You say that the target table has indexes. How many indexes? Do they need to reorged? This would slow down the inserts.

Can the update statement actually use the index that you think it should, or is it doing a TS scan to update 1 row.
by Neil C
Mon Nov 28, 2005 7:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issues
Replies: 10
Views: 4051

select T1.A1 from table T T1 ,T T2" where <join conditions> --- note this is a self join. Why can this query not be used to create a hash file? Just select T2.A2, as well as T1.A1, and make this the key of the hash file. How many rows would this query generate? You say that the lookup has been...
by Neil C
Thu Sep 15, 2005 9:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance improvement
Replies: 5
Views: 2559

I think this falls into the "Just run it and see what happens" bucket Ray. :wink:
by Neil C
Wed Sep 07, 2005 8:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: command line functins that import and export the DS jobs
Replies: 23
Views: 13536

Is there a parameter to enable this to append to to_file_name file?
by Neil C
Mon Mar 21, 2005 10:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Friday Funny
Replies: 2
Views: 1460

Have you tried Googlisms?
http://www.googlism.com
by Neil C
Mon Nov 01, 2004 6:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data stage job stats (counts) stopped updating
Replies: 7
Views: 4008

Yay! It has ended OK. I was not looking forward to the rollback if it crashed.... Have now dissabled 24 RI constraints on the target table and it is running again. Lot less rows today, but a lot faster as well. Now to see how many other tables have useless constraints eneabled on them... Thanks guys.
by Neil C
Thu Oct 28, 2004 10:11 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data stage job stats (counts) stopped updating
Replies: 7
Views: 4008

In excess of 24 hours run time is in no way acceptable. It is doing a lot of work (many rows to process) but it should run quicker than it seems to have been over the last day. It was running at about 8 rows per second when the counts stopped. It usually does run quicker than this. Maybe up to 100 r...
by Neil C
Thu Oct 28, 2004 9:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data stage job stats (counts) stopped updating
Replies: 7
Views: 4008

Has there ever been a solution found for this problem? I have a job in the same situation currently. Running for 25:30 hours and the stats stopped updating some time back. It SEEMS to be still running, but I would like to know how far it has got. As far as I can see the two Oracle databases involved...
by Neil C
Mon Sep 27, 2004 10:22 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job abending after 16 million odd records
Replies: 6
Views: 3416

Thanks Ray. Found the note and passed it on to our DBA.
by Neil C
Mon Sep 27, 2004 8:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job abending after 16 million odd records
Replies: 6
Views: 3416

Kenneth, yes to all of that. Run time was 15 and 20 hours. I have modified the jobs to select only those rows that did not get processed first time round into a sequential file, then to process these. One still had 3.5M to go, the other only 1.9M so I should be able to get them run in a reasonable t...
by Neil C
Mon Sep 27, 2004 6:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job abending after 16 million odd records
Replies: 6
Views: 3416

Job abending after 16 million odd records

I have two different (but similar) DS jobs that read data from Oracle 9i (9.2.0.5), perform 3 hash file lookups and 3 Oracle lookups, and write (INSERT) rows into a table on a second Oracle instance. My problem is that after ABOUT 16M rows (16,239,271 for one, 16,497,919 for the other) the job abend...
by Neil C
Sun Aug 29, 2004 9:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DB2 SQL error
Replies: 5
Views: 10174

What was the error code from the DB2 system log (allways assuming there was one)?
by Neil C
Sun Aug 22, 2004 7:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Jobs simultaneously accessing the same DB2 table
Replies: 4
Views: 2270

You could also ask your DB2 DBA if row level locking might help you. Generally a DB2 table would be created with a number of rows per block, and an update lock will lock the whole block. If the blocks are large, or the rows are short, then the possability of two updates hitting the same block would ...
by Neil C
Wed Aug 11, 2004 10:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multiple writes to a Hash file
Replies: 2
Views: 1558

DISKCACHE = -1 and DCWRITEDEAMON = 0.

Off to do some reading....

Thanks Ray.
by Neil C
Wed Aug 11, 2004 9:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: sql error
Replies: 3
Views: 2378

-805 error code in DB2 means "DBRM OR PACKAGE NAME NOT FOUND IN PLAN" So go to the DB2 system and find out what package or plan it is complaining about and get the DB2 DBA to rebind it for you. What method of accessing DB2 are you using? DB2 Connect, Oracle Transparent Gateway, something e...