Search found 134 matches

by fridge
Tue May 09, 2006 9:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: delete large number of records in DB2
Replies: 17
Views: 16806

possibly a simpler method

another way of approaching this is to break the delete statment into chunks - delete from MYTABLE where KEYFIELD in ( select KEYFIELD from MYTABLE fetch first 1000 rows only ) ; And keep running this in a loop until all the records are gone ! Obviously you want to bump up the 1000 fetch limit to som...
by fridge
Mon Apr 24, 2006 4:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Running job in control M
Replies: 16
Views: 20899

sorry sam , was speaking a bit generically - but since I am downloading a patch for UT2004 and twiddling my meterphorical thumbs will try to expand. Basisically a datastage job could take many variables , examples are Source File e.g. /prd/data/CUST_20050101.DAT Target DataBase e.g. BIWAREHOUSETHING...
by fridge
Mon Apr 24, 2006 5:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Running job in control M
Replies: 16
Views: 20899

Hi, we use controlM quite easily here - all it does is run a command line after all but a few points that you may wish to consider a) you could have CtrlM kick of a $DSHOME/bin/dsjob -etc -etc -etc -project PROJNAME -job JOBNAME command but this isnt particular migratable between dev and prod envior...
by fridge
Tue Jan 17, 2006 10:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: BASIC Transformer
Replies: 3
Views: 1098

The transformer Is accessabile through the repository tree ->stage types-->parrell--> processing --> basic transformer Care should be taken as though it still fits the parallel archetiture - it can be a severe bottleneck for each processing node. Cunningly it also looks EXACTLEY the same as the EE t...
by fridge
Tue Jan 17, 2006 10:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: BASIC Transformer
Replies: 3
Views: 1098

The transformer Is accessabile through the repository tree ->stage types-->parrell--> processing --> basic transformer Care should be taken as though it still fits the parallel archetiture - it can be a severe bottleneck for each processing node. Cunningly it also looks EXACTLEY the same as the EE t...
by fridge
Sat Oct 15, 2005 8:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: error code = -14
Replies: 5
Views: 1962

bit more detail

we have been plagued by this one, basically the out the box DS configuration allows for only a set amount of dynamic and static hash files to be open at once. These are specified in uvconfig (see T30Files and Mfiles entrys) once this number is hit then universe starts closing file handles to open ne...
by fridge
Thu Oct 06, 2005 3:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_Buffer_Operator: Add block to queue failed.
Replies: 2
Views: 1434

this often means that it cant write a scratch file (used in merge, sorting etc) check disk space - when job running - we hit this and an 'annoyying thing about px is it can clean up nicely if job aborts' so removed tmp files - so cant always see if disk full once job completes. also can be caused (i...
by fridge
Wed Jul 20, 2005 10:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Pivot plugin not found
Replies: 4
Views: 1692

I dont believe all stages are installed by default , unless they are specified in the original install. (Bit of a pain if you forget to do it as you have to add them in after creating new projects - not that you can create old projects - i digress) there is a unix util , something like dspackinst in...
by fridge
Tue May 03, 2005 10:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Question Re DB2EE stage and partioning
Replies: 1
Views: 1294

Question Re DB2EE stage and partioning

Hi, having some less than performant results with writing to db2 (insert mode) and want to get some input. Basically have a partioned db2 table (20x) and have set up a config.apt on appserver with 4x on app and 1 node for db2 (the db2nodes.cfg) says 20. When using the db2 stage for reads it launchs ...
by fridge
Thu Apr 21, 2005 9:43 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multiple recordtypes in a single flatfile
Replies: 8
Views: 4209

You can also use the Complex File Stage with multiple output links - the selection page allows you to define the field as the rectype indicator and each output link can have different table defs on it Its a more elegant, and understandable solution but I am not sure about performance vs reading from...
by fridge
Tue Apr 19, 2005 9:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: version control moved different job
Replies: 8
Views: 1613

I have had this problem in our set up and I believe it can be resolved by reindexing the version control repository, using DS.TOOLS from the command line in Admin.exe often does the trick
by fridge
Mon Apr 04, 2005 4:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Writing to log using buildop
Replies: 1
Views: 1056

Writing to log using buildop

Simple one, is there a standard function to write debug info to job log in my buildop c++ code
by fridge
Tue Mar 15, 2005 5:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple Record Types in sequential files
Replies: 5
Views: 2181

Multiple Record Types in sequential files

Hi , I have a file that has two distinct record types of form RECT1 field1 field2 field3 RECT2 fielda fieldb Question is what is the easiest way to read this using PX v7.1 (I know there is CFF stage in 7.5) I believe I can do something with schemas but am new to this and documentation is a bit uncle...
by fridge
Tue Feb 08, 2005 7:00 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job accessed by another user
Replies: 6
Views: 2666

This can be a pain, but its worth understanding what is going on DataStage maintains a list of locks on all universe files that are used in the system , including runtime files such as RT_CONFIGxx and designtime files such as DS_JOBS (this lock I guess is record level) When a user opens a job in des...
by fridge
Thu Jan 20, 2005 5:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Attempting to Cleanup after ABORT raised
Replies: 6
Views: 2986

I believe (but will prob get blasted by the likes of Ray) that this can also happen if deadlock daemon enabled and it found a deadlock.

Basically if 'deadly embrace' occurs on a hashfile record/group the daemon kicks in and nobbles one of the offenders