Search found 134 matches
- Tue May 09, 2006 9:20 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: delete large number of records in DB2
- Replies: 17
- Views: 16806
possibly a simpler method
another way of approaching this is to break the delete statment into chunks - delete from MYTABLE where KEYFIELD in ( select KEYFIELD from MYTABLE fetch first 1000 rows only ) ; And keep running this in a loop until all the records are gone ! Obviously you want to bump up the 1000 fetch limit to som...
- Mon Apr 24, 2006 4:08 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Running job in control M
- Replies: 16
- Views: 20899
sorry sam , was speaking a bit generically - but since I am downloading a patch for UT2004 and twiddling my meterphorical thumbs will try to expand. Basisically a datastage job could take many variables , examples are Source File e.g. /prd/data/CUST_20050101.DAT Target DataBase e.g. BIWAREHOUSETHING...
- Mon Apr 24, 2006 5:30 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Running job in control M
- Replies: 16
- Views: 20899
Hi, we use controlM quite easily here - all it does is run a command line after all but a few points that you may wish to consider a) you could have CtrlM kick of a $DSHOME/bin/dsjob -etc -etc -etc -project PROJNAME -job JOBNAME command but this isnt particular migratable between dev and prod envior...
- Tue Jan 17, 2006 10:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: BASIC Transformer
- Replies: 3
- Views: 1098
The transformer Is accessabile through the repository tree ->stage types-->parrell--> processing --> basic transformer Care should be taken as though it still fits the parallel archetiture - it can be a severe bottleneck for each processing node. Cunningly it also looks EXACTLEY the same as the EE t...
- Tue Jan 17, 2006 10:16 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: BASIC Transformer
- Replies: 3
- Views: 1098
The transformer Is accessabile through the repository tree ->stage types-->parrell--> processing --> basic transformer Care should be taken as though it still fits the parallel archetiture - it can be a severe bottleneck for each processing node. Cunningly it also looks EXACTLEY the same as the EE t...
- Sat Oct 15, 2005 8:02 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: error code = -14
- Replies: 5
- Views: 1962
bit more detail
we have been plagued by this one, basically the out the box DS configuration allows for only a set amount of dynamic and static hash files to be open at once. These are specified in uvconfig (see T30Files and Mfiles entrys) once this number is hit then universe starts closing file handles to open ne...
- Thu Oct 06, 2005 3:53 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: APT_Buffer_Operator: Add block to queue failed.
- Replies: 2
- Views: 1434
this often means that it cant write a scratch file (used in merge, sorting etc) check disk space - when job running - we hit this and an 'annoyying thing about px is it can clean up nicely if job aborts' so removed tmp files - so cant always see if disk full once job completes. also can be caused (i...
- Wed Jul 20, 2005 10:59 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Pivot plugin not found
- Replies: 4
- Views: 1692
I dont believe all stages are installed by default , unless they are specified in the original install. (Bit of a pain if you forget to do it as you have to add them in after creating new projects - not that you can create old projects - i digress) there is a unix util , something like dspackinst in...
- Tue May 03, 2005 10:23 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Question Re DB2EE stage and partioning
- Replies: 1
- Views: 1294
Question Re DB2EE stage and partioning
Hi, having some less than performant results with writing to db2 (insert mode) and want to get some input. Basically have a partioned db2 table (20x) and have set up a config.apt on appserver with 4x on app and 1 node for db2 (the db2nodes.cfg) says 20. When using the db2 stage for reads it launchs ...
- Thu Apr 21, 2005 9:43 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Multiple recordtypes in a single flatfile
- Replies: 8
- Views: 4209
You can also use the Complex File Stage with multiple output links - the selection page allows you to define the field as the rectype indicator and each output link can have different table defs on it Its a more elegant, and understandable solution but I am not sure about performance vs reading from...
- Tue Apr 19, 2005 9:16 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: version control moved different job
- Replies: 8
- Views: 1613
- Mon Apr 04, 2005 4:13 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Writing to log using buildop
- Replies: 1
- Views: 1056
Writing to log using buildop
Simple one, is there a standard function to write debug info to job log in my buildop c++ code
- Tue Mar 15, 2005 5:06 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Multiple Record Types in sequential files
- Replies: 5
- Views: 2181
Multiple Record Types in sequential files
Hi , I have a file that has two distinct record types of form RECT1 field1 field2 field3 RECT2 fielda fieldb Question is what is the easiest way to read this using PX v7.1 (I know there is CFF stage in 7.5) I believe I can do something with schemas but am new to this and documentation is a bit uncle...
- Tue Feb 08, 2005 7:00 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job accessed by another user
- Replies: 6
- Views: 2666
This can be a pain, but its worth understanding what is going on DataStage maintains a list of locks on all universe files that are used in the system , including runtime files such as RT_CONFIGxx and designtime files such as DS_JOBS (this lock I guess is record level) When a user opens a job in des...
- Thu Jan 20, 2005 5:18 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Attempting to Cleanup after ABORT raised
- Replies: 6
- Views: 2986