Search found 110 matches
- Tue Sep 06, 2005 1:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: use of column import/transformer
- Replies: 3
- Views: 1515
use of column import/transformer
Hi, As an input for a job I have one table, that contains 120million records per day. In these records there are 10 straigthforward fields(char,number,...) and 4 complicated varchars. These varchars have a structure like : "var1"=type:"stringvalue","var2"=type:numberval...
- Wed Aug 31, 2005 5:41 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Square root of a negative
- Replies: 7
- Views: 3532
- Wed Aug 31, 2005 5:39 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Square root of a negative
- Replies: 7
- Views: 3532
ok, I did the search on the square root part, this didn't show anything. It was only while writing the post I thought about the question where to find the code. Still with the code it does not become clear. (there is no line 301) more JOB.1061193054.DT.1373958241.TRANS1 * Tokens were replaced below ...
- Wed Aug 31, 2005 2:05 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Square root of a negative
- Replies: 7
- Views: 3532
Square root of a negative
hi, I've created a server job that basically is: folder-stage(all .xml-files, which is mostly only one) xml-input stage with 3 different outputs (different key-column) this data is then loaded in 3 oracle-stages these stages are then again read and linked to a transformer which is again writing to a...
- Mon Aug 29, 2005 7:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: problem writing to oracle stage(partitoned-index organized)
- Replies: 4
- Views: 2097
- Mon Aug 29, 2005 7:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: problem writing to oracle stage(partitoned-index organized)
- Replies: 4
- Views: 2097
access rigths are ok for all other 100 jobs we have running daily with this user on this DB, also the rigths on the table are ok. I've tried with all combinations of the index option: -rebuild :Oracle_Enterprise_64: index option rebuild may not be used on a partitioned index. Table 'tng.ACCOUNT_BALA...
- Mon Aug 29, 2005 6:52 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: problem writing to oracle stage(partitoned-index organized)
- Replies: 4
- Views: 2097
problem writing to oracle stage(partitoned-index organized)
Hi, we 're trying to load an oracle table from DS. The oracle table is index-organized and hash-partitioned on the pk . some ways we tried: -we normally use an etl-user, that is not owner of the table, but has sufficient rigths. When we try this for this table, with option to truncate and load we ge...
- Mon Aug 22, 2005 2:37 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: extract data from two different databases
- Replies: 7
- Views: 3991
- Fri Aug 19, 2005 5:18 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: extract data from two different databases
- Replies: 7
- Views: 3991
lots of different options , best option depends on a lot of factors(like number of records in the tables) -easiest: 2 oracle stage one for the table, one for the max . Filter records in the job (disadvantage: you select all records from the table which could be a lot of overhead) - in a workflow fir...
- Thu Aug 18, 2005 6:01 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: error while extracting the data from oracle enterprise stage
- Replies: 2
- Views: 1783
main thing you need to do is use datastage as it is meant. Why are you writing these complex queries in one stage. Performance of your full job will be a lot better if you use one oracle-stage per table which you then join in datastage and also use the ds-aggregator. This will also get you a better ...
- Tue Aug 16, 2005 7:31 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to set commit frequency in Oracle Entreprise stage
- Replies: 6
- Views: 4008
- Fri Aug 12, 2005 1:27 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: PX Routines
- Replies: 4
- Views: 2079
I use an after routine for this. most important statement in this:
.
This gives you the number rows that were processed on this one link in a stage.
Code: Select all
CountRows = DSGetLinkInfo(DSJ.ME, Stage, Link, DSJ.LINKROWCOUNT)
This gives you the number rows that were processed on this one link in a stage.
- Fri Jul 29, 2005 3:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: naming columns from data
- Replies: 1
- Views: 1185
naming columns from data
We have an input from an oracle-db which have a column with key-value pairs. There are a lot of changes trough time which pairs are in there. data examlpe: Key data 1 name=first;object=table;designer = me 2 name=second;object=script;designer=me From this data I would like to make records where colum...
- Tue Jul 26, 2005 5:02 am
- Forum: Enhancement Wish List
- Topic: stage type extensions
- Replies: 1
- Views: 2411
stage type extensions
As most users we are using only a limited set of DB's (we now have 4 Oracle and one sybase IQ). Yet everytime you have to supply the db/user and pasword(or variables for these). I would like to see the possibility to extend the oracle stage to create for instance a DWH-Oracle that allready contains ...
- Mon Jul 25, 2005 5:50 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: only one proces returns rows from partitioned table
- Replies: 1
- Views: 1108
only one proces returns rows from partitioned table
Hi, I'm selecting data from an oracle stage(one table). When selecting without the partition table option (so with one process) I get 2000000 records back (all records from table) . When I put the partition option and take a 16-node configfile It only returns 160000 records and stops without error. ...