Search found 110 matches

by jasper
Tue Sep 06, 2005 1:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: use of column import/transformer
Replies: 3
Views: 1515

use of column import/transformer

Hi, As an input for a job I have one table, that contains 120million records per day. In these records there are 10 straigthforward fields(char,number,...) and 4 complicated varchars. These varchars have a structure like : "var1"=type:"stringvalue","var2"=type:numberval...
by jasper
Wed Aug 31, 2005 5:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Square root of a negative
Replies: 7
Views: 3532

in &PH& it just sais:
more DSD.RUN_49231_13758 :

DataStage Job 448 Phantom 9831
DataStage Phantom Finished.
by jasper
Wed Aug 31, 2005 5:39 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Square root of a negative
Replies: 7
Views: 3532

ok, I did the search on the square root part, this didn't show anything. It was only while writing the post I thought about the question where to find the code. Still with the code it does not become clear. (there is no line 301) more JOB.1061193054.DT.1373958241.TRANS1 * Tokens were replaced below ...
by jasper
Wed Aug 31, 2005 2:05 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Square root of a negative
Replies: 7
Views: 3532

Square root of a negative

hi, I've created a server job that basically is: folder-stage(all .xml-files, which is mostly only one) xml-input stage with 3 different outputs (different key-column) this data is then loaded in 3 oracle-stages these stages are then again read and linked to a transformer which is again writing to a...
by jasper
Mon Aug 29, 2005 7:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: problem writing to oracle stage(partitoned-index organized)
Replies: 4
Views: 2097

it's a px job, but I've put the destination stage as sequential to see if this might help.
In the mean time I've also been playing with the $APT_ORACLE_LOAD_OPTIONS but this doesn't help.
by jasper
Mon Aug 29, 2005 7:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: problem writing to oracle stage(partitoned-index organized)
Replies: 4
Views: 2097

access rigths are ok for all other 100 jobs we have running daily with this user on this DB, also the rigths on the table are ok. I've tried with all combinations of the index option: -rebuild :Oracle_Enterprise_64: index option rebuild may not be used on a partitioned index. Table 'tng.ACCOUNT_BALA...
by jasper
Mon Aug 29, 2005 6:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: problem writing to oracle stage(partitoned-index organized)
Replies: 4
Views: 2097

problem writing to oracle stage(partitoned-index organized)

Hi, we 're trying to load an oracle table from DS. The oracle table is index-organized and hash-partitioned on the pk . some ways we tried: -we normally use an etl-user, that is not owner of the table, but has sufficient rigths. When we try this for this table, with option to truncate and load we ge...
by jasper
Mon Aug 22, 2005 2:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: extract data from two different databases
Replies: 7
Views: 3991

the way we normally do this is to put it an a hashfile and read this file in the workflow(user-variable stage that executes a readfromhash-function)
by jasper
Fri Aug 19, 2005 5:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: extract data from two different databases
Replies: 7
Views: 3991

lots of different options , best option depends on a lot of factors(like number of records in the tables) -easiest: 2 oracle stage one for the table, one for the max . Filter records in the job (disadvantage: you select all records from the table which could be a lot of overhead) - in a workflow fir...
by jasper
Thu Aug 18, 2005 6:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: error while extracting the data from oracle enterprise stage
Replies: 2
Views: 1783

main thing you need to do is use datastage as it is meant. Why are you writing these complex queries in one stage. Performance of your full job will be a lot better if you use one oracle-stage per table which you then join in datastage and also use the ds-aggregator. This will also get you a better ...
by jasper
Tue Aug 16, 2005 7:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to set commit frequency in Oracle Entreprise stage
Replies: 6
Views: 4008

If you're working with parallell processes it might indeed be best to set this to 1.
I've also come accross deadlock situation, that had nothing to do with bad design. Only way to avoid this is if you can partition your table and get datastage partiotioned in the same way.
by jasper
Fri Aug 12, 2005 1:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PX Routines
Replies: 4
Views: 2079

I use an after routine for this. most important statement in this:

Code: Select all

 CountRows = DSGetLinkInfo(DSJ.ME, Stage, Link, DSJ.LINKROWCOUNT)
.

This gives you the number rows that were processed on this one link in a stage.
by jasper
Fri Jul 29, 2005 3:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: naming columns from data
Replies: 1
Views: 1185

naming columns from data

We have an input from an oracle-db which have a column with key-value pairs. There are a lot of changes trough time which pairs are in there. data examlpe: Key data 1 name=first;object=table;designer = me 2 name=second;object=script;designer=me From this data I would like to make records where colum...
by jasper
Tue Jul 26, 2005 5:02 am
Forum: Enhancement Wish List
Topic: stage type extensions
Replies: 1
Views: 2411

stage type extensions

As most users we are using only a limited set of DB's (we now have 4 Oracle and one sybase IQ). Yet everytime you have to supply the db/user and pasword(or variables for these). I would like to see the possibility to extend the oracle stage to create for instance a DWH-Oracle that allready contains ...
by jasper
Mon Jul 25, 2005 5:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: only one proces returns rows from partitioned table
Replies: 1
Views: 1108

only one proces returns rows from partitioned table

Hi, I'm selecting data from an oracle stage(one table). When selecting without the partition table option (so with one process) I get 2000000 records back (all records from table) . When I put the partition option and take a 16-node configfile It only returns 160000 records and stops without error. ...