DSXchange

thanx for the hint, this indeed decreases memory usage enormously. however: I've never worked with unix-sort before, but I seem to be having problems with available datatypes. When I insert a unix-sort it gives errors on timestamp and decimal not allowed as keys. So this option means an extra transf...

Hi, we're trying to process internet-usage records. We're talking about 60million records per day. These records need to be aggregated. However output from the aggregator is still very large( 40million). We have some memory and swap, but this doesn't seem to be enough. (32 GB mem, 32 GB swap). Our u...

we have this same error aftre a restart of the server. so user should be ok(connection was fine before restart). I however think that the restart was done incorrect, mix up between root-user and datastage-admin-user stopping and starting the processes. Could this cause this problem, and if so, how c...

personally I would not funnel. When you have inserts and updates split, keep them split up. It will improve performance .
Off cource dependant an DB and a lot of other parameters.

I'm not sure if this applies to datastage also, but in most db's you have to watch for the difference between varchar and char.
the string 'aa' as varchar(10) is not equal to 'aa' as char(10).
I think datastage works to same way.

I succeeded in this c-function. have to check special cases but this is the code for a first working version char* GetKeyValue(char* fullstring,char* searchstring) {char found[100]; char returnval[100]; char* tmp; char* keyvaldelimiter; char* puntcomma; size_t len; int keylen; keyvaldelimiter="...

ArndW, Do I oversee anything in the documentation of the index-function? using index I think it would look like: index(Fullstring,searchstring,1) would point me to the beginning of the key. Then I need to find the end of the key so +len(key).then I have the end of the key, value starts 5 places furt...

I'm not really convinced about your solution. You are correct I can write this in Datastage, but It is a complex calculation which would be used 25 times in one transformer. I want this in a routine otherwise it won't be readable. My transform has to look simple so The same funstion being called in ...

check the dir $DSHOME/../PXEngine/lib You here need to see links like -rwxr-xr-x 1 PDdtsadm PDdtsadm 1811572 Aug 9 2004 liborchoracle8isun4.so -rwxr-xr-x 1 PDdtsadm PDdtsadm 1811792 Aug 9 2004 liborchoracle9isun4.so -rwxr-xr-x 1 PDdtsadm PDdtsadm 1806720 Aug 9 2004 liborchoracle10gsun4.so lrwxrwxrwx...

Hi, As an input I have strings like : "Modem"=X:"49255080","Pkg"=l:0,"Svc"=l:4,"Brch"=L:0,"Reason"=l:0,"CfgDuration"=L:1800,"Duration"=L:1800,"EndTime"=T:1132056185,"UpV"=L:8,"DnV"=L:8,"...

It is saying got: "#", line 1 . Probably you've mistyped the parametername , or deleted the parameter from the jobparameters. Reason I think this: If you have a parameter DBUSER and you fill this in the stage you put #DBUSER#, if you there put #DB_USER# it won't be translated and you get a...

some things to watch: - parallelism: if the diff stage is run in parallel you migth get mismatches of node(allthough come to think of it this would cause an insert and delete not an update) -char-varchar : are both inputs the same format? if you compare a varchar with a char there migth be spaces ca...

I see you've allready solved it, but I still would like to give one hint: You say you're using an Oracle 10 client on an 8 DB. We 've had a lot of problems with this and our oracle support said this is not supported. If you need to work on both DB's with one client(what I find somewhat of a lack in ...

I use another way to do this, which looks much more elegant( to me at least). In a sort stage (I suppose you need to sort somewhere before this anyway) you can let it generate a 'key change column'. I usually use this, in the transformer your logic then becomes something like : if keychange is 1 the...

thanx, I'll give this a try.