The Aggrigator...dum dum dum :)
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
You shouldn't need TRIM on the numerics. This may help. An even more efficient way to handle this is to perform any arithmetic - for example add zero to the number. DataStage always returns the shortest possible string from an arithmetic calculation. And it's definitely quicker, if the item is already numeric.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
The numeric fields that I did the trim(upcase)) to were id fields...Like Port ID. id rather not do any funny stuff to that. im gona search for multex again see if i can find my last post.ray.wurlod wrote:You shouldn't need TRIM on the numerics. This may help. An even more efficient way to handle this is to perform any arithmetic - for example add zero to the number. DataStage always returns the shortest possible string from an arithmetic calculation. And it's definitely quicker, if the item is already numeric.
Jim
Sure I need help....But who dosent?
Hi,
I don't remember if it was said here or not, was much to read,
did you concider sorting the data (oh yea Ken, I believe, said it )
before aggregating it?
this should speed your aggregator stage and might eliminate the mutex issue since the work for the agg stage would be much easier on the system resources.
(Don't forget to mention the sorted column number in the input section of your agg stage and the ascending/descending sort you made)
IHTH
I don't remember if it was said here or not, was much to read,
did you concider sorting the data (oh yea Ken, I believe, said it )
before aggregating it?
this should speed your aggregator stage and might eliminate the mutex issue since the work for the agg stage would be much easier on the system resources.
(Don't forget to mention the sorted column number in the input section of your agg stage and the ascending/descending sort you made)
IHTH
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
I have actualy been a very bad forum poster...the type that I hate actualy. The multex error is happening in a job before the aggrigator job. You see i am haveing a problem in the aggrigator in that it is producing more rows of data than the same function in SQL server sql code would produce. So i went back to the job that creates the load file for my aggrigator and did a Trim(upcase)) to all of the fields except my metrics. At this point the job that creates the load file for the aggrigator is failing with the multex error. Im guessing I should have broken it out into another post. What is worse is this very job had done this in the past and i did something to get past it and I CANT REMEMBER!!!! its just about to drive me crazy.roy wrote:Hi,
I don't remember if it was said here or not, was much to read,
did you concider sorting the data (oh yea Ken, I believe, said it )
before aggregating it?
this should speed your aggregator stage and might eliminate the mutex issue since the work for the agg stage would be much easier on the system resources.
(Don't forget to mention the sorted column number in the input section of your agg stage and the ascending/descending sort you made)
IHTH
Jim
Sure I need help....But who dosent?
Hi,
Well unfortunatly the only solution I can give you is to rewrite it from scratch and do everything by the book.
sometimes thru time some jobs, that were edited numerous times get some litle thing we wrote that messes the job and we can't find our bug.
so I would recomend a rewrite from scratch, painfull yess, but might get you going with no bugs.
Good Luck
Well unfortunatly the only solution I can give you is to rewrite it from scratch and do everything by the book.
sometimes thru time some jobs, that were edited numerous times get some litle thing we wrote that messes the job and we can't find our bug.
so I would recomend a rewrite from scratch, painfull yess, but might get you going with no bugs.
Good Luck
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
After i rebuilt the partitioner and colector section of the job it ran without any trouble. Thank god I didnt have to rebuild the transforms. Now on to my aggrigation problemroy wrote:Hi,
Well unfortunatly the only solution I can give you is to rewrite it from scratch and do everything by the book.
sometimes thru time some jobs, that were edited numerous times get some litle thing we wrote that messes the job and we can't find our bug.
so I would recomend a rewrite from scratch, painfull yess, but might get you going with no bugs.
Good Luck
Jim
Sure I need help....But who dosent?
Jim,
Trim by itself without options defaults to option r I believe. This may be giving you problems since the r option removes leading, trailing, and multiple occurances of space and tab(unless another character is specified) within the field.
example:
trim(" this text ")= "this text"
I have run into problems mainly concerning trailing blanks, therefore I use trimb(filedname) most of the time.
hth,
Steve
Trim by itself without options defaults to option r I believe. This may be giving you problems since the r option removes leading, trailing, and multiple occurances of space and tab(unless another character is specified) within the field.
example:
trim(" this text ")= "this text"
I have run into problems mainly concerning trailing blanks, therefore I use trimb(filedname) most of the time.
hth,
Steve