Hi,
We have developed the job. like this
OCI(Source)-->HASHFILE(Refere)-->TRAN-->SEQFILE-->AGR(SUM)--
>AGR(MAX)--->SORT-->TRANS-->HASH
We lookup the data in to transformer and these records are loaded into a
Sequence file. After that using the Aggregator, we found the Sum value
and once again we put another Aggregator, we found the Max value.
Then we used Sort Stage, then we got the Max Value.
Now, The problem is
Our client said, we don't need to use sort stage after 2nd
Aggregator. They expect the result direct from the 2nd Aggregator.
We tried to change. But till now , we did not get the exact value . We
need the result from only through 2nd Aggregator.
with Regards
prabhu
Can any one Suggest me. How can i do ?
need max value without sort stage
Moderators: chulett, rschirm, roy
Re: need max value without sort stage
Ok i am confused, you said in your descriptioin that you are getting the max value from the second aggregator and in your quest, you want to get max from the second aggregator without sorting. But arent you already doing that???praburaj wrote:After that using the Aggregator, we found the Sum value
and once again we put another Aggregator, we found the Max value.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
Re: need max value without sort stage
yes, I did . Using the 2nd Aggregator , i maximize the value. Then i put
sorting stage and sort stage connected to Hashfile. Ok , data is coming
good. But now, we need to find the max data through 2nd Aggregator.
That means 2nd Aggregator will connect to Hash file. After the 2nd
Aggregator dont put any stage. That will connect only in Hash file. I tried
but i did not get correct result.
Any Solutions.
sorting stage and sort stage connected to Hashfile. Ok , data is coming
good. But now, we need to find the max data through 2nd Aggregator.
That means 2nd Aggregator will connect to Hash file. After the 2nd
Aggregator dont put any stage. That will connect only in Hash file. I tried
but i did not get correct result.
Any Solutions.
You tell us, why you need the sort stage to store the data in the file. If your requirement is to find the max of the group, and that too, if you already found using the 2nd aggregator, I dont find a need to sort stage. If you give some example of what you expect, and what you get if sort stage is been removed, it will be easy.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'