DSguru2B wrote:In the transformer, go to the stage properties, what partitioning are you providing?
Counts and sums in Datastage with out 'Aggregator' stage
Moderators: chulett, rschirm, roy
Coming back to the "Why you are not using the Aggregator stage", inconsistant and inaccurate data is not the fault of the aggregator stage. Its the fault of how it was used. Take a small set of data, use the aggregator stage to build a job out of it. Test it out. If you have problems, we are here to help you out. Once you get that working, then feed in a couple of millions. If that works out too then feed in your complete data feed. Prove to "them" that aggregator works just fine. Instead of reinventing the wheel. You do realize that doing all those current row to previous row comparisons will also take some time. Wont be drastically slow but still.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
I got it. thanks Guru.
one last question. Is there any way that we can write last record with count to output instead of having a sort and Remove Dupl. stages after transformer.
one last question. Is there any way that we can write last record with count to output instead of having a sort and Remove Dupl. stages after transformer.
DSguru2B wrote:And thats where you are going wrong. You need to partition it by keys. Do this, provide Hash as partitioning and choose the three keys. Now run your job again. See what happens.
Thank you,
Anu
Anu
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: