I started this issue in a previous post but the problem is little differnt from where i started
So I am posting a new one
I used -n option in the sort, it worked
That is for a small dataset
When I ran it for bigger dataset. I am getting this error
Code: Select all
ds_ipcgetnext - timeout waiting for mutex
I am sorting the data before entering the Aggregator stage
If I dont sort again in the input of the Aggregartor stage. I think I am getting this error
And I also found that it takes a long time to get ouput from the Aggregator stage
If I sort again in the aggregator stage, then the output seems to flow little faster
Can somebody explain this to me?
Thanks
Kishan