what does mean the following error in lookup stage:
"...When checking operator: Input Dataset 1 has partitioning other than Entire specified; disabling memory sharing"
Thanks in advance!
warning : lookup stage
Moderators: chulett, rschirm, roy
It means that they are partitioning your data other than the default preference (Entire).
If they use Entire partitioning, they would share the memory between all the nodes, instead of making copies of the same thing for each node (and eating up more memory).
However, you are setting it as something else, so... no memory sharing.
If they use Entire partitioning, they would share the memory between all the nodes, instead of making copies of the same thing for each node (and eating up more memory).
However, you are setting it as something else, so... no memory sharing.