1)I am using a dataset in multipla jobs ..its an intermidiate file
what propogation flag shoul I set ..where its an Input stage ??
2)I have set the reference dataset link partition to entire in the look up stage
is that ok ..??
confused about partitioning method
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 94
- Joined: Sun Jul 18, 2010 11:35 pm
-
- Participant
- Posts: 152
- Joined: Mon Mar 07, 2011 6:16 am
Re: confused about partitioning method
1. Your Propagation flag need to clear all the time
2.For look up stage it is absolutely fine.Because in entire the reference is being copied to all the node which is necessary
2.For look up stage it is absolutely fine.Because in entire the reference is being copied to all the node which is necessary
Soumya