Page 1 of 1

Hash partition doubt

Posted: Wed Nov 13, 2013 10:55 pm
by srini.dw
Hi,

I have a job.

OC connector -> copy -> DataSet.

Eg. I have done the hash partition of 3 key columns in copy stage and same partition has been kept in Dataset.

How do I make sure the hash partition on those keys which I have done is correct or not ?

Jobs are running in 2 nodes.

Any help would be appreciated.

Thanks,

Posted: Wed Nov 13, 2013 11:25 pm
by chulett
Why not set the partitioning directly in the Data Set?

Posted: Wed Nov 13, 2013 11:55 pm
by srini.dw
Thanks for the reply.

We are not suppposed to use Auto partition.
Copy stage I should keep partition, cannot leave to Auto.
If i keep the Hash in copy stage, i should be carry forwarding the same partition forward.

Tools -> DataManagement -> Check no. of records in node 1 and node 2. Is this the method or any other method.

Thanks,

Posted: Thu Nov 14, 2013 12:11 am
by chulett
Never said anything about using Auto partitioning. Was wondering if you're concerned about which partitioning method the Data Set will use, why not set it to Hash in the Data Set stage itself?

Maybe I'm misunderstanding what your "How do I make sure the hash partition on those keys which I have done is correct or not ?" question means. :?