Hash partition doubt

srini.dw · Post by **srini.dw** » Wed Nov 13, 2013 10:55 pm

Hi,

I have a job.

OC connector -> copy -> DataSet.

Eg. I have done the hash partition of 3 key columns in copy stage and same partition has been kept in Dataset.

How do I make sure the hash partition on those keys which I have done is correct or not ?

Jobs are running in 2 nodes.

Any help would be appreciated.

Thanks,

chulett · Post by **chulett** » Wed Nov 13, 2013 11:25 pm

Why not set the partitioning directly in the Data Set?

srini.dw · Post by **srini.dw** » Wed Nov 13, 2013 11:55 pm

Thanks for the reply.

We are not suppposed to use Auto partition.
Copy stage I should keep partition, cannot leave to Auto.
If i keep the Hash in copy stage, i should be carry forwarding the same partition forward.

Tools -> DataManagement -> Check no. of records in node 1 and node 2. Is this the method or any other method.

Thanks,

chulett · Post by **chulett** » Thu Nov 14, 2013 12:11 am

Never said anything about using Auto partitioning. Was wondering if you're concerned about which partitioning method the Data Set will use, why not set it to Hash in the Data Set stage itself?

Maybe I'm misunderstanding what your "How do I make sure the hash partition on those keys which I have done is correct or not ?" question means.