Type of partitioning

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
developeretl
Participant
Posts: 89
Joined: Sat Jul 24, 2010 11:33 pm

Type of partitioning

Post by developeretl »

Hi Can any1 explain me what type of partitioning should be used on the stages. Iam new to this and i dnt know which partitioning like same or hash or entire or auto ??
Sreenivasulu
Premium Member
Premium Member
Posts: 892
Joined: Thu Oct 16, 2003 5:18 am

Post by Sreenivasulu »

same - partitioning as the previous stage
hash - partitioned based on a hash key generated
auto - partition done by datastage based derived based on its own

Regards
Sreeni
DSShishya
Premium Member
Premium Member
Posts: 37
Joined: Tue Oct 27, 2009 9:43 pm

Post by DSShishya »

Like Srinivasalu pointed Hash partitioning is key based partitioning.

Now in order for you to give better explanation (I suppose this is an interview question)

Hash partitioning is used in stages like Aggregator, Remove Duplicate or any of the stages where similar records needs to be in the same partition.

Its mainly this Hash partitioning which plays an important role. Also, although it says that "Entire" partitioning should be used in lookups it is better to use Hash partitioning in lookup because it serves the purpose and more importantly Entire partitioning can be a major performance issue if the data in the reference table is too large.

And of-course the default partitioning method is Auto.

Hope this helped but if you just understand the concept of each partitioning method then it becomes a lot easier for you to explain.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

You cannot leave out the Roundrobin partition, as its the best mate for key less operations.
If we point you to check the manuals, anyway you will reply saing, you wanted to know about the experience of the forum users in the usage of partitions, as you did in the other post.
So better, let me not say that. :wink:
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
Post Reply