Partition Type = Auto

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
karthi_gana
Premium Member
Premium Member
Posts: 729
Joined: Tue Apr 28, 2009 10:49 pm

Partition Type = Auto

Post by karthi_gana »

All,

I have designed a simple job as below

Code: Select all


Seq_File --> Copy Stage --> Seq_File1
                                    --> Seq_File2
                                    --> Seq_File3
I left the partition type = auto (default value) as it is. I have read somewhere if we choose/left "Auto", the datastage engine will apply either "Same" or "Round Robin". How to know which one will be applied by datastage?
Karthik
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Search!
This question has been answered in detail before.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
karthi_gana
Premium Member
Premium Member
Posts: 729
Joined: Tue Apr 28, 2009 10:49 pm

Post by karthi_gana »

I did :(

But I don't find any useful information. May be, i am not using the correct keyword to search it.
Karthik
karthi_gana
Premium Member
Premium Member
Posts: 729
Joined: Tue Apr 28, 2009 10:49 pm

Post by karthi_gana »

can you refer some post's to know about it? I was tired to search about this topic. I don't find anything related to my requirement.
Karthik
Kryt0n
Participant
Posts: 584
Joined: Wed Jun 22, 2005 7:28 pm

Post by Kryt0n »

For the purpose of your job, what difference does it make which it applies?

For a sequential file, there is no partitioning which is likely to rule out "same"
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Code: Select all

(Auto) ::=  Round Robin if sequential -> parallel
            Entire on reference input to Lookup stage
            DB2 on input link to DB2 stage of any kind (parallel execution)
            Same if parallel -> parallel
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
karthi_gana
Premium Member
Premium Member
Posts: 729
Joined: Tue Apr 28, 2009 10:49 pm

Post by karthi_gana »

Thanks a lot Ray.

can you please tell me where i can find more information on this topic?

sequential --> Parallel

do you mean sequential to any parallel stages?

say for example sequential --> filter or copy ?
Karthik
kwwilliams
Participant
Posts: 437
Joined: Fri Oct 21, 2005 10:00 pm

Post by kwwilliams »

Why don't you choose the one you want instead of using auto? If you're curious as to what it does when you use auto look at the dump score. It will tell you the partition method.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Sequential ---> ANY Parallel (except as noted - ref input to Lookup, input to DB2)

More information in the Advanced DataStage class from IBM. Not sure where it exists in the documenatation suite, but it has to be in there somewhere. Have you looked in the Information Center?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Nearly every section in the Parallel Job Developer's Guide repeats the descriptions of all the partitioning and collecting options. If IBM would pull all that into one section, it may cut the full doc size in half. Read the product manuals, and you can't miss it.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply