My job consists of 2 join stages to join 3 Datasets. When i run this job it aborts immediately with the following error message.
"main_program: Fatal Error: There are irreconcilable constraints on the number of
partitions of an operator: parallel APT_JoinSubOperator in JnsTgtCol_1.
The number of partitions is already constrained to 1,but an eSame partitioned input virtual dataset produced by
parallel inserted tsort operator {key={value=GUEST_I}} has 4."
Can anybody please explain what is the error and how can i resolve it.
Regards
Pinkesh
irreconcilable constraints
Moderators: chulett, rschirm, roy
Re: irreconcilable constraints
Pinkesh,pkothana wrote:My job consists of 2 join stages to join 3 Datasets. When i run this job it aborts immediately with the following error message.
"main_program: Fatal Error: There are irreconcilable constraints on the number of
partitions of an operator: parallel APT_JoinSubOperator in JnsTgtCol_1.
The number of partitions is already constrained to 1,but an eSame partitioned input virtual dataset produced by
parallel inserted tsort operator {key={value=GUEST_I}} has 4."
Can anybody please explain what is the error and how can i resolve it.
Regards
Pinkesh
Can you send me the osh script?
Vitali.
Hi,
I got some info on the problem I'm facing.
I have two jobs that are creating Data Sets as the output. After that one job merges these two data sets to create the final sequential file output.
When I run the jobs with One Node configuration, everything works fine. But when I run the jobs with 4 node configuration, the Merge Job Aborts with Irreconcilable Constraints Error.
If in place of Data Sets output, i use Sequential File outputs, the jobs are working fine in both 1 node and 4 node configuration.
Can anybody help me in this regard.
Appreciate Your Prompt Response.
Thanks & Regards
Pinkesh
I got some info on the problem I'm facing.
I have two jobs that are creating Data Sets as the output. After that one job merges these two data sets to create the final sequential file output.
When I run the jobs with One Node configuration, everything works fine. But when I run the jobs with 4 node configuration, the Merge Job Aborts with Irreconcilable Constraints Error.
If in place of Data Sets output, i use Sequential File outputs, the jobs are working fine in both 1 node and 4 node configuration.
Can anybody help me in this regard.
Appreciate Your Prompt Response.
Thanks & Regards
Pinkesh
Pinkesh,pkothana wrote:Hi,
I got some info on the problem I'm facing.
I have two jobs that are creating Data Sets as the output. After that one job merges these two data sets to create the final sequential file output.
When I run the jobs with One Node configuration, everything works fine. But when I run the jobs with 4 node configuration, the Merge Job Aborts with Irreconcilable Constraints Error.
If in place of Data Sets output, i use Sequential File outputs, the jobs are working fine in both 1 node and 4 node configuration.
Can anybody help me in this regard.
Appreciate Your Prompt Response.
Thanks & Regards
Pinkesh
Try to set the Preserve partitioning flag to Clear for your data sets. You'll find it on the Stage properties Advanced tab.
Vitali.
irreconcilable constraints
Thanks a ton Vitali.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 1
- Joined: Wed May 13, 2009 3:35 pm
- Location: roanoke