Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.
Moderators: chulett , rschirm , roy
kollurianu
Premium Member
Posts: 614 Joined: Fri Feb 06, 2004 3:59 pm
Post
by kollurianu » Tue Nov 12, 2013 9:59 am
Getting following warning and couldn't fix it..
any help appreciated..
RmDp_3: When checking operator: User inserted sort "Srt_3" does not fulfill the sort requirements of the downstream operator "RmDp_3"
Used same partition method and keys in rem dup stage. In sort stage with same keys it was hash partitioned and sorted.. and set the partion in sort stage.
But still cannot avoid the warning.
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Tue Nov 12, 2013 10:37 am
The keys you are using in the Remove Duplicates stage do not match with the keys you sorted on before it.
-craig
"You can never have too many knives" -- Logan Nine Fingers
kollurianu
Premium Member
Posts: 614 Joined: Fri Feb 06, 2004 3:59 pm
Post
by kollurianu » Tue Nov 12, 2013 12:25 pm
remove dup keys are same as sort stage keys...
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Tue Nov 12, 2013 12:44 pm
If that was true, you wouldn't be seeing the warning.
-craig
"You can never have too many knives" -- Logan Nine Fingers
kollurianu
Premium Member
Posts: 614 Joined: Fri Feb 06, 2004 3:59 pm
Post
by kollurianu » Tue Nov 12, 2013 2:19 pm
even though the sort and remove dup keys are different now,After including the ENV variable APT_NO_SORT_INSERTION to yes warnings were gone..
So just trying to understand what does this do or mean?
asorrell
Posts: 1707 Joined: Fri Apr 04, 2003 2:00 pm
Location: Colleyville, Texas
Post
by asorrell » Tue Nov 12, 2013 2:46 pm
You told DataStage NOT to insert any sorts into the job. And pretty much guaranteed that it isn't going to work correctly if a sort IS required.
That's a very dangerous option to use.
kollurianu
Premium Member
Posts: 614 Joined: Fri Feb 06, 2004 3:59 pm
Post
by kollurianu » Tue Nov 12, 2013 3:48 pm
Oh ok thanks but not able understand what I am missing and how solve the issue..