Sort order lost in transformer when migrated to 11.5

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
irshanuddin
Participant
Posts: 44
Joined: Wed May 27, 2009 3:01 pm

Sort order lost in transformer when migrated to 11.5

Post by irshanuddin »

We have a job that we migrated from 8.5 to 11.5 which was giving incorrect results. We narrowed this down to a transformer messing up the sort order after reading from a sort stage.
We have tried changing the partition to "Same" but didnt work.
The only way the transformer appears to maintain the sort order is if it is run in Sequential mode.
I have also tried sorting again in the transformer using the same keys as the sort stage but that failed as well.

Any suggestions?
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

If you set the partitioning to "same" and are not modifying the key column in the transformer, then the order won't be changed.
Turn on $APT_DUMP_SCORE and see what operators are actually being called; and perhaps you might try disabling combination of operators ($APT_DISABLE_COMBINATION) to see if that might be having an affect on your problem.
rkashyap
Premium Member
Premium Member
Posts: 532
Joined: Fri Dec 02, 2011 12:02 pm
Location: Richmond VA

Post by rkashyap »

Do contact IBM support for this issue.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Each time I have seen "strange things" going on related to the Transformer stage, it has been caused by using the wrong compiler version. A major, minor, or fix pack difference in the compiler version can definitely cause unusual, incorrect behaviors. Double check system requirements' exact version listed against the version you have installed.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply