Order of Columns in Vertical Pivot

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
jerome_rajan
Premium Member
Premium Member
Posts: 376
Joined: Sat Jan 07, 2012 12:25 pm
Location: Piscataway

Order of Columns in Vertical Pivot

Post by jerome_rajan »

We have a file that comes on a monthly basis and looks something like

Code: Select all

col1,data1
col2,data2
col3,data3,
col4,data4
col5,data5
.
.
col52,data6
The idea here is to just pick up the 2nd column(data1,data2...) and pivot it to produce and output in the exact same order

Code: Select all

data1,data2,data3...data52
How do I ensure that the order doesn't get messed up in the Pivot stage
We are using the vertical pivot in a 8.5 parallel job.
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn

Life is really simple, but we insist on making it complicated.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Simply don't do anything that would mess up the order. Computers are dumb - they do exactly what you tell them to do. You'd be well advised to run the PXPivot stage in sequential mode for this one.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
jerome_rajan
Premium Member
Premium Member
Posts: 376
Joined: Sat Jan 07, 2012 12:25 pm
Location: Piscataway

Post by jerome_rajan »

Precisely the point. I am not doing anything to mess up the order but there is some auto partitioning happening. I changed it to Same right from the output link of the sequential file to the very end and I keep getting an error saying 'Irreconcilable constraints' or something of that sort.
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn

Life is really simple, but we insist on making it complicated.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Which part of "Sequential" was unclear?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
adityavinay
Participant
Posts: 32
Joined: Tue Dec 13, 2011 7:27 am

Post by adityavinay »

Dont do any partitioning. Let it be Auto. Just follow as Ray Suggested. Run your Pivot stage in sequential. It should give the results as expected.
Post Reply