Pivot stage poor performance

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
seanc217
Premium Member
Premium Member
Posts: 188
Joined: Thu Sep 15, 2005 9:22 am

Pivot stage poor performance

Post by seanc217 »

I have a sequential file stage which goes to a transformer. One link out of the transformer goes to an Oracle stage and another goes to a pivot stage where I pivot 60 columns 9 times. I am getting very poor performance on this. If I remove the pivot stage and run the job it runs much faster. Anyway if anyone has suggestions let me know. If you need more info, I will get it.

Thanks for any ideas.

Sean
Ultramundane
Participant
Posts: 407
Joined: Mon Jun 27, 2005 8:54 am
Location: Walker, Michigan
Contact:

Re: Pivot stage poor performance

Post by Ultramundane »

I have never been able to get good performance from the pivot stage. I use awk. I was told by IBM that the pivot stage would be faster in V8.0.
seanc217
Premium Member
Premium Member
Posts: 188
Joined: Thu Sep 15, 2005 9:22 am

Post by seanc217 »

Well...
I am running Hawk Beta 2A and this is not the case. Hopefully they fix this by GA?

I guess I will land each occurence to a dataset and load them that way.

Thanks,

Sean
Post Reply