Limitation of the Pivot Stage?

chulett · Post by **chulett** » Sat Jul 03, 2004 4:22 pm

I'm curious if anyone is aware of any limitations in the use of the Pivot stage? One of my developers who makes heavy use of it is having problems trying to pivot one row into more than 64 rows.

Now, don't ask me the whys or the wherefors. I'm not really sure why he needs to do what he is trying to do, but he tells me 64 works fine. Adding in the 65th field to the output derivation craters the job. And no, I don't know the exact error message. Yet. And it's probably not a coincidence that the limit seemingly is a power of two.

I'll take a closer look at the job and see about alternate approaches on Tuesday, but right now I'm just curious if anyone else has seen or heard of an issue like this.

ray.wurlod · Post by **ray.wurlod** » Sat Jul 03, 2004 4:53 pm

I think we'll need someone with access to the Pivot stage's source code to be able to answer this one. There's no documented limit, but there's always a limit!

rasi · Post by **rasi** » Sun Jul 04, 2004 7:30 pm

The limit is definitely not 64 rows. One of my job had splitted 130 rows as output. So I can say that the limit is not 64 but for higher number > 130 it may apply.

Thanks
Rasi