I generate a sequence in the transformer, using @numpartition and @PARTITIONNUM.The problem i faced is - there are no duplicate sequence numbers, but the count value is missing.I mean the following is the job flow:
I am sending 100 records to the transformer and should not it give the same 100 as last records count? but it gives counts more than 100 ...(110,120,345 for eg.,) and it misses some values in the middle (35,56,78, for eg.,)source dataset-> transformer stage->xml file
Note - logic to create the sequence is -
I have a stage vairable, countvar whose intial value is @PARTITIONNUM - @NUMPARTITIONS + 1 and in the derivation of the vaiable, i am using this - countvar + @NUMPARTITIONS.
This variable is integer and as per my requirement i have to left pad zeros, am using an output column and used the function, str to determine the number of left padded zeros and passing it to next stage.
Pls help me finding the problem.
Thanks in advance!!