DSXchange

Hi,
In DS Transformer stage , I use one stage variable STGVAR1 of IINTEGER with starting value 0.And then I use the expression that STGVAR1+1.The values in the output not coming correctly,output I pasted below.Can you help me the reason why it is not incrementing properly?
1
1
2
3
4
5
6
7
8
9
10
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
12
13
14
.
.
.

How many nodes is your job running on? More than one, it seems.

If there are more than one node then
Go to transformer Properties , then Advanced
And then change execution mode to sequential
:D

Nagalakshmi.Krishna wrote:Can you help me the reason why it is not incrementing properly?

No, because both instances of your Transformer stage ARE incrementing correctly. You have two lots of 1 through 20. If you need to preserve the order thereof, add a sort of some kind downstream of the Transformer stage, and use a Sort Merge collection algorithm.

beacause of the partition, the are two partitions in ur job, u should change the stage property, use sequencial.defualt by parallel.

Or understand why it is happening and deal with or adapt it as Ray notes, rather than force your parallel job to run sequential.

Typically you would use an algorithm such as the following in a transform stage to ensure that you get a single unique number across any number of partitions in your job:

Here Transformer runs in Parallel Mode. So, records are distributed accordingly to the nodes. To generate Sequence number use the below derivation.

(((@INROWNUM -1) * @NUMPARTITIONS) + @PARTITIONNUM + 1)

Hi,

The Logic is not working correctly.
Its giving the Odd numbers in the Sequence.

Thanks
Naveen

It IS correct. The even numbers are on the other node.

Please confirm whether the sequence number is not generating properly or Sorting order problem.

I checked this logic with "Round Robin Partition" and 4 node configuration file. The logic is working properly and explanation is as follows.

(((@INROWNUM -1) * @NUMPARTITIONS) + @PARTITIONNUM + 1)

Partition 1:

((1 -1) * 4) + 0 +1 = 1

((2 -1) * 4) + 0 +1 = 5

((3 -1) * 4) + 0 +1 = 9

((4 -1) * 4) + 0 +1 = 13

Partition 2:

((1 -1) * 4) + 1 +1 = 2

((2 -1) * 4) + 1 +1 = 6

((3 -1) * 4) + 1 +1 = 10

((4 -1) * 4) + 1 +1 = 14

Partition 3:

((1 -1) * 4) + 2 +1 = 3

((2 -1) * 4) + 2 +1 = 7

((3 -1) * 4) + 2 +1 = 11

Partition 4:

((1 -1) * 4) + 3 +1 = 4

((2 -1) * 4) + 3 +1 = 8

((3 -1) * 4) + 3 +1 = 12

If you face Sorting order problem while collecting the records apply Sort Merge collection method on sequence number.

The first partition number is 0, not 1.

I mentioned first Partition number is 0 (Zero) right. Correct me If i coufused you.