Surrogate Key Generator - produced sequence num with a gap

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
cwong
Charter Member
Charter Member
Posts: 26
Joined: Tue Apr 30, 2002 8:02 am
Location: Canada

Surrogate Key Generator - produced sequence num with a gap

Post by cwong »

Kind of wonder if you had experienced the similar issue - Surrogate Key Generator produced sequence number with a gap.

Backgrouund info:
===========
(1) the state file is deleted and created every time before the job is run
(2) expect the Surrogate key number start from 1 and increment by 1
(3) Job ran with 2 node configuration

Result:
====
(1) input = 503598 rows of data processed through
(2) the highest value of Surrogate key generated = 503799
(3) from debug, found one gap = 201 in between the sequence number as below

Gen# Gap Partition#
------ ---- ------------
"498798","1","0"
"498799","1","0"
"499001","202","1"
"499002","1","1"
"499003","1","1"

The sequence number is growing okay from 1 upto 498799 between partition 0 and partition 1. Then found this one unexpected gap. After this gap, the sequence number beyond this point continued growing normally between partition 0 and partition 1 with no issue.


Any insight or advice ?

C.
cwong
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

-craig

"You can never have too many knives" -- Logan Nine Fingers
cwong
Charter Member
Charter Member
Posts: 26
Joined: Tue Apr 30, 2002 8:02 am
Location: Canada

Post by cwong »

Hi Craig,

Thanks greatly for sharing the info.

I will apply the recommended changes and update the result here later.
cwong
Post Reply