Parallel Tranformer & Surrogate key stages
Posted: Sun Dec 09, 2007 7:31 am
Hi All,
When Transformer Stage or Surrogate Key Generator Stage is used to generate sequence numbers, first time you run it will generate sequnce numbers and stores the last value (in internal format) in a file if source type is Flat File and when you run DataStage job second time, third time and soforth the Transformer Stage and Surrogate Key Generator Stage reads stored value from file and keep-on increment sequnce numbers and writes back last value to file, this iteration follows whenever you run your job.
1). What happens if you let Transformer Stage or Surrogate Key Generator Stage to generate values and job aborts after processing some records, does DataStage stores last value generated from the current abort or does it rolls-back to last values which was stored from last sucessful run.
2). Can we let Transformer Stage or Surrogate Key Generator Stage generate sequnce number and from second run on-wards, is this right approach or letting Transformer Stage or Surrogate Key Generator Stage to generate numbers and don't refresh file by any other means, If this is not right approach, what would be the right approach to pass max vlue from warehouse table other than reading value in the file from sequncer job and passing it as a parameter as initial vaue to Transformer Stage or Surrogate Key Generator Stage.
Thanks
srimitta
When Transformer Stage or Surrogate Key Generator Stage is used to generate sequence numbers, first time you run it will generate sequnce numbers and stores the last value (in internal format) in a file if source type is Flat File and when you run DataStage job second time, third time and soforth the Transformer Stage and Surrogate Key Generator Stage reads stored value from file and keep-on increment sequnce numbers and writes back last value to file, this iteration follows whenever you run your job.
1). What happens if you let Transformer Stage or Surrogate Key Generator Stage to generate values and job aborts after processing some records, does DataStage stores last value generated from the current abort or does it rolls-back to last values which was stored from last sucessful run.
2). Can we let Transformer Stage or Surrogate Key Generator Stage generate sequnce number and from second run on-wards, is this right approach or letting Transformer Stage or Surrogate Key Generator Stage to generate numbers and don't refresh file by any other means, If this is not right approach, what would be the right approach to pass max vlue from warehouse table other than reading value in the file from sequncer job and passing it as a parameter as initial vaue to Transformer Stage or Surrogate Key Generator Stage.
Thanks
srimitta