Column Generator : Column Method = Schema File

[memrinal]

Hi All,

What should be the format of the schema file if one uses Column Method=Schema File.
What should this schema file contain?

I have to generate sequence number from a given number for each record. currently i am using combination o f lookup, transformer nd row generator for this. as the sequnce number generated by the Column generator is from 0.
Will changing Column method to Schema file help my starting the numbers from a given number that i can specifyu in the fie.

TIA

[roy]

Hi,
The stage you need is PxSurrogateKeyGenerator not column generator, column generator is a dev/debug tool.

schema file is a substitute for the table definition in the stage itself.

IHTH,

[richdhan]

Hi Memrinal,

Colum Method = Schema File is used by sequential file stage/file set stage. It is basically used when you dont want to give the metadata directly in the stage but rather use the schema file for getting the metadata information.

A sample schema file looks like this

schema record
(
column1:int32;
column2:string[max=12];
)

HTH
Rich

[bcarlson]

Hi,
The stage you need is PxSurrogateKeyGenerator not column generator, column generator is a dev/debug tool.

IHTH,

Is there a reason why the Column Generator should not be used outside of development? Just wondering...

From what I've seen, the Column Generator is far more flexible than the PxSurrogateKeyGenerator (and just as fast). The Surrogate gen can only do numeric (identity) fields while you can generate pretty much anything with the Column Generator.

Yes, you can use the Column Generator to create test data, but we use it all the time to add code fields, period dates, temporary join fields, timestamps, etc.

[ray.wurlod]

Development/Debug is a Category. If you'd prefer to have the Column Generator stage in a different category, customize your Palette and move it to where you want it.
There is no reason whatsoever to eschew use of the Column Generator stage in production - bcarlson's site makes good use of this stage in establishing a column to contain an artificial key - the column is (re-)populated in a subsequent stage in the job design.

[roy]

Hi All,

What should be the format of the schema file if one uses Column Method=Schema File.
What should this schema file contain?

I have to generate sequence number from a given number for each record. currently i am using combination o f lookup, transformer nd row generator for this. as the sequnce number generated by the Column generator is from 0.
Will changing Column method to Schema file help my starting the numbers from a given number that i can specifyu in the fie.

TIA

I mentioned the PxSurrogateKeyGenerator since the original poster mentioned numeric sequence that they need some controll over the starting number.

I guess other uses for the column generator is just a matter of opinion and I do encorrage thinking outside the box so as long as it serves the purpose why not go for it (we do so many things to gain performance so if it helps, by all means )