Modify Stage - what can it do?

[dohertys]

From looking at other posts regarding the modify stage I'm aware that there are some functions that you can use which don't appear in the documentation.

Can you tell me the best place to look for a full list of what it can do?

I know you can add a column with it, but can you then set that column to a particular value?

Can you perform any arithmetic - or do I need a transformer?

Thanks

[dohertys]

Thanks for that.


I've found a way I can add a field onto a row and set it to '1'

It relies on 1 of the original fields being not nullable.

I've used the following...

MyNewIndicatorField:Int8=notnull(OriginalNotNullableField)

If I just put this one line in, I get the new field set to 1 for every row, however, I lose the 'OriginalNotNullableField'
so I have to add a second line into the modify

OriginalNotNullableField=OriginalNotNullableField

So, I've managed to put a new field into my row, and set it to 1.


Is there a way to set it to some other value?
Do any of the 'conversion functions' allow you to do any arithmetic?

[dohertys]

I'd been told not to use a column generator because 'if its in the "Development/Debug" section of the palette its only to be used in Development or debugging - and not in live jobs."

What's your opinion, is there anything wrong with using "Development/Debug" stages in live jobs?

Hmmm - I think I'll put that as a new topic...


Thanks all for your help.

[ray.wurlod]

Always push back on stupid requirements, and you can tell the PHB that I said so. The categories on the Palette are totally customizable - you can readily move a stage type into another category to suit your personal whim.

Row generators and column generators particularly are used in lots of production jobs in my (wide) experience. Go for it.

[dohertys]

Thanks all.

I think that most of what I was trying to get the modify stage to do is done better in a column generator then.