Can the final (production) code have Row Generators?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vrishabhsagar
Participant
Posts: 33
Joined: Mon Nov 12, 2007 1:02 am
Location: Bangalore

Can the final (production) code have Row Generators?

Post by vrishabhsagar »

Hi All,

While browsing parallel extender forums , I came across many threads which advise the use of Row generators in situations where we have to count rows and propagate count as 0 (out of a transformer) even if there are zero rows in the input dataset.

This makes me wonder, if row generator can be used in the code that will be deployed in production environment? Even if the row generator is going to generate just one pseudo row :?

Shouldn't row gen be used only for development/debugging purposes?
Rishabh Sagar V
Bangalore
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Re: Can the final (production) code have Row Generators?

Post by chulett »

vrishabhsagar wrote:Shouldn't row gen be used only for development/debugging purposes?
No.
-craig

"You can never have too many knives" -- Logan Nine Fingers
vrishabhsagar
Participant
Posts: 33
Joined: Mon Nov 12, 2007 1:02 am
Location: Bangalore

Re: Can the final (production) code have Row Generators?

Post by vrishabhsagar »

chulett wrote:
vrishabhsagar wrote:Shouldn't row gen be used only for development/debugging purposes?
No.

Hmmm.... Can someone tell me why? Won't the row gen decrease the performance of the job?
Rishabh Sagar V
Bangalore
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

If it's the right technique to get the job done, does it matter? DS is a toolbox, with a large variety of tools and widgets....use the best one for the job at hand...and weigh the issues surrouding it. Of course you can and should use Row Generator in "production"..... provided you have considered all of the other criteria and non-functional issues that could impact it. Might it impact performance? Maybe...but you also might have a job that doesn't process enough rows to matter, and (not claiming this, just saying it's a metric) using Row Generator might be simpler for new members of your team to maintain and understand.....which could also be an important metric.

Absolutes can get you in trouble. Its like saying "never use Server anymore"....or "always avoid Transformers....."....Fallacies too, but things I've heard from time to time.

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Don't be thrown off but the artifical classification of the stage in the 'Development' branch of the repository. As Ernie notes, it has a purpose and while it certainly can be used for dev/debug specific purposes, if the stage solves a production problem and you are aware of any pros/cons, who cares how it is labelled?

Here's one absolute that won't get you into trouble - Ernie is The Man. Well, the XML Man at least. Absolutely. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
vrishabhsagar
Participant
Posts: 33
Joined: Mon Nov 12, 2007 1:02 am
Location: Bangalore

Thanks everyone!

Post by vrishabhsagar »

I always had my doubts about using the row generators in my production jobs .... now that my fears have been alleviated, I feel much more free and ready to design jobs in a much better fashion!!

Thanks again.... :D
Rishabh Sagar V
Bangalore
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The Palette is fully customizable. Categories are totally artificial.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply