FUNCTION: @INROWNUM

prasad_chennai · Post by **prasad_chennai** » Fri Sep 21, 2007 10:39 am

Hi,

I am using a system variable @INROWNUM as one of the Stage variable.Below mentioned is my Condition.

IF @INROWNUM >= parhigherlimit then 1 else 0

Where 'parhigherlimit' is the parameter being passed.
problem i am facing here is:
say if my parameter parhigherlimit=3,then my condition will looks to be

IF @INROWNUM >= 3 then 1 else 0

But above condition is not holding good,its returning output as '1' only when parhigherlimit is equal to or greater than 5.
if its parhigher=3 or 4 then it will return '0'.
so what would be the issue here.

appreciate your responses,

Regards,
K.RaghavendraPrasad

throbinson · Post by **throbinson** » Fri Sep 21, 2007 11:00 am

Are you running the job with a single node configuration file?

prasad_chennai · Post by **prasad_chennai** » Fri Sep 21, 2007 11:07 am

throbinson,

Nope.I running jobs on 3 Nodes configuration file.Do you think it will matter for system variables.

Minhajuddin · Post by **Minhajuddin** » Fri Sep 21, 2007 11:39 am

prasad_chennai wrote:throbinson,

Nope.I running jobs on 3 Nodes configuration file.Do you think it will matter for system variables.

There is your problem.....

When you are running it will create three INDEPENDENT instances of your transformer.

prasad_chennai · Post by **prasad_chennai** » Fri Sep 21, 2007 11:29 pm

Yes, Experts ..

You all got me right. Can anybody tell how to get worked out system variables for all the nodes.(i am using 2 sytem variables @Inrownum & @false in job design).For these variables to work,shall in need to make transformer as a sequential processing or i need to set any environment variable, plz let me know.

Thanks.
prasad

prasad_chennai · Post by **prasad_chennai** » Wed Sep 26, 2007 3:45 am

Yes, Experts ..

You all got me right. Can anybody tell how to get worked out system variables for all the nodes.(i am using 2 sytem variables @Inrownum & @false in job design).For these variables to work,shall in need to make transformer as a sequential processing or i need to set any environment variable, plz let me know.

is it possible to integrate records from all the nodes and get the incoming rowcount without making the processing as sequential.

Thanks.
prasad

prasad_chennai · Post by **prasad_chennai** » Wed Sep 26, 2007 3:46 am

Yes, Experts ..

You all got me right. Can anybody tell how to get worked out system variables for all the nodes.(i am using 2 sytem variables @Inrownum & @false in job design).For these variables to work,shall in need to make transformer as a sequential processing or i need to set any environment variable, plz let me know.

is it possible to integrate records from all the nodes and get the incoming rowcount without making the processing as sequential.

Thanks.
prasad

throbinson · Post by **throbinson** » Wed Sep 26, 2007 5:17 am

Do a search on @ num partitions or @ partition num

Mushed together. All one word. Others have responded better then I.
I don't want this to come up in this or future searches.
Also I would question your underlying design to ensure that you minimize ,or account for, skew across partitions. In other words, what if two partitions get three rows and the other only two for a total of 5 rows output? Will your row counting algorithm still be valid?

prasad_chennai · Post by **prasad_chennai** » Wed Sep 26, 2007 8:16 am

throbinson wrote:Do a search on @ num partitions or @ partition num

what if two partitions get three rows and the other only two for a total of 5 rows output? Will your row counting algorithm still be valid?

throbinson,
yes,what you have mentioned is right I think.I am not able to find how many rows moved to which node or like that.But if i have More than or equal to 5 rows,its perfect & getting exact output as required.No issue with more than or equal to 5 rows. (I mean my algorithm will stand Valid for 5 rows).

Thanks,
Prasad.

prasad_chennai · Post by **prasad_chennai** » Wed Sep 26, 2007 8:18 am

throbinson wrote:Do a search on @ num partitions or @ partition num

what if two partitions get three rows and the other only two for a total of 5 rows output? Will your row counting algorithm still be valid?

throbinson,
yes,what you have mentioned is right I think.I am not able to find how many rows moved to which node or like that.But if i have More than or equal to 5 rows,its perfect & getting exact output as required.No issue with more than or equal to 5 rows. (I mean my algorithm will stand Valid for 5 rows).

Thanks,
Prasad.

ray.wurlod · Post by **ray.wurlod** » Wed Sep 26, 2007 4:21 pm

A Monitor on the job will show individual node row counts if Show Instances is selected.

prasad_chennai · Post by **prasad_chennai** » Thu Sep 27, 2007 6:42 am

So how shall I get the integrated collection of the INRownum from all other nodes. (I think my @Inrownum is working for the single node now as i am not getting expected result.)

Thanks,
prasad

prasad_chennai · Post by **prasad_chennai** » Thu Sep 27, 2007 6:44 am

So how shall I get the integrated collection of the INRownum from all other nodes. (I think my @Inrownum is working for the single node now as i am not getting expected result.)

Thanks,
prasad

Minhajuddin · Post by **Minhajuddin** » Thu Sep 27, 2007 7:01 am

There is a post by vincent in the FAQ.....

This will help you put together your logic for multiple nodes...
viewtopic.php?t=95243

prasad_chennai · Post by **prasad_chennai** » Thu Sep 27, 2007 8:39 am

Minhajuddin,
Thanks you,

Until i generate the Rownums will it be not possible to get the rowcount In Parallel edition.I dont want to generate any surrogate keys or something.As in Server jobs, we get total number of rowcount Incoming to the transformer stage if we use the system variable as @INROWNUM.
So why cant i use this one in Parallel edition,i know its depends on Number of nodes so how can aggregate all those rows into single node and get th INROWNUM value without making the transfomer stage sequential.When the rows move out of the transformer they should flow as they were before in all nodes.

looking Forward to your responses,
Prasad.