How to check for last record

nehak · Post by **nehak** » Mon Jun 16, 2008 2:01 am

Hi...
I want to process last record seperately... how to know whether coming record is last or not.. i tried using @INROWNUM but not able to come to any conclusion... plz help me..

venki · Post by **venki** » Mon Jun 16, 2008 2:12 am

If you use @INROWNUM function it give max record in each of the node.
i think this function is not help full to identifying last record.Try with this:

@PARTITIONNUM+(@NUMPARTITION*@INROWNUM-(@NUMPARTITION-1))

Regards,
Venkat.

nehak · Post by **nehak** » Mon Jun 16, 2008 2:25 am

Venkat, transformer execution mode i kept as sequential... and the below expression is giving all records except last..

@PARTITIONNUM+(@NUMPARTITION*@INROWNUM-(@NUMPARTITION-1))

ArndW · Post by **ArndW** » Mon Jun 16, 2008 2:43 am

You won't know that you are processing the last row until you hit the end-of-file, when it is too late. You can pass the number of rows into the job as a parameter and compare against that number in the transform stage.

venki · Post by **venki** » Mon Jun 16, 2008 2:48 am

If you use @INROWNUM function it give max record in each of the node.
i think this function is not help full to identifying last record.Try with this:

@PARTITIONNUM+(@NUMPARTITION*@INROWNUM-(@NUMPARTITION-1))

Regards,
Venkat.

OddJob · Post by **OddJob** » Mon Jun 16, 2008 8:58 am

@INROWNUM is the inpt row counter, not the max row. As Arnd said, you're not going to know until it's too late. You'll need to pass in a per node row count (or something!!)

Minhajuddin · Post by **Minhajuddin** » Mon Jun 16, 2008 11:24 am

Why do you want to do this in a Transformer stage?

If you want to look at other options, you can use a Tail stage to get the last record in each partition or the last record in any of the partitions. Or if you want a really funky logic, you can hardcode a value in a new column (say dummy='x') and then pass it through a remove duplicates and retain the last row.