Finding the last record in a transformer

[venkates.dw]

Is there any way to find the last record in a transformer?

[laxman.ds]

Get last record as max valued @INROWNUM (System Variable). But you need to take care about partitions per enabled for that job.

[ray.wurlod]

You can use the LastRecord() function. (I think that's what it's called.)

To use this you need to be running version 8.5.

[Immaculin]

criteria:

data in the file: (has only 2 rows)

ABCDEFGHI
123456789

In the output I want it as :

00000ABCDEFGHI00000123456789


stage variables:

alphabet:@INROWNUM = 1
number:@INROWNUM = 2


The constraint in the transformer to print the second row is not working (@INROWNUM = 2).

Where will we find the partitions per enabled for a job?

[ray.wurlod]

Where will we find the partitions per enabled for a job?

Everywhere.
Parallel execution is enabled by default in the parallel Transformer stage.

Open up the stage properties. On the Advanced tab you will be able to change the execution mode to Sequential.

Do consider using a server job for this task. It will be finished while the parallel job is still thinking about starting.

[Immaculin]

I will not be able to view the premium content.

[ray.wurlod]

I will not be able to view the premium content.

You can if you get yourself a premium membership. By doing so you will be helping to keep this site alive; premium membership is the main way that hosting and bandwidth costs are met.

[chulett]

data in the file: (has only 2 rows)

Server job.

[babbu9]

For flat files:
First you need to know the rowcount for your file:
In the job properties use before job subroutine command execsh and type
"cat filename | wc -l > rowcount.txt"

Have a lookup in your job that looksup the file rowcount.txt and gets the rownum value. Generate rownum using @INROWNUM for the source records. Use the rownum as the key for both the source and lookup data. Set lookup condition to continue on condition not met and lookup failure. Add a transformer after the lookup and add condition where src.rownum=lkp.rownum and divert this record. This is your last record in the source.

For database sources your lookup needs to have "select count(1) from src_table" to find the table rowcount and repeat the same logic.