Record Count in Transformer

[sg33]

Hi ,
I have the job like ....
seq. file.....>transformer......>dataset

I want to count the number of records coming from the source .How can I do that in the transformer stage .

P.S :I don't want to use DSgetlinkinfo() and Aggregator stage or any script

[chulett]

Count them... for what purpose? To what end?

[ray.wurlod]

System variable @INROWNUM contains this count. Note that it is per-node.
You can not get the final count until the final row has been processed (on the current node).

[PhilHibbs]

P.S :I don't want to use DSgetlinkinfo() and Aggregator stage or any script

Then you are pretty much out of luck. Aggregator is the way to do this. Does each row need to know the row count, for instance for computing averages, or a sequence string like "1 of 1000", "2 of 1000" etc., or do you just want one row output with the count? Why do you not want to use an Aggregator?

There's no way for the Transformer to know that the current row is the last one. You could write a routine to write the @INROWNUM to a file in overwrite mode and then pick up the value afterwards, then read the file. The Transformer would have to run in Sequential mode, not Parallel.

[chulett]

There's no way for the Transformer to know that the current row is the last one.

Actually, that was added in the 8.5 release, from what I recall.

As you noted, we'd still like to know the "why" of all this, then perhaps we can give a cogent answer.

[qt_ky]

It's the LastRow() function in 8.5.

[PhilHibbs]

It's the LastRow() function in 8.5.

Nice to know. Thanks.

[v2kmadhav]

Would doing a count and passing it as a param to this job be something that interests you ?

[PhilHibbs]

Would doing a count and passing it as a param to this job be something that interests you ?

That would involve scripting, or at least shell, we do that with

Code: Select all

wc -l

but the OP is on windows.

[v2kmadhav]

Sorry my bad.. Didnt see the OS.

not sure about the reqmt but.. Since you using the sequential file... you could add the "rowNumberColumn" option and see if that helps you..

[chulett]

The included MKS Toolkit would allow the use of UNIX commands.

I'd still recommend waiting for the OP to come back and clarify their needs before people keep playing this endless guessing game.