Row Count.

sambit · Post by **sambit** » Mon Nov 30, 2009 12:17 pm

Is there a way I can take the count of the links from my previous run of a job? The job was run again yesterday after 1 month and the -linkinfo is giving me the count of the recent most run. Also there is no information on the row count from the logs.

chulett · Post by **chulett** » Mon Nov 30, 2009 12:22 pm

The only place you'll find metrics from a previous run is in the job's log. What makes you sat there's "no information on the row count" there?

sambit · Post by **sambit** » Mon Nov 30, 2009 12:23 pm

In the job log I can see all the details except for the no. of rows processed.

Sreenivasulu · Post by **Sreenivasulu** » Mon Nov 30, 2009 12:31 pm

In fact its the other way round. Joblog gives more accurate info than linkinfo. This information is based on my experience

Regards
Sreeni

sambit · Post by **sambit** » Mon Nov 30, 2009 12:33 pm

May be. But the problem here is how to get the row count. The log has the orchestrate, configuration details and also the peek values but doesn't have any information on the row count.

This is job is not writing to any file/DS/tables. It just has peek stages as the final output. Is this the reason why there is no details of row count in the log?

chulett · Post by **chulett** » Mon Nov 30, 2009 1:38 pm

ray.wurlod · Post by **ray.wurlod** » Mon Nov 30, 2009 4:02 pm

Is there a message in the log that the peek operator consumed nnn rows?
(The key word here is "consumed".)

chulett · Post by **chulett** » Mon Nov 30, 2009 4:45 pm

I didn't see any such when I checked my logs, just the actual dumped 'records' from the Peek stage. Is this functionality, optional or otherwise, that was added in 8.x?

sambit · Post by **sambit** » Mon Nov 30, 2009 5:02 pm

I am guessing it is something introduced in 8x. What do you think, Ray?

ray.wurlod · Post by **ray.wurlod** » Mon Nov 30, 2009 5:58 pm

Depends. What do you mean by "it"?