help on Ds log files

paddu · Post by **paddu** » Mon Jul 24, 2006 11:32 pm

Hi all

i searched the forum but need more help.

how do i capture source and target row counts from DS Director log files into a file or a table ???
please pass some suggestions.

Thanks

loveojha2 · Post by **loveojha2** » Mon Jul 24, 2006 11:42 pm

You would need to write your own program for parsing the log file (if you want to do it outside ds).
But doning it that way is time consuming and may not be accurate at times.

You can use the DSGetLinkInfo function which can be used from within the job or outside the job (may be a separate routine) to get the row counts on a link within the job.

paddu · Post by **paddu** » Mon Jul 24, 2006 11:54 pm

i used DSGetLinkInfo function in the job .
result of the count is 0 on the link which actually has 30 record count

loveojha2 · Post by **loveojha2** » Mon Jul 24, 2006 11:59 pm

At what place you are using it ?(very important)

You should be using it within a routine which can be called through after job subroutine. This will make sure that your job has finished and the counts on the link are the final.

paddu · Post by **paddu** » Tue Jul 25, 2006 1:00 am

i used in the transformer , trying to capture counts from source link .

Can you help me building in Routine?

Appreciate your help

Thanks

paddu · Post by **paddu** » Tue Jul 25, 2006 1:04 am

i used the function as

DSGetlinkInfo(DSJ.ME,"Source","out",DSJ.LINKROWCOUNT)

in the transformer.

thanks

DSguru2B · Post by **DSguru2B** » Tue Jul 25, 2006 2:03 am

The job needs to finish as already pointed out to you. Using the function inside the transformer will not get you the required output as the job is still in execution mode.
If you want to use it in the transformer itself then specify another link with two column with exactly the same constraint as the link you want the row count of. Put @OUTROWNUM as a derivation for one column and default the other column(dummy key) to some value say '1'. Pass it through the aggregator, group by the dummy key and specify Last as the derivation of the other column. That will get you the rowcount.

paddu · Post by **paddu** » Tue Jul 25, 2006 8:06 am

HI all,

thanks ,i got the idea DSguru2b .
My situation is all the jobs ( 50)are designed .if i use the function in the Transformer and pass that to aggregate and so on, my each job should have this logic. i need to change all the jobs.

we already are hitting on performance so can you guys help me come up with a routine(share a routine) as "loveojha2" suggested to use as After job Routine.

Any help appreciated

Thanks

ray.wurlod · Post by **ray.wurlod** » Tue Jul 25, 2006 3:28 pm

Do you have a consistent naming convention for the input link to the target stage and for the output link from the source stage? And for the stages themselves? And for the intermediate active stage (which you will need for DSGetLinkInfo)?

If not, some complexity will be introduced, and you may be better off using DSGetLogEntry to read the "active stage finishing" message to get the row counts.