Link Count

srimitta · Post by **srimitta** » Tue Mar 11, 2008 7:27 am

Hi All,

We created XML job reports using DSJobReport in After-job routine.
when we looked at XML data, what we found is for same job name & link name it's returning multiple counts some are right count and some are not.

Is there a way I can get exact count or any other method I can get this information.

ray.wurlod · Post by **ray.wurlod** » Tue Mar 11, 2008 5:59 pm

If you can't get exact counts, how do you know that the counts you are getting are not the correct ones?!!

You can use the API or dsjob after the job has completed to get link row counts. But this uses the same mechanism that DSJobReport uses.

srimitta · Post by **srimitta** » Wed Mar 12, 2008 8:42 am

Thanks Ray for the reply.

For same JOB_NAME, STAGE_NAME & LINK_NAME the ROW_COUNT is different and count on either of them are true.

LEDW_EDW_agreement DS_ES_Agreement Lnk_Agreement_file_in_cnt 5
LEDW_EDW_agreement DS_ES_Agreement Lnk_Agreement_file_in_cnt 467

True count is supposed to be like this.
LEDW_EDW_agreement DS_ES_Agreement Lnk_Agreement_file_in_cnt 871.

Any thoughts why I am not getting right row count.

SriMitta

ray.wurlod · Post by **ray.wurlod** » Wed Mar 12, 2008 5:37 pm

Not till you tell us how, when and where (in the job or afterwards) you obtained these ones.

srimitta · Post by **srimitta** » Thu Mar 13, 2008 7:22 am

Using DSJobRport in After-job subroutine.

Thanks
SriMitta

ray.wurlod · Post by **ray.wurlod** » Thu Mar 13, 2008 4:51 pm

You still haven't explained where the three different sets of values come from, and how you know that 871 is correct.

For example, were the values obtained on two separate runs? Have you verified by performing a line count on the output file?

srimitta · Post by **srimitta** » Sat Mar 15, 2008 2:13 pm

If look at Performance Stastics in the job & record count in the file are same, but I don't find correct row count in XML created by DSJobReport in After-job Subroutine.

Plese let me know if I am missing any details, for better help.

Thanks
SriMitta

ray.wurlod · Post by **ray.wurlod** » Sat Mar 15, 2008 4:29 pm

What happens to the counts (as a test) if you don't specify the XML option on DSJobReport?

srimitta · Post by **srimitta** » Mon Mar 17, 2008 4:54 pm

I tried to run job with format option in DSJobRport as 1;/home/srmt002,
job created a job detail text file.

And also I ran job without file option, job returned below warning.
<Job Name>..AfterJob (DoJobReport): Failed to open directory

Thanks
SriMitta

ray.wurlod · Post by **ray.wurlod** » Mon Mar 17, 2008 5:01 pm

Use a directory to which the executing user has read, write and execute permission.

srimitta · Post by **srimitta** » Mon Mar 17, 2008 5:19 pm

Without file format option below is the Report generated by job.

**************************************************
STATUS REPORT FOR JOB: Audit_Job
Generated: 2008-03-17 18:56:26
Job start time=2008-03-17 18:56:23
Job end time=2008-03-17 18:56:26
Job elapsed time=00:00:03
Job status=1 (Finished OK)
Stage: Copy_of_Sequential_File_6.IDENT1, 28 rows input
Stage start time=2008-03-17 18:56:24, end time=2008-03-17 18:56:24, elapsed=00:00:00
Link: ppp, 28 rows
Link: ppp, 28 rows
Stage: Transformer_3, 49 rows input
Stage start time=2008-03-17 18:56:24, end time=2008-03-17 18:56:24, elapsed=00:00:00
Link: DSLink2, 49 rows
Link: DSLink5, 37 rows

Any idea how to design a job to read this file

chulett · Post by **chulett** » Mon Mar 17, 2008 5:21 pm

Short answer: as one long varchar field. Long answer would depend on exactly what you needed from it.

srimitta · Post by **srimitta** » Mon Mar 17, 2008 5:26 pm

I know what you mean to say.
Read as a single column with max column width.

This is what I need from job report, any idea how to get this info.

STATUS REPORT FOR JOB: Audit_Job
Job start time=2008-03-17 18:56:23
Job end time=2008-03-17 18:56:26
Job status=1 (Finished OK)
Stage: Copy_of_Sequential_File_6.IDENT1, 28 rows input
Link: ppp, 28 rows
Link: ppp, 28 rows
Stage: Transformer_3, 49 rows input
Link: DSLink2, 49 rows
Link: DSLink5, 37 rows

Thanks
SriMitta

srimitta · Post by **srimitta** » Mon Mar 17, 2008 5:32 pm

Sorry earlier reply was not complete, here what I exactly what you needed from it.

JOB_NAME
JOB_START_TIME
JOB_END_TIME
STAGE_NAME
LINK_NAME
ROW_COUNT
JOB_STATUS

Thanks
SriMitta

ray.wurlod · Post by **ray.wurlod** » Mon Mar 17, 2008 7:27 pm

I don't need anything from it. You do. You use the Field() function and substring techniques to extract the various pieces. The delimiter character between lines is the system variable @FM.