Page 1 of 2

Link Count

Posted: Tue Mar 11, 2008 7:27 am
by srimitta
Hi All,

We created XML job reports using DSJobReport in After-job routine.
when we looked at XML data, what we found is for same job name & link name it's returning multiple counts some are right count and some are not.

Is there a way I can get exact count or any other method I can get this information.

Posted: Tue Mar 11, 2008 5:59 pm
by ray.wurlod
If you can't get exact counts, how do you know that the counts you are getting are not the correct ones?!!

You can use the API or dsjob after the job has completed to get link row counts. But this uses the same mechanism that DSJobReport uses.

Posted: Wed Mar 12, 2008 8:42 am
by srimitta
Thanks Ray for the reply.

For same JOB_NAME, STAGE_NAME & LINK_NAME the ROW_COUNT is different and count on either of them are true.

LEDW_EDW_agreement DS_ES_Agreement Lnk_Agreement_file_in_cnt 5
LEDW_EDW_agreement DS_ES_Agreement Lnk_Agreement_file_in_cnt 467

True count is supposed to be like this.
LEDW_EDW_agreement DS_ES_Agreement Lnk_Agreement_file_in_cnt 871.

Any thoughts why I am not getting right row count.

SriMitta

Posted: Wed Mar 12, 2008 5:37 pm
by ray.wurlod
Not till you tell us how, when and where (in the job or afterwards) you obtained these ones.

Posted: Thu Mar 13, 2008 7:22 am
by srimitta
Using DSJobRport in After-job subroutine.

Thanks
SriMitta

Posted: Thu Mar 13, 2008 4:51 pm
by ray.wurlod
You still haven't explained where the three different sets of values come from, and how you know that 871 is correct.

For example, were the values obtained on two separate runs? Have you verified by performing a line count on the output file?

Posted: Sat Mar 15, 2008 2:13 pm
by srimitta
If look at Performance Stastics in the job & record count in the file are same, but I don't find correct row count in XML created by DSJobReport in After-job Subroutine.

Plese let me know if I am missing any details, for better help.

Thanks
SriMitta

Posted: Sat Mar 15, 2008 4:29 pm
by ray.wurlod
What happens to the counts (as a test) if you don't specify the XML option on DSJobReport?

Posted: Mon Mar 17, 2008 4:54 pm
by srimitta
I tried to run job with format option in DSJobRport as 1;/home/srmt002,
job created a job detail text file.

And also I ran job without file option, job returned below warning.
<Job Name>..AfterJob (DoJobReport): Failed to open directory


Thanks
SriMitta

Posted: Mon Mar 17, 2008 5:01 pm
by ray.wurlod
Use a directory to which the executing user has read, write and execute permission.

Posted: Mon Mar 17, 2008 5:19 pm
by srimitta
Without file format option below is the Report generated by job.

**************************************************
STATUS REPORT FOR JOB: Audit_Job
Generated: 2008-03-17 18:56:26
Job start time=2008-03-17 18:56:23
Job end time=2008-03-17 18:56:26
Job elapsed time=00:00:03
Job status=1 (Finished OK)
Stage: Copy_of_Sequential_File_6.IDENT1, 28 rows input
Stage start time=2008-03-17 18:56:24, end time=2008-03-17 18:56:24, elapsed=00:00:00
Link: ppp, 28 rows
Link: ppp, 28 rows
Stage: Transformer_3, 49 rows input
Stage start time=2008-03-17 18:56:24, end time=2008-03-17 18:56:24, elapsed=00:00:00
Link: DSLink2, 49 rows
Link: DSLink5, 37 rows

Any idea how to design a job to read this file :?

Posted: Mon Mar 17, 2008 5:21 pm
by chulett
Short answer: as one long varchar field. Long answer would depend on exactly what you needed from it.

Posted: Mon Mar 17, 2008 5:26 pm
by srimitta
I know what you mean to say.
Read as a single column with max column width.

This is what I need from job report, any idea how to get this info.

STATUS REPORT FOR JOB: Audit_Job
Job start time=2008-03-17 18:56:23
Job end time=2008-03-17 18:56:26
Job status=1 (Finished OK)
Stage: Copy_of_Sequential_File_6.IDENT1, 28 rows input
Link: ppp, 28 rows
Link: ppp, 28 rows
Stage: Transformer_3, 49 rows input
Link: DSLink2, 49 rows
Link: DSLink5, 37 rows

Thanks
SriMitta

Posted: Mon Mar 17, 2008 5:32 pm
by srimitta
Sorry earlier reply was not complete, here what I exactly what you needed from it.

JOB_NAME
JOB_START_TIME
JOB_END_TIME
STAGE_NAME
LINK_NAME
ROW_COUNT
JOB_STATUS

Thanks
SriMitta

Posted: Mon Mar 17, 2008 7:27 pm
by ray.wurlod
I don't need anything from it. You do. You use the Field() function and substring techniques to extract the various pieces. The delimiter character between lines is the system variable @FM.