How to capture no of rows processed on link in parallel job

VineelPrem · Post by **VineelPrem** » Mon Feb 25, 2013 12:53 pm

Hello all,
I had trouble calculating no of rows processed on a link in a parallel job . i searched the forum and could not find any solution.I see that that there is a DSGetLinkInfo() function in server job . Is there any function for parallel jobs ??
Thanks in advance for your response

Regards
Prem

prasson_ibm · Post by **prasson_ibm** » Mon Feb 25, 2013 1:43 pm

Hi,
You can write a server routine and you can call that routine in parallel jobs in two ways:-

1. Call routine in job sequence and pass rowcount as a job parameter.
2.In parallel job you can call basic transformer stage and call the routine.

Its very simple routine,just you need to pass stage name and link name to that function.let me know in case you need routine handy.

VineelPrem · Post by **VineelPrem** » Mon Feb 25, 2013 1:53 pm

Thanks for the quick response Prasson . Did u mean routine or just a custom transform ? It would be great if you can help me out with that routine,
Thanks

chulett · Post by **chulett** » Mon Feb 25, 2013 2:04 pm

Clarify something for us - you need to get a link row count and then do what with it? Knowing that would help get you appropriate advice.

prasson_ibm · Post by **prasson_ibm** » Mon Feb 25, 2013 2:07 pm

Hi,
You need to write a server routine,I am replying from mobile so I can't write whole routine but function will look like thts:-

RowInputCount - DSGetLinkInfo(DSJ.ME,"stage name","link name",DSJ.LINKROWCOUNT)
ANS - RowInputCount

You can search any basic routine and frame it in that.

VineelPrem · Post by **VineelPrem** » Mon Feb 25, 2013 2:52 pm

Hi Chulett,
I have to insert the no of rows each DS job Inserts/update/Deletes to the target tables to another table which keeps track of all the DS job info
Thanks

VineelPrem · Post by **VineelPrem** » Mon Feb 25, 2013 2:53 pm

Thanks a lot Prasson . thats helps me

chulett · Post by **chulett** » Mon Feb 25, 2013 5:04 pm

Be aware that coding it with DSJ.ME as the job handle means it can only check the links in the job that called it. And that means you'd need to call this routine 'after job' in every job that you wanted to monitor. I prefer a 'post' process, something that you can run after your loads are complete that interogates all of the jobs from the run and gathers up all of the statistics needed at one time. That separation means your loads are not interrupted or hung up by a failure to collect the job statistics.

vmcburney · Post by **vmcburney** » Mon Feb 25, 2013 10:15 pm

You are wasting your time, IBM have built this functionality into Information Server 8.7 and 9.1 via the Operations Console. All job and link row counts are loaded into the operations console and can be queried like normal database tables - you can point Cognos or whatever BI tool you use at it and report and, aggregate on row counts.

chulett · Post by **chulett** » Tue Feb 26, 2013 12:06 am

I guess they are wasting their time if in fact they are on the releases you mention. So... Prem?

vamsi.4a6 · Post by **vamsi.4a6** » Tue Feb 26, 2013 2:04 am

You can also try below command on unix prompt

dsjob -linkinfo <project> <job> <stage> <link>

prasson_ibm · Post by **prasson_ibm** » Tue Feb 26, 2013 6:21 am

vmcburney wrote:You are wasting your time, IBM have built this functionality into Information Server 8.7 and 9.1 via the Operations Console. All job and link row counts are loaded into the operations console and can be queried like normal database tables - you can point Cognos or whatever BI tool you use at it and report and, aggregate on row counts.

Hi,

This seems to be interesting information.I just loggedin to Operation Console and tried to check the rowcount,but there i saw rows/second enformation is logged.
It will be very helpful if you can let us know which table we need to query to get linkrowcount of particular job..?

VineelPrem · Post by **VineelPrem** » Tue Feb 26, 2013 10:50 am

Thanks for the info vcmburney.Thats interesting . But we are still on 8.5 .

VineelPrem · Post by **VineelPrem** » Tue Feb 26, 2013 10:52 am

Hi chulett we are still on 8.5 . I am using the dsjob utility to capture information and parse it .

VineelPrem · Post by **VineelPrem** » Tue Feb 26, 2013 10:55 am

Thanks Vamshi

vamsi.4a6 wrote:You can also try below command on unix prompt

dsjob -linkinfo <project> <job> <stage> <link>