job statistics/ job audit figures

Archive of postings to DataStageUsers@Oliver.com. This forum intended only as a reference and cannot be posted to.

Moderators: chulett, rschirm

Locked
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

job statistics/ job audit figures

Post by admin »

We would like to store some audit figures per job. Like number of records processed, rejected etc. Some of these are part of the Datastage job logging. Is there a way to process this log and store the information in a relational table ?

Or is there a better way(routine) to write record counters to a table at the end of the job ?


regards
Luc

Luc Huygelen
Data Engineering
EDS (Electronic Data Systems)
Noorderlaan 147
2030 Antwerpen (Belgium)
* +32 (0)3 544 6026 or 8932 6026
> * luc.huygelen@eds.com
>
>
>
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Post by admin »

Ask your Ascential rep about MetaStage ... amongst other things its designed to collect exactly this sort of information.

-----Original Message-----
From: Huygelen, Luc [mailto:luc.huygelen@eds.com]
Sent: 02 October 2001 16:30
To: datastage-users@oliver.com
Subject: job statistics/ job audit figures


We would like to store some audit figures per job. Like number of records processed, rejected etc. Some of these are part of the Datastage job logging. Is there a way to process this log and store the information in a relational table ?

Or is there a better way(routine) to write record counters to a table at the end of the job ?


regards
Luc

Luc Huygelen
Data Engineering
EDS (Electronic Data Systems)
Noorderlaan 147
2030 Antwerpen (Belgium)
* +32 (0)3 544 6026 or 8932 6026
> * luc.huygelen@eds.com
>
>
>


This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended addressee, you must
not disclose, copy or take any action in reliance of this transmission.

Although this message and its contents have been scanned for viruses and no
viruses were detected, no responsibility whatsoever is accepted by the
Company, or any of its offices or companies for any loss or damage
arising in any way from receipt or use thereof.

If you have received this email in error please delete this message and notify the Polk System Administrator at postmaster@polkglobal.com.
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Post by admin »

There is a set of functions for obtaining information from the job log.
DSGetLogSummary()
DSGetLogEvent()
DSGetNewestLogId()

Also, the number of rows processed by an active stage is returnable by DSGetStageInfo(), while the number of rows processed by a link is returned by DSGetLinkInfo().

Check them out. Also check out the MetaStage product.

-----Original Message-----
From: Huygelen, Luc [mailto:luc.huygelen@eds.com]
Sent: Wednesday, 03 October 2001 01:30
To: datastage-users@oliver.com
Subject: job statistics/ job audit figures


We would like to store some audit figures per job. Like number of records processed, rejected etc. Some of these are part of the Datastage job logging. Is there a way to process this log and store the information in a relational table ?

Or is there a better way(routine) to write record counters to a table at the end of the job ?


regards
Luc

Luc Huygelen
Data Engineering
EDS (Electronic Data Systems)
Noorderlaan 147
2030 Antwerpen (Belgium)
* +32 (0)3 544 6026 or 8932 6026
> * luc.huygelen@eds.com
>
>
>
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Post by admin »

Hi Luc,
try with "dsjob" utility.
You can find some interesting info and option in "Server Job Developers Guide" installed with Datastage client.

I think it can help you
Riccardo

----- Original Message -----
From: "Huygelen, Luc"
To:
Sent: Tuesday, October 02, 2001 5:30 PM
Subject: job statistics/ job audit figures


> We would like to store some audit figures per job. Like number of
> records processed, rejected etc. Some of these are part of the
> Datastage job logging. Is there a way to process this log and store
> the information in a relational table ?
>
> Or is there a better way(routine) to write record counters to a table
> at
the
> end of the job ?
>
>
> regards
> Luc
>
> Luc Huygelen
> Data Engineering
> EDS (Electronic Data Systems)
> Noorderlaan 147
> 2030 Antwerpen (Belgium)
> * +32 (0)3 544 6026 or 8932 6026
> > * luc.huygelen@eds.com
> >
> >
> >
>
Locked