Add total record count and total reject count in log file.

Kel · Post by **Kel** » Fri May 22, 2015 3:16 am

Hi,

I have a log file which registers rejected records and is being used by 3 separate jobs executed as follows: Job1>Overwrite Log File; Job2> Append Log File; Job3>Append Log File. The Log file looks something like this.

Co11~Col2~Col3~Col4~Col5~Col6
0123456~132455~987654678~ADDRNUMBER~1234566~1

My requirement is to add Total Record Counts and Total Rejected Counts on top of the log file from the 3 jobs. The log file now needs to look something like this.

Total Record Count: 100
Total Rejected Count: 2

Co11~Col2~Col3~Col4~Col5~Col6
0123456~132455~987654678~ADDRNUMBER~1234566~1

Has anyone done something like this in Datastage? Any inputs will be highly appreciated.

Thanks.

ray.wurlod · Post by **ray.wurlod** » Fri May 22, 2015 3:52 am

Write the new lines, and any required empty lines, to a dummy file. Then use TYPE command to append the log file. Then delete the log file, and rename the dummy file. The first of these steps is probably done with a fourth DataStage job, the others can be done in an after-job subroutine invoked from that job.

Kel · Post by **Kel** » Fri May 22, 2015 4:18 am

ray.wurlod wrote:Write the new lines, and any required empty lines, to a dummy file. Then use TYPE command to append the log file. Then delete the log file, and rename the dummy file. The first of these steps is pr ...

Hi , I cannot get any insight from your reply since I'm not a premium member. Job Pay is just enough to survive the next cutoff

. Anyways, Are you saying that I should create a new job with a dummy file where I count the total and reject records and then combine it with the existing log file into a new log file? Am I getting the idea or I'm nowhere near?

Thanks.

ray.wurlod · Post by **ray.wurlod** » Fri May 22, 2015 3:49 pm

You're getting the idea and, when you get your premium membership, you'll also get the technique for accomplishing it.

Premium membership is the mechanism by which the hosting and bandwidth costs of DSXchange are funded. We prefer that mechanism to allowing advertisements on the site.

priyadarshikunal · Post by **priyadarshikunal** » Sat May 23, 2015 9:25 am

and please delete other two posts with same question.

Moderator: done