Sanjay
DateConv is a routine included. If you have an old download then you need to download it again. If this routine conflicts with one you already have then rename it in the job and rename the routine in the DSX file. It needs this routine to function.
1) After execution, I could see only EtlStats job execution status. We
have executed many more jobs during day and in the past days. How do I see
the job status of all these jobs?
DSJobReportDbDriver is the controlling job. If you run this and have parameter
SeqName = All then it will get row counts for all jobs. SeqName can get row
counts for all jobs in a sequence if the value is the name of a sequence job.
If SeqName is just a job's name then it will get row counts for that one job.
How can I see the job execution status of all the jobs ran and for which job status is present in RT_LOGxxx files?
If a job is compiled then it will not get row counts because they are cleared out of RT_STATUSxxx.
DSJobReportDbDriver does not read RT_LOGxxx to get old values.
2) Which job should get triggered every day?
I run DSJobReportDbDriver at the end of each sequence as the last job activity in the sequence.
The parameter SeqName will need the name of the sequence being run.
3) What are the further steps?
Next step is to automate reports. If you look at SeqQaCompleteness. It runs several reports
to QA the whole data warehouse load. This is a lot more work to set this up but you can
run some of the reports on the last few steps.
4) How do I execute and see the reports generated using GenHtml?
GenHtml is similar setup. It is controlled by a sequence which runs KgdGenHtmlJobDocs and
KgdGenHtmlRoutineDocs. CategoryToDoc parameter will need All to document a whole project.
It can also be a sequence name, category name or job name. It will write html files into
ProjectDir/KimD/Jobs
ProjectDir/KimD/Routines
You may need to create these below the project. It will add YYYYMMDD directories below there.
You also need to get DSaveAsBmpDriver.bat and DSaveAsBmp.bat. These will get the bmp images
from each job design. Most people convert these from bmp files to gif or jpg. You need to edit
each html file display the correct image. This is very slow. The josb run very fast. Seconds to
document the whole project.
DSJobReportDbDriver is fairly slow to get row counts for a whole project maybe a hour for lots
of jobs.
5) What are the other functionality of ETLSTATS and GetHtml?
Reports and QA. It can turn any SQL statement into html. If you add ".html" on the end of a
column then it will turn that column into a link. There are all kinds of ETL metadata reports
included. Run them.
I think DwNav and ParameterNavigator both do a better job of all of this. These do cost money
and are available on my web site. They are lots easier to use.
Thanks Kim.
>From:
Sanjay.Desai@relianceinfo.com
>To: "Kim Duke" <
kim_g_duke@hotmail.com>
>Subject: RE: ETLSTATS and GenHtml - Request for Jobs execution order information
>Date: Thu, 15 Sep 2005 18:13:55 +0530
>
>Hi Kim,
>
>Thanks for your prompt reply.
>
>I have followed your instruction for EtlStats installation. Only one
>error which i encountered is listed below.
>
>"GetEtlQaSqlStat" gave following error while compilation.
>Error preprocessing Transform Derivation for stage GetEtlQaSqlStat.XfmStat.
>Link ETL_QA_RESULT, Column CREATE_TS: DateConv('',1,'')
>Too many arguments to function DateConv
>
>I could manage to run SeqJobStatus and SeqPrepareEtlStats.
>
>Questions:
>1) After execution, I could see only EtlStats job execution status. We
>have executed many more jobs during day and in the past days. How do I see
>the job status of all these jobs? How can I see the job execution
>status of all the jobs ran and for which job status is present in RT_LOGxxx
>files?
>2) Which job should get triggered every day?
>3) What are the further steps?
>4) How do I execute and see the reports generated using GenHtml?
>5) What are the other functionality of ETLSTATS and GetHtml?
>
>Appreciate your response.
>
>Thanks and Regards
>
>Sanjay Desai