Page 1 of 1

Is DS Job log stored in a hash file?

Posted: Wed Jun 27, 2007 12:16 pm
by olgc
Hi there,

How is the job log stored in Datastage server? Is it stored in a hash file?

Thanks,

Posted: Wed Jun 27, 2007 12:19 pm
by chulett
Yes.

Posted: Wed Jun 27, 2007 1:11 pm
by olgc
Thanks, Chulett.

That means if the job log is too big, such as hundred thousand entries, then it will hurt the job performance. Is this right?

Another question, are all UV tables stored as hash files?

Thanks,

Posted: Wed Jun 27, 2007 2:11 pm
by pneumalin
I don't think the log size will impact the performance of a specific job run. However, it definitely costs big time on overall performance for DataStage server to maintain such a high overhead, especially while you are trying to view log in director or parsing the log information.
Maintaining 7 or less run log is adivsed thorugh Administrator Auto-Purge project property, and off-load the historical log to a local disk storage via dsjob utility if required.

As far as I know, all the Engine related tables are stored as Hash file style.

Posted: Wed Jun 27, 2007 2:17 pm
by chulett
Actually, it can have quite a dramatic effect on job performance which is why it's important to keep them purged down as much as possible.

Re: Is DS Job log stored in a hash file?

Posted: Wed Jun 27, 2007 3:32 pm
by ray.wurlod
olgc wrote:Hi there,

How is the job log stored in Datastage server? Is it stored in a hash file?

Thanks,
No. It's stored in a hashed file.

Posted: Wed Jun 27, 2007 4:00 pm
by chulett
I left that little tidbit for you, Ray. :wink: