Is DS Job log stored in a hash file?

[olgc]

Hi there,

How is the job log stored in Datastage server? Is it stored in a hash file?

Thanks,

[chulett]

Yes.

[olgc]

Thanks, Chulett.

That means if the job log is too big, such as hundred thousand entries, then it will hurt the job performance. Is this right?

Another question, are all UV tables stored as hash files?

Thanks,

[pneumalin]

I don't think the log size will impact the performance of a specific job run. However, it definitely costs big time on overall performance for DataStage server to maintain such a high overhead, especially while you are trying to view log in director or parsing the log information.
Maintaining 7 or less run log is adivsed thorugh Administrator Auto-Purge project property, and off-load the historical log to a local disk storage via dsjob utility if required.

As far as I know, all the Engine related tables are stored as Hash file style.

[chulett]

Actually, it can have quite a dramatic effect on job performance which is why it's important to keep them purged down as much as possible.

[ray.wurlod]

Hi there,

How is the job log stored in Datastage server? Is it stored in a hash file?

Thanks,

No. It's stored in a hashed file.

[chulett]

I left that little tidbit for you, Ray.