After executing a Column Analysis on several Oracle tables I found that several of the columns in a couple of the tables showed "Error" on the Column Analysis screen. I then discovered that I could view a log of errors at Operate>Log Views. The log showed the following message for each of the tables that had a failure:
Failed to create FreqDist Summary for ec1481df.c862f974.1d80d18b.657e6465-ec8e-4e43.be3f.007963003f00
The only difference was the lengthy ec1481df.c862f974.1d80d18b.657e6465-ec8e-4e43.be3f.007963003f00 string which I believe is a table identifier.
What can I do to determine exactly why the Column Analysis failed for those columns?
Failed to create FreqDist Summary
-
- Participant
- Posts: 527
- Joined: Thu Apr 19, 2007 1:25 am
- Location: Melbourne
Thanks for the response, Stuart!
I am getting summary results for SOME of the columns in SOME of the tables, but then 'Error' showing in the summary for the balance of the columns and tables. That does sound like a tablespace problem but our DBAs increased the available space by 2Gb and the result was the same. However, at your suggestion I looked in the log files and in the SystemErr.log file I found MULTIPLE occurrences of the following messages:
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.createException(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.getException(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.oracle.OracleImplStatement.execute(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.commonExecute(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdateInternal(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdate(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.sda.ScratchDataAccessImpl.execute(ScratchDataAccessImpl.java(Compiled Code))
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.dropIndexes(BaseProfileJob.java(Inlined Compiled Code))
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.loadTargetInfo(BaseProfileJob.java(Compiled Code))
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.doPreProcess_retryable(BaseProfileJob.java:187)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob$1.retryableOperation(SorcererJob.java:508)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doRetryableOperation(RetryableOperation.java:206)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doLockedRetryableOperation(RetryableOperation.java:123)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob.doPreProcess(SorcererJob.java:519)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXTaskRunner.executeJob(PXTaskRunner.java:66)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.runTask(PXEngineWorker.java:121)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.run(PXEngineWorker.java:87)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at java.lang.Thread.run(Thread.java:571)
[9/19/11 12:44:31:161 CDT] 00000072 SystemErr R java.sql.SQLException: [IBM][Oracle JDBC Driver][Oracle]ORA-01418: specified index does not exist
at com.ibm.isf.jdbc.base.BaseExceptions.createException(Unknown Source)
at com.ibm.isf.jdbc.base.BaseExceptions.getException(Unknown Source)
at com.ibm.isf.jdbc.oracle.OracleImplStatement.execute(Unknown Source)
at com.ibm.isf.jdbc.base.BaseStatement.commonExecute(Unknown Source)
at com.ibm.isf.jdbc.base.BaseStatement.executeUpdateInternal(Unknown Source)
at com.ibm.isf.jdbc.base.BaseStatement.executeUpdate(Unknown Source)
at com.ascential.investigate.sda.ScratchDataAccessImpl.execute(ScratchDataAccessImpl.java(Compiled Code))
at com.ascential.investigate.auth.jobs.BaseProfileJob.dropIndexes(BaseProfileJob.java(Inlined Compiled Code))
at com.ascential.investigate.auth.jobs.BaseProfileJob.loadTargetInfo(BaseProfileJob.java(Compiled Code))
at com.ascential.investigate.auth.jobs.BaseProfileJob.doPreProcess_retryable(BaseProfileJob.java:187)
at com.ascential.investigate.auth.jobs.SorcererJob$1.retryableOperation(SorcererJob.java:508)
at com.ascential.investigate.utils.locking.RetryableOperation.doRetryableOperation(RetryableOperation.java:206)
at com.ascential.investigate.utils.locking.RetryableOperation.doLockedRetryableOperation(RetryableOperation.java:123)
at com.ascential.investigate.auth.jobs.SorcererJob.doPreProcess(SorcererJob.java:519)
at com.ascential.investigate.auth.engine.px.PXTaskRunner.executeJob(PXTaskRunner.java:66)
at com.ascential.investigate.auth.engine.px.PXEngineWorker.runTask(PXEngineWorker.java:121)
at com.ascential.investigate.auth.engine.px.PXEngineWorker.run(PXEngineWorker.java:87)
at java.lang.Thread.run(Thread.java:571)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.createException(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.getException(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.oracle.OracleImplStatement.execute(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.commonExecute(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdateInternal(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdate(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.sda.ScratchDataAccessImpl.execute(ScratchDataAccessImpl.java(Compiled Code))
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.dropIndexes(BaseProfileJob.java(Inlined Compiled Code))
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.loadTargetInfo(BaseProfileJob.java(Compiled Code))
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.doPreProcess_retryable(BaseProfileJob.java:187)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob$1.retryableOperation(SorcererJob.java:508)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doRetryableOperation(RetryableOperation.java:206)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doLockedRetryableOperation(RetryableOperation.java:123)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob.doPreProcess(SorcererJob.java:519)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXTaskRunner.executeJob(PXTaskRunner.java:66)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.runTask(PXEngineWorker.java:121)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.run(PXEngineWorker.java:87)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at java.lang.Thread.run(Thread.java:571)
Note the message at [9/19/11 12:44:31:161 CDT]. Only SOME of the sets of these messages had that error. Might that be related to my problem? What might be causing that?
In addition I discovered that if I only profile a small numer of columns at a time (say, a dozen) the profiling is successful. While this works it is very inconvenient as I have many columns in about 3 dozen tables that need to be profiled. Any idea how to fix this so I can I don't have to profile a dozen columns at a time.
I am getting summary results for SOME of the columns in SOME of the tables, but then 'Error' showing in the summary for the balance of the columns and tables. That does sound like a tablespace problem but our DBAs increased the available space by 2Gb and the result was the same. However, at your suggestion I looked in the log files and in the SystemErr.log file I found MULTIPLE occurrences of the following messages:
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.createException(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.getException(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.oracle.OracleImplStatement.execute(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.commonExecute(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdateInternal(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdate(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.sda.ScratchDataAccessImpl.execute(ScratchDataAccessImpl.java(Compiled Code))
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.dropIndexes(BaseProfileJob.java(Inlined Compiled Code))
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.loadTargetInfo(BaseProfileJob.java(Compiled Code))
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.doPreProcess_retryable(BaseProfileJob.java:187)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob$1.retryableOperation(SorcererJob.java:508)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doRetryableOperation(RetryableOperation.java:206)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doLockedRetryableOperation(RetryableOperation.java:123)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob.doPreProcess(SorcererJob.java:519)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXTaskRunner.executeJob(PXTaskRunner.java:66)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.runTask(PXEngineWorker.java:121)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.run(PXEngineWorker.java:87)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at java.lang.Thread.run(Thread.java:571)
[9/19/11 12:44:31:161 CDT] 00000072 SystemErr R java.sql.SQLException: [IBM][Oracle JDBC Driver][Oracle]ORA-01418: specified index does not exist
at com.ibm.isf.jdbc.base.BaseExceptions.createException(Unknown Source)
at com.ibm.isf.jdbc.base.BaseExceptions.getException(Unknown Source)
at com.ibm.isf.jdbc.oracle.OracleImplStatement.execute(Unknown Source)
at com.ibm.isf.jdbc.base.BaseStatement.commonExecute(Unknown Source)
at com.ibm.isf.jdbc.base.BaseStatement.executeUpdateInternal(Unknown Source)
at com.ibm.isf.jdbc.base.BaseStatement.executeUpdate(Unknown Source)
at com.ascential.investigate.sda.ScratchDataAccessImpl.execute(ScratchDataAccessImpl.java(Compiled Code))
at com.ascential.investigate.auth.jobs.BaseProfileJob.dropIndexes(BaseProfileJob.java(Inlined Compiled Code))
at com.ascential.investigate.auth.jobs.BaseProfileJob.loadTargetInfo(BaseProfileJob.java(Compiled Code))
at com.ascential.investigate.auth.jobs.BaseProfileJob.doPreProcess_retryable(BaseProfileJob.java:187)
at com.ascential.investigate.auth.jobs.SorcererJob$1.retryableOperation(SorcererJob.java:508)
at com.ascential.investigate.utils.locking.RetryableOperation.doRetryableOperation(RetryableOperation.java:206)
at com.ascential.investigate.utils.locking.RetryableOperation.doLockedRetryableOperation(RetryableOperation.java:123)
at com.ascential.investigate.auth.jobs.SorcererJob.doPreProcess(SorcererJob.java:519)
at com.ascential.investigate.auth.engine.px.PXTaskRunner.executeJob(PXTaskRunner.java:66)
at com.ascential.investigate.auth.engine.px.PXEngineWorker.runTask(PXEngineWorker.java:121)
at com.ascential.investigate.auth.engine.px.PXEngineWorker.run(PXEngineWorker.java:87)
at java.lang.Thread.run(Thread.java:571)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.createException(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.getException(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.oracle.OracleImplStatement.execute(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.commonExecute(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdateInternal(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdate(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.sda.ScratchDataAccessImpl.execute(ScratchDataAccessImpl.java(Compiled Code))
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.dropIndexes(BaseProfileJob.java(Inlined Compiled Code))
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.loadTargetInfo(BaseProfileJob.java(Compiled Code))
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.doPreProcess_retryable(BaseProfileJob.java:187)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob$1.retryableOperation(SorcererJob.java:508)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doRetryableOperation(RetryableOperation.java:206)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doLockedRetryableOperation(RetryableOperation.java:123)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob.doPreProcess(SorcererJob.java:519)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXTaskRunner.executeJob(PXTaskRunner.java:66)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.runTask(PXEngineWorker.java:121)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.run(PXEngineWorker.java:87)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at java.lang.Thread.run(Thread.java:571)
Note the message at [9/19/11 12:44:31:161 CDT]. Only SOME of the sets of these messages had that error. Might that be related to my problem? What might be causing that?
In addition I discovered that if I only profile a small numer of columns at a time (say, a dozen) the profiling is successful. While this works it is very inconvenient as I have many columns in about 3 dozen tables that need to be profiled. Any idea how to fix this so I can I don't have to profile a dozen columns at a time.
-
- Participant
- Posts: 527
- Joined: Thu Apr 19, 2007 1:25 am
- Location: Melbourne
This is the important one:
If your indices are in a different tablespace to the data and the index tablespace is almost full, you might get something like this.
If you look further up the log, or in a previous log, you might find previous Oracle errors that explain it.
Check your IADB tablespaces.[9/19/11 12:44:31:161 CDT] 00000072 SystemErr R java.sql.SQLException: [IBM][Oracle JDBC Driver][Oracle]ORA-01418: specified index does not exist
If your indices are in a different tablespace to the data and the index tablespace is almost full, you might get something like this.
If you look further up the log, or in a previous log, you might find previous Oracle errors that explain it.