Failed to create FreqDist Summary

pk7 · Post by **pk7** » Fri Sep 16, 2011 3:38 pm

After executing a Column Analysis on several Oracle tables I found that several of the columns in a couple of the tables showed "Error" on the Column Analysis screen. I then discovered that I could view a log of errors at Operate>Log Views. The log showed the following message for each of the tables that had a failure:

Failed to create FreqDist Summary for ec1481df.c862f974.1d80d18b.657e6465-ec8e-4e43.be3f.007963003f00

The only difference was the lengthy ec1481df.c862f974.1d80d18b.657e6465-ec8e-4e43.be3f.007963003f00 string which I believe is a table identifier.

What can I do to determine exactly why the Column Analysis failed for those columns?

stuartjvnorton · Post by **stuartjvnorton** » Sun Sep 18, 2011 5:48 pm

Check SystemOut.log and systemErr.log.

Do you have any summary results at all when you open the analysis results for these tables? If so, take a look at your tablespace for IADB. It's easy to run out of room there if you're not careful.

pk7 · Post by **pk7** » Mon Sep 19, 2011 1:21 pm

Thanks for the response, Stuart!

I am getting summary results for SOME of the columns in SOME of the tables, but then 'Error' showing in the summary for the balance of the columns and tables. That does sound like a tablespace problem but our DBAs increased the available space by 2Gb and the result was the same. However, at your suggestion I looked in the log files and in the SystemErr.log file I found MULTIPLE occurrences of the following messages:

[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.createException(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.getException(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.oracle.OracleImplStatement.execute(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.commonExecute(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdateInternal(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdate(Unknown Source)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.sda.ScratchDataAccessImpl.execute(ScratchDataAccessImpl.java(Compiled Code))
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.dropIndexes(BaseProfileJob.java(Inlined Compiled Code))
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.loadTargetInfo(BaseProfileJob.java(Compiled Code))
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.doPreProcess_retryable(BaseProfileJob.java:187)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob$1.retryableOperation(SorcererJob.java:508)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doRetryableOperation(RetryableOperation.java:206)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doLockedRetryableOperation(RetryableOperation.java:123)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob.doPreProcess(SorcererJob.java:519)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXTaskRunner.executeJob(PXTaskRunner.java:66)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.runTask(PXEngineWorker.java:121)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.run(PXEngineWorker.java:87)
[9/19/11 12:44:31:148 CDT] 00000072 SystemErr R at java.lang.Thread.run(Thread.java:571)
[9/19/11 12:44:31:161 CDT] 00000072 SystemErr R java.sql.SQLException: [IBM][Oracle JDBC Driver][Oracle]ORA-01418: specified index does not exist

at com.ibm.isf.jdbc.base.BaseExceptions.createException(Unknown Source)
at com.ibm.isf.jdbc.base.BaseExceptions.getException(Unknown Source)
at com.ibm.isf.jdbc.oracle.OracleImplStatement.execute(Unknown Source)
at com.ibm.isf.jdbc.base.BaseStatement.commonExecute(Unknown Source)
at com.ibm.isf.jdbc.base.BaseStatement.executeUpdateInternal(Unknown Source)
at com.ibm.isf.jdbc.base.BaseStatement.executeUpdate(Unknown Source)
at com.ascential.investigate.sda.ScratchDataAccessImpl.execute(ScratchDataAccessImpl.java(Compiled Code))
at com.ascential.investigate.auth.jobs.BaseProfileJob.dropIndexes(BaseProfileJob.java(Inlined Compiled Code))
at com.ascential.investigate.auth.jobs.BaseProfileJob.loadTargetInfo(BaseProfileJob.java(Compiled Code))
at com.ascential.investigate.auth.jobs.BaseProfileJob.doPreProcess_retryable(BaseProfileJob.java:187)
at com.ascential.investigate.auth.jobs.SorcererJob$1.retryableOperation(SorcererJob.java:508)
at com.ascential.investigate.utils.locking.RetryableOperation.doRetryableOperation(RetryableOperation.java:206)
at com.ascential.investigate.utils.locking.RetryableOperation.doLockedRetryableOperation(RetryableOperation.java:123)
at com.ascential.investigate.auth.jobs.SorcererJob.doPreProcess(SorcererJob.java:519)
at com.ascential.investigate.auth.engine.px.PXTaskRunner.executeJob(PXTaskRunner.java:66)
at com.ascential.investigate.auth.engine.px.PXEngineWorker.runTask(PXEngineWorker.java:121)
at com.ascential.investigate.auth.engine.px.PXEngineWorker.run(PXEngineWorker.java:87)
at java.lang.Thread.run(Thread.java:571)

[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.createException(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseExceptions.getException(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.oracle.OracleImplStatement.execute(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.commonExecute(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdateInternal(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ibm.isf.jdbc.base.BaseStatement.executeUpdate(Unknown Source)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.sda.ScratchDataAccessImpl.execute(ScratchDataAccessImpl.java(Compiled Code))
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.dropIndexes(BaseProfileJob.java(Inlined Compiled Code))
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.loadTargetInfo(BaseProfileJob.java(Compiled Code))
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.BaseProfileJob.doPreProcess_retryable(BaseProfileJob.java:187)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob$1.retryableOperation(SorcererJob.java:508)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doRetryableOperation(RetryableOperation.java:206)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.utils.locking.RetryableOperation.doLockedRetryableOperation(RetryableOperation.java:123)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.jobs.SorcererJob.doPreProcess(SorcererJob.java:519)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXTaskRunner.executeJob(PXTaskRunner.java:66)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.runTask(PXEngineWorker.java:121)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at com.ascential.investigate.auth.engine.px.PXEngineWorker.run(PXEngineWorker.java:87)
[9/19/11 12:44:31:162 CDT] 00000072 SystemErr R at java.lang.Thread.run(Thread.java:571)

Note the message at [9/19/11 12:44:31:161 CDT]. Only SOME of the sets of these messages had that error. Might that be related to my problem? What might be causing that?

In addition I discovered that if I only profile a small numer of columns at a time (say, a dozen) the profiling is successful. While this works it is very inconvenient as I have many columns in about 3 dozen tables that need to be profiled. Any idea how to fix this so I can I don't have to profile a dozen columns at a time.

stuartjvnorton · Post by **stuartjvnorton** » Mon Sep 19, 2011 5:41 pm

This is the important one:

[9/19/11 12:44:31:161 CDT] 00000072 SystemErr R java.sql.SQLException: [IBM][Oracle JDBC Driver][Oracle]ORA-01418: specified index does not exist

Check your IADB tablespaces.

If your indices are in a different tablespace to the data and the index tablespace is almost full, you might get something like this.

If you look further up the log, or in a previous log, you might find previous Oracle errors that explain it.