error Standardize

[loreandre]

Hello to all !!!

I need its aid. I have a problem, I obtained other message error from QualityStage when run Standardize.
The error is the following one:
ERROR: specified record size is too large

Apparently this new problem is related to the size of the file. This error takes place when I execute job standardize.

Thanks in advance and regards.

Lore

[ray.wurlod]

This error usually occurs when there is at least one row in your data file that contains more columns than are specified in the file dictionary for that file.

That is the first thing that you must check. The easy way is to determine the number of lines in the file (wc -l) and divide by the line length in the file dictionary. This must yield a whole number. As a secondary check, multiply the number of lines by the length of a line and check against the number of characters in the file (wc -c), allowing for line termination characters.

[loreandre]

I don't understand very well what you say to me. I review the columns in both parts and are equal. The archives logs that they generate are:

STAN.0.log
IntegApl(3561):Tue Apr 10 10:53:39 2007
IntegApl(3561):Tue Apr 10 10:53:40 2007 LOG: running as process 3562
IntegApl(3561):Tue Apr 10 10:53:40 2007 (MSG_pex.c:4; pex.c:834) ERROR: child [000]STN[Run 000/Step001 of STAN](3562) failed with status 1
IntegApl(3561):Tue Apr 10 10:53:40 2007 (MSG_pex.c:22; pex.c:721) ERROR: terminating app with 1
IntegApl(3561):Tue Apr 10 10:53:40 2007 (MSG_vutils.c:13; vutils.c:1412) ERROR: vexit status=1


STAN.Step000.log
STN(3562):Tue Apr 10 10:53:40 2007 LOG: LC_COLLATE is C
STN(3562):Tue Apr 10 10:53:40 2007 LOG: ioOpenFile /Ascential/QualityStage/Projects/DEDUPLI/Data/MALADDR(IORead)
STN(3562):Tue Apr 10 10:53:40 2007 LOG: file /Ascential/QualityStage/Projects/DEDUPLI/Data/MALADDR open
STN(3562):Tue Apr 10 10:53:40 2007 LOG: Using BufSize = 102400, AllocSize = 102400, kind = 3, encoding = native for /Ascential/QualityStage/Projects/DEDUPLI/Data/MALADDR
STN(3562):Tue Apr 10 10:53:40 2007 LOG: ioOpenFile /Ascential/QualityStage/Projects/DEDUPLI/Data/STAN(IOWrite)
STN(3562):Tue Apr 10 10:53:40 2007 LOG: file /Ascential/QualityStage/Projects/DEDUPLI/Data/STAN open
STN(3562):Tue Apr 10 10:53:40 2007 LOG: Using BufSize = 102400, AllocSize = 102400, kind = 3, encoding = native for /Ascential/QualityStage/Projects/DEDUPLI/Data/STAN
STN(3562):Tue Apr 10 10:53:40 2007 LOG: maxOutFileSz = 2064590272
STN(3562):Tue Apr 10 10:53:40 2007 (MSG_stan.c:7 ; stan.c:524) ERROR: specified record size is too large

STN(3562):Tue Apr 10 10:53:40 2007 LOG: 1 records processed
STN(3562):Tue Apr 10 10:53:40 2007 (MSG_vutils.c:13; vutils.c:1412) ERROR: vexit status=1

STN(3562):Tue Apr 10 10:53:40 2007 LOG: End


Thanks!!

LORE

[ray.wurlod]

How large is the record specified for source file MALADDR? That is, what is the highest column number defined in its file definition?

What is the size (in characters) of the MALADDR file?

[loreandre]

The highest column number defined in its file definition is the MALADDR=4557 in the results file STAN=4972

Thaks

LORE[/quote]

[ray.wurlod]

What is the size (in characters) of the MALADDR file?

Code: Select all

wc /Ascential/QualityStage/Projects/DEDUPLI/Data/MALADDR 

[loreandre]

The size of the MALADDR file is the 396021830.


Thanks

LORE

[ray.wurlod]

The wc command should give you three numbers. I am interested in all three.

Assuming you have given me a character count, I observe that 396021830 / 4557 is not a whole number. But, when we allow for the line terminator character, 396021830 / 4558 is a whole number (86885).

So that's the first of the checks complete.

Now the other numbers from wc are needed.