sequential files - flush option?
Posted: Thu Jun 25, 2009 12:03 am
Is there a way to force a record by record flush for sequential files?
In c, I'd use fflush( seqfile );
I would like a better idea of the output rate - is it steady? bursty?
My job is buffering about 300 records between flushes,
and at 3 to 5 minutes per flush, that seems like a coarse
average.
I suppose get a better rate with a peek-stage and pulling time stamps
from the job log. *shrug* I'm just looking for ideas
("more than 1 way to do it" and all that).
John G.
In c, I'd use fflush( seqfile );
I would like a better idea of the output rate - is it steady? bursty?
My job is buffering about 300 records between flushes,
and at 3 to 5 minutes per flush, that seems like a coarse
average.
I suppose get a better rate with a peek-stage and pulling time stamps
from the job log. *shrug* I'm just looking for ideas
("more than 1 way to do it" and all that).
John G.