call fsync after flush (Refs #573)

short: flushing the bufio buffer is not enough to ensure data
consistency.

long:
Saving an entry to the WAL calls writeLine to append data to the
autofile group backing the WAL, then calls group.Flush() to flush that
data to persistent storage. group.Flush() in turn proxies to
headBuf.flush(), flushing the active bufio.BufferedWriter. However,
BufferedWriter wraps a Writer, not another BufferedWriter, and the way
it flushes is by calling io.Writer.Write() to clear the BufferedWriter's
buffer. The io.Writer we're wrapping here is AutoFile, whose Write
method calls os.File.Write(), performing an unbuffered write to the
operating system, where, I assume, it sits in the OS buffers awaiting
sync. This means that Wal.Save does not, in fact, ensure the saved
operation is synced to disk before returning.
This commit is contained in:
Anton Kaliaev 2017-09-21 16:11:28 -07:00
parent 246082368a
commit d71d1394ec
No known key found for this signature in database
GPG Key ID: 7B6881D965918214
1 changed files with 5 additions and 1 deletions

View File

@ -153,7 +153,11 @@ func (g *Group) WriteLine(line string) error {
func (g *Group) Flush() error { func (g *Group) Flush() error {
g.mtx.Lock() g.mtx.Lock()
defer g.mtx.Unlock() defer g.mtx.Unlock()
return g.headBuf.Flush() err := g.headBuf.Flush()
if err == nil {
err = g.Head.Sync()
}
return err
} }
func (g *Group) processTicks() { func (g *Group) processTicks() {