[go-nuts] Stream compression with compress/flate.

From looking at your code, it looks like the problem is because you're read
from inflate expects the full data. Whereas Read can actually return early,
and you need to keep reading until there are no more data.

I think deflate.Flush() MUST send all remaining data and it works well the
first 32 iterations. I suspect the cause is flate dictionary size is 32K
and the blocks are 1000 byte length.

This link explains flush methods and how must work:
http://www.bolet.org/~pornin/deflate-flush.html



El lunes, 30 de junio de 2014 22:31:32 UTC+2, jasdel escribió:

But it doesn't seem to be the Flush() call that's messing up but the read.
  The reader has a 32768B history buffer that is read from...hence why your
33rd read only has only 768 bytes. If you call read again it fills up
fine. Honestly, the reader source is too hard for my tired brain to
follow tonight, but not sure what the 'correct' behavior is on the read
call in this situation.

Thanks,
Alex

A flate reader is an io.Reader, and http://golang.org/pkg/io/#Reader
says "Read reads up to len(p) bytes into p" and note the "up to".
Also, "If some data is available but not len(p) bytes, Read
conventionally returns what is available instead of waiting for more."

If you need a full read, then call io.ReadFull.
http://golang.org/pkg/io/#ReadFull says that "ReadFull reads exactly
len(buf) bytes".

With ReadFull works Ok.

Thanks Nigel.



El martes, 1 de julio de 2014 07:34:25 UTC+2, Nigel Tao escribió: