Block upstream decoding if we start to build up too many buffers
(presumably because downstream is waiting for real time to pass while it
plays audio at us).
The magic number 16 is plucked from nowhere in particular. I have no
idea how to choose a number properly.