Fixes the case where SelectIdleQueue is passed an invalid file handle resulting in atrocious performance.

Prior to the fix, this manifests as the following log file:

(W) nbxmpp.transports_nb calling send on empty buffer and queue