USB devio device removal fix

Fixes problem with using usbfs and a device is removed while the
device still has pending events.