This fixes a (very very small) preempt race window when we
invalidate the IO permission bitmap on process exit.