This requires some trickery to properly save the exception state if the
generator creates its own exception state.