The logic that attempted to optimise this away was buggy since it
wasn't taking IHU expiration times into account.  At any rate,
this optimisation is probably not worth the complexity.