Seems to make some sense after all, but we need to add a check that the
user isn't a roster contact as well.