During the review of gitlab-org/gitlab-ee!5389 it was noticed that the
docs mandated ignoring a column first, and a release later dropping it.

Given this migration is nearly finished, I've reverted the changes in
one commit so this commit can be reverted itself and picked on a new
branch.