Improve performance when filtering on milestone on labels

Also some minor refactoring in the seeding.

See merge request !1587