Revert "core: Update certificates as late as possible"

This reverts commit 202a9bcd because it caused
some test failures.
8 jobs for master
in 0 seconds, using 0 compute credits, and was queued for 0 seconds