Revert "core: Update certificates as late as possible"

This reverts commit 202a9bcd because it caused
some test failures.
2 jobs for revert-202a9bcd