We don't upload artifacts and cache in those jobs anyway,
and this should make the job more reliable instead of
relying on .gitignore