When connecting by ssh, bash starts with a $PATH containing standard
directories (/usr/bin:/bin). We don't want this to have priority either.