Also memoize has_metrics? as well, that might be expensive, and it
should not change for the lifetime of EnvironmentStatus