extra_requires was added in slapos.core, which simplifies this part.

/reviewed-on nexedi/slapos!693

Because we run egg tests with setup.py test, which installs missing
eggs, if an egg was not installed by buildout, then it installed before
running test. This was the case for mock, which is now python3 only (
https://pypi.org/project/mock/4.0.0b1/ ) and we started to see test
failures.

To solve this issue, refactor the setup definition to use
extra_requires, which seems to work fine in buildout now. Keep
test_requires because it's the what `python setup.py test` uses.

Clean buildout profiles to install slapos.cookbook[test] for test
instead of duplicating the content of test_requires.

/reviewed-on nexedi/slapos!690

and make sure we really use the develop version, by clearing version pin
that might be for another version.

Also clean up comments in version section.

This will be needed for standalone tests.

Needed for nexedi/kedifa!2

/reviewed-on nexedi/slapos!537

They are dependencies of slapos.toolbox and we already agreed to put slapos.toolbox version in a shared file.

/cc @jerome @jm

/reviewed-on nexedi/slapos!502

slapos.core test suite needs `sensors` command in $PATH
nexedi/slapos.core@7467ef4c (comment 71574)

/reviewed-on nexedi/slapos!479

Depend on caucase, as it shall be installed before as it is dependency.

  Traceback of the tests:

    Installing eggs.
While:
  Installing eggs.
  Getting distribution for 'urllib3>=1.18'.
Error: Picked: urllib3 = 1.24.1

/reviewed-on nexedi/slapos!450

/reviewed-on nexedi/slapos!427

they are already pinned in stack/slapos.cfg

Instead of letting `python setup.py test` install the depencies, use
buildout way of installing the eggs.

This software use `interpreter` recipe of `zc.recipe.egg` to install a
python with all eggs pre-installed. This is a way to get all the
dependencies at install time instead of getting them at run time from
pypi when running `python setup.py test`.
`erp5.util.testsuite` has been extended to support a parameter to
specify which python interpreter to use.

One issue is that this way of installing eggs by buildout cause chicken
and egg problem: cloning repository containing `slapos.recipe.cmmi`
needs git, and to compiling git needs `slapos.recipe.cmmi`.
The consequence of this is that re-running software will install too
many parts again.
One solution for this would be to clone `slapos.recipe.cmmi` with a
`git` command provided by testnode or system package.
Another solution would be to not install `slapos.recipe.cmmi` develop
egg, simply install the egg from it's current pypi version while
installing the software (running tests will be from the git checkout
anyway).
For now this is open issue.

Another point of attention is that `python setup.py test` install the
requirements listed in `test_requires`, but `zc.recipe.egg` does not
provide a way of installing these. Some of our packages have `[test]`
entrypoints, in this case, the software installs the test entrypoints.
For others, we install the eggs.

Other improvements:
 * use a simple `slapos.recipe:wrapper` instead of `slapos.cookbook:egg_test`
 * fix the typo in repository name erp5-util-repository ->
   erp5.util-repository ( this mean we will have to fix the test suites in
   nexedi ERP5 )
 * document "what is this software" and a scenario of how this software
   can be used to develop slapos eggs.
 * switch to buildout-hash.cfg for easier template hash management.

 zc.buildout version up to 2.5.2+slapos012
 slapos.recipe.template version up to 4.3
 slapos.core version up to 1.4.4

Slapos.toolbox has a new dependency to pycurl, which fails to compile if libcurl cannot be found. This commit adds the component/pycurl dependency to most of the Software Releases which have a dependency to slapos.toolbox.

I tried to do it globally, so I couldn't check the compilation of all the modified SRs. Is it a way to test that all SRs still compiled ?

Also, did I forget some important SR ?

@rafael @alain.takoudjou @kazuhiko @jm 

/reviewed-on !97

  CFFI is added on this directory, and it is required to bootstrap slapos.toolbox.