slapos:70b3e0e3ec6931b3ac5422eee8f599c7ed0c022b commitshttps://lab.nexedi.com/nexedi/slapos/-/commits/70b3e0e3ec6931b3ac5422eee8f599c7ed0c022b2019-04-18T01:56:46+02:00https://lab.nexedi.com/nexedi/slapos/-/commit/70b3e0e3ec6931b3ac5422eee8f599c7ed0c022berp5: Fix bug with too many apache Listen2019-04-18T01:56:46+02:00Jérome Perrinjerome@nexedi.com
A regression in the apache entries for testrunner used one apache port
for each zope - not one for each family as what was intended.
There was also a problem that these apache ports were used even when no
testrunner.https://lab.nexedi.com/nexedi/slapos/-/commit/0f110d31cfc8a328afd4b5e4645457d8f7bced9aerp5/test: test how apache, haproxy and zope are created2019-04-18T01:56:45+02:00Jérome Perrinjerome@nexedi.com
- Exercise how multiple families are supported
- Check the number of zope in each family respects `instance-count`
argument
- Check the number of listening sockets is what we expect for server
processes
- Check that when we don't request test runner, apache does not listen
for test runner proxyhttps://lab.nexedi.com/nexedi/slapos/-/commit/9e4c712abc2384a5e37597cd596f60a305031844version up: MariaDB 10.2.232019-04-17T23:12:00+02:00Julien Muchembledjm@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/97fc19b56fc677e8f9ab3b404b856f4de6824029mariadb: add support for lz4/snappy/zstd compression2019-04-17T23:12:00+02:00Julien Muchembledjm@nexedi.com
About Zstd, commit <a href="/kirr/slapos/-/commit/a0d582ab5057e453ff43b1657de5c3ef02e9d45d" data-original="a0d582ab5057e453ff43b1657de5c3ef02e9d45d" data-link="false" data-link-reference="false" data-project="28" data-commit="a0d582ab5057e453ff43b1657de5c3ef02e9d45d" data-reference-type="commit" data-container="body" data-placement="top" data-html="true" title="mariarocks: add support for zstd compression" class="gfm gfm-commit has-tooltip">a0d582ab</a> was wrong.
WITH_<engine>_<comp>=ON compilation options are added to force a build
failure if dependencies are broken.https://lab.nexedi.com/nexedi/slapos/-/commit/1e295ea31ca4515796f73478c2bf2ccb89296593software/seleniumserver: Follow upgrade to caddy 1.0.02019-04-17T11:19:02+02:00Lukasz Nowakluke@nexedi.com
The host needs a name in order to have self_signed certificate generated.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/546" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/546" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2893" data-project-path="nexedi/slapos" data-iid="546" data-mr-title="software/seleniumserver: Follow upgrade to caddy 1.0.0" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!546</a>https://lab.nexedi.com/nexedi/slapos/-/commit/946f16f7c1eec78a3d6cf011fc000519198b1c3bcaddy-frontend: Make sure etc/log-access.conf is never empty2019-04-17T08:30:31+02:00Jérome Perrinjerome@nexedi.com
When there are no shared instances, the file was empty, but caddy
refuses to start when using an import statement on an empty file, with
this error:
```
Error during parsing: Could not read tokens while importing .../etc/log-access.conf: EOF
```
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/545" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/545" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2891" data-project-path="nexedi/slapos" data-iid="545" data-mr-title="caddy-frontend: Make sure etc/log-access.conf is never empty" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!545</a>https://lab.nexedi.com/nexedi/slapos/-/commit/51c7a651277285001ca1dcf66f4a147bbd8b35d1component/caddy: Upgrade to v1.0.0-beta12019-04-16T16:23:46+02:00Lukasz Nowakluke@nexedi.com
This also means that caddy source is fetched directly from upstream, as all
required fixes has been incorporated into the upstream.
Since <a href="https://github.com/mholt/caddy/releases/tag/v0.11.4" rel="nofollow noreferrer noopener" target="_blank">https://github.com/mholt/caddy/releases/tag/v0.11.4</a> TLS-SNI challenge
is replaced by ACME TLS-ALPN challenge, so switch has changed.
Drop direct usage of gowork for now, in order to have caddy built using go
module, support for gowork with go modules might come later.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/544" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/544" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2890" data-project-path="nexedi/slapos" data-iid="544" data-mr-title="component/caddy: Upgrade to v1.0.0-beta1" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!544</a>https://lab.nexedi.com/nexedi/slapos/-/commit/2b121fbe1854860e0d0546dae8a445e89986cd09Fix "Revert "caddy-frontend: Protect against wrong custom config""2019-04-16T08:33:24+02:00Lukasz Nowakluke@nexedi.com
Instance to check custom configuration protection was removed, so follow
this in master partition assertion.https://lab.nexedi.com/nexedi/slapos/-/commit/a19435942de19e3a693a2739e782da1e84c3a0d2Revert "caddy-frontend: Protect against wrong custom config"2019-04-15T08:38:01+02:00Lukasz Nowakluke@nexedi.com
This reverts commit <a href="/tleymone/slapos/-/commit/7993ff81b4905f273f410eb91fac3ef17ab2e2ef" data-original="7993ff81b4905f273f410eb91fac3ef17ab2e2ef" data-link="false" data-link-reference="false" data-project="1449" data-commit="7993ff81b4905f273f410eb91fac3ef17ab2e2ef" data-reference-type="commit" data-container="body" data-placement="top" data-html="true" title="caddy-frontend: Protect against wrong custom config" class="gfm gfm-commit has-tooltip">7993ff81</a>.
Custom configuration checks are hard to be trusted, as they can impact too
many aspects of running frontend.
Frontend administrator knows the risks of custom configuration, and shall take
proper care.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/543" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/543" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2886" data-project-path="nexedi/slapos" data-iid="543" data-mr-title='Revert "caddy-frontend: Protect against wrong custom config"' data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!543</a>https://lab.nexedi.com/nexedi/slapos/-/commit/4eee4c81ac91449b1b26f13da25bb541b33eda21fixup! caddy-frontend: Disable ATS cache promise plugin2019-04-12T12:13:45+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/c82f00de011818d1c0073621e4489cb27cb93c59caddy-frontend/test: Cleanup TestQuicEnabled2019-04-12T10:54:31+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/451032eeff5b26de635aaa66f6a61177523384fecaddy-frontend: Disable ATS cache promise plugin2019-04-12T07:33:48+02:00Lukasz Nowakluke@nexedi.com
ATS cache fillup is uncontrollable during test run.https://lab.nexedi.com/nexedi/slapos/-/commit/c44c7bdf6b9bd03ea0d4c166ea5ff5643883758fcaddy-frontend: Update documentation according to current state2019-04-12T07:20:06+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/1d271f4ddc5739ff7f30cc971d6b766781ff7f8fcaddy-frontend: Re-do zero-SSL BBB2019-04-12T07:20:06+02:00Lukasz Nowakluke@nexedi.com
Instead of complex architecture in the profiles, reuse kedifa-updater
capability to do backward compatibility certificate management thanks to its
fall-back mechanism.
kedifa-updater uses state file to know, if it ever succeed to download
certificate from KeDiFa, and so it really makes it that pushing at least once
certificate to KeDiFa, even if it is sometimes unresponsive, will switch to
it.
Fallback certificate is used, thus each slave listens immediately on HTTP and
HTTPS. Thanks to this, asynchronous updates do not need to communicate with
slapos node instance, and slapos node instance does not care about the
certificates anymore.https://lab.nexedi.com/nexedi/slapos/-/commit/25902c06c926d573af55a0cd8ea06f591553e4e2caddy-frontend: Pick up kedifa with async updater2019-04-12T07:20:06+02:00Lukasz Nowakluke@nexedi.com
Instead of fetching certificates on each slapos node instance use new
kedifa-updater, which is a tool to asynchronously fetch certificates and
has a hook to reload the server in case if new certificate is available.
custom_ssl_directory is NOT BBBhttps://lab.nexedi.com/nexedi/slapos/-/commit/eb33377ca101105be479e2fb057710ce45358248caddy-frontend: Sort slave list during processing2019-04-12T07:20:06+02:00Lukasz Nowakluke@nexedi.com
This mostly useful during tests to have stable results, especially when
some slaves are rejected.
This change is expected to be no-op during normal run.
Note: The slave rejection system does not guarantee any ordering, as the sort
order can change, because of parameters can reorder slaves. Thus, even
if slave A was requested before slave B, and they conflict each other,
slave A can be rejected instead of "expected" slave B.https://lab.nexedi.com/nexedi/slapos/-/commit/6f3eafe0742c06d1dbe455f9f9adf812c0f35fa6caddy-frontend: Keep certificate and key in one file2019-04-12T07:20:06+02:00Lukasz Nowakluke@nexedi.com
This is consistent across usage in caddy-frontend and allow better reusage.https://lab.nexedi.com/nexedi/slapos/-/commit/341df23f70b5de01e89007a397113abeb750e470caddy-frontend: Cleanup PIDFILE after reload2019-04-12T07:20:06+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/f27a120edc3da0b9fb12a119847c6b850459af89fix "caddy-frontend: Drop not needed apache references"2019-04-12T07:20:06+02:00Lukasz Nowakluke@nexedi.com
Section was not renamed in buildout.hash.cfghttps://lab.nexedi.com/nexedi/slapos/-/commit/de58f83e5b78f0dcf8793ce2da86d632ba41271fcaddy-frontend/test: Drop duplicated assertion2019-04-12T07:20:06+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/ffb1fada43457c1369633abc1cb584b5ad147859version up: slapos.core 1.4.222019-04-11T10:57:09+02:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/c2d532a2c42764c31121f30d160ca46b86d07d31fix OBS compilation after perl version up2019-04-11T10:56:59+02:00Thomas Gambierthomas.gambier@nexedi.com
perl was upgraded from version 5.26.1 to 5.28.1 in
<a href="/nexedi/slapos/-/commit/8d4fa2630f587a32b20a8d27ac6060088e102aa4" data-original="8d4fa2630f587a32b20a8d27ac6060088e102aa4" data-link="false" data-link-reference="false" data-project="15" data-commit="8d4fa2630f587a32b20a8d27ac6060088e102aa4" data-reference-type="commit" data-container="body" data-placement="top" data-html="true" title="version up: perl 5.28.1, GeoLite2-Country_20190402" class="gfm gfm-commit has-tooltip">8d4fa263</a>https://lab.nexedi.com/nexedi/slapos/-/commit/e4d52f15ade614741bf5e181144b9aeb172e922ahelloweb: Pick up recent golang1.122019-04-11T10:44:58+02:00Lukasz Nowakluke@nexedi.com
Helloweb is small app, which is very good place to use the most recent go
always.https://lab.nexedi.com/nexedi/slapos/-/commit/ff4a8b2d92e244444aa980c4d3a5d1b1b2881ea5golang: version up to go1.12.32019-04-11T10:44:58+02:00Lukasz Nowakluke@nexedi.com
Contains many bug fixes found since 1.12, see
<a href="https://golang.org/doc/devel/release.html#go1.12.minor" rel="nofollow noreferrer noopener" target="_blank">https://golang.org/doc/devel/release.html#go1.12.minor</a>https://lab.nexedi.com/nexedi/slapos/-/commit/258d1e609c92e469a98ce351affc7b4af8438a39perl: backport a fix for parrallel build2019-04-11T04:23:07+02:00Jérome Perrinjerome@nexedi.com
SLAPOS-SR-TEST-MASTER sometimes reveal errors:
```
Can't locate Getopt/Long.pm in @INC (you may need to install the Getopt::Long module)
...
makefile:588: recipe for target 'cpan/podlators/pm_to_blib' failed
make: *** [cpan/podlators/pm_to_blib] Error 25
```
Backport a fix for this problem discussed at <a href="https://rt.perl.org/Public/Bug/Display.html?id=132360" rel="nofollow noreferrer noopener" target="_blank">https://rt.perl.org/Public/Bug/Display.html?id=132360</a>
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/542" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/542" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2882" data-project-path="nexedi/slapos" data-iid="542" data-mr-title="perl: backport a fix for parrallel build" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!542</a>https://lab.nexedi.com/nexedi/slapos/-/commit/544521b17ef850bfc174e5c304e07b5a3569f1f2version up: slapos.toolbox 0.922019-04-10T09:53:27+02:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/990377d913d4935186e296a4293e044886fac37berp5: exclude mariadb backup-incremental folder2019-04-10T04:50:49+02:00Nicolas Wavrantnicolas.wavrant@nexedi.com
This folder contains binlogs, which are written on every transaction
commited in mariadb. As it is not an immutable file, it shouldn't be
part of the backup, even if its path is confusing...https://lab.nexedi.com/nexedi/slapos/-/commit/47dccf14aa96f14b9a0a57854b22e0d07014bb59stack/erp5: add md5sum check and do not use subfolder2019-04-09T03:23:52+02:00Xiaowu Zhangxiaowu.zhang@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/540" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/540" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2878" data-project-path="nexedi/slapos" data-iid="540" data-mr-title="stack/erp5: add md5sum check and do not use subfolder" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!540</a>https://lab.nexedi.com/nexedi/slapos/-/commit/3a8e8c8d8525723a8e324391dfa4af5038606e68caddy-frontend/test: Adapt results to recent slapos.core2019-04-05T09:40:54+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/d4bff7926c916613a9279fb35e1ed33777c4125bcaddy-frontend/test: Force promise run during test2019-04-05T09:40:54+02:00Lukasz Nowakluke@nexedi.com
--force with --check-anomaly makes monitor.runpromise execute the promise
unconditionally, even for testless ones.https://lab.nexedi.com/nexedi/slapos/-/commit/296ad8e627737d766e0de73efd7ea6a5f01a2c65caddy-frontend/test: Provide more information in case of plugin failure2019-04-05T09:40:54+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/e381c05b91012a1fb6a595b3fc10c042000b211bcaddy-frontend/test: Allow extended msg in assertTestData2019-04-05T09:40:54+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/1e7ef8e16618072e60446b488aac80e92974efbaslapos-sr-testing: Use recent slapos.core from stack/slapos.cfg2019-04-05T09:40:54+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/708215bbb8b2b3d5da53c1a1039fe6a75cafee32Theia: updates improving python language server2019-04-05T05:29:29+02:00Jérome Perrinjerome@nexedi.com
Update versions and tweak a bit python language server config.
After some investigation, I understood that completions where slow for us because jedi add some [buildout support](<a href="https://github.com/davidhalter/jedi/blob/cef769ecd8b3a50cd0784d8660b123f4bf0eaec2/jedi/evaluate/sys_path.py#L132-L137" rel="nofollow noreferrer noopener" target="_blank">https://github.com/davidhalter/jedi/blob/cef769ecd8b3a50cd0784d8660b123f4bf0eaec2/jedi/evaluate/sys_path.py#L132-L137</a>) which walks up directories to find a `buildout.cfg` and inspects the corresponding scripts in `bin` to find python package paths. On web runner I have 98 scripts in `~/bin/`, each of them adding between 30 and 50 entries to `sys.path`.
A quick workaround is to create an empty `buildout.cfg` in the current directory or a parent directory before editing python code.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/509" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/509" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2732" data-project-path="nexedi/slapos" data-iid="509" data-mr-title="Theia: updates improving python language server" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!509</a>https://lab.nexedi.com/nexedi/slapos/-/commit/8d4fa2630f587a32b20a8d27ac6060088e102aa4version up: perl 5.28.1, GeoLite2-Country_201904022019-04-04T17:36:33+02:00Killian Lufaukillian.lufau@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/539" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/539" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2874" data-project-path="nexedi/slapos" data-iid="539" data-mr-title="version up: perl 5.28.1, GeoLite2-Country_20190402" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!539</a>https://lab.nexedi.com/nexedi/slapos/-/commit/d0e0b06f6c488ac53f3c544b4dfbed15bcfdc984bison: add autoconf as build dependency2019-04-04T17:18:14+02:00Killian Lufaukillian.lufau@nexedi.com
Building Bison 3.3.2 now requires autoconf.https://lab.nexedi.com/nexedi/slapos/-/commit/c2fc271b5b8007b4c98f74f8531f05a9c79606a9fixup! bison: add automake as build dependency2019-04-04T17:18:14+02:00Killian Lufaukillian.lufau@nexedi.com
fixup for <a href="/nexedi/slapos/-/commit/af2475991103f457c5f83eb261f30b5e17d28e22" data-original="af2475991103f457c5f83eb261f30b5e17d28e22" data-link="false" data-link-reference="false" data-project="15" data-commit="af2475991103f457c5f83eb261f30b5e17d28e22" data-reference-type="commit" data-container="body" data-placement="top" data-html="true" title="bison: add automake as build dependency" class="gfm gfm-commit has-tooltip">af247599</a>: Put automake
in $PATH instead of creating its own environment variable.https://lab.nexedi.com/nexedi/slapos/-/commit/c0538e07e52a110bbb72bfd5fedba11cac403833software/slapos-testing: Pin zc.lockfile for KeDiFa2019-04-02T19:16:49+02:00Lukasz Nowakluke@nexedi.com
Needed for <a href="https://lab.nexedi.com/nexedi/kedifa/merge_requests/2" data-original="https://lab.nexedi.com/nexedi/kedifa/merge_requests/2" data-link="false" data-link-reference="true" data-project="865" data-merge-request="2868" data-project-path="nexedi/kedifa" data-iid="2" data-mr-title="Feature/async updater" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/kedifa!2</a>
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/537" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/537" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2869" data-project-path="nexedi/slapos" data-iid="537" data-mr-title="software/slapos-testing: Pin zc.lockfile for KeDiFa" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!537</a>https://lab.nexedi.com/nexedi/slapos/-/commit/b1925ebaf56c5651e5f556a35e06afee6e87a894h5py: improve environment compilation variables2019-04-02T02:55:22+00:00Nicolas Wavrantnicolas.wavrant@nexedi.com
otherwise hdf5.so cannot be found on compilation of h5pyhttps://lab.nexedi.com/nexedi/slapos/-/commit/91cb61077c3f072c34671cd60a771ee51173c94ferp5: set version of more-itertools2019-04-02T02:54:07+00:00Nicolas Wavrantnicolas.wavrant@nexedi.com
more-itertools is a hidden dependency, not managed by buildout.
It has dropped support for python2 after version 5.0.0