slapos:e35a7b9bc064aabe4206e543306b01775c1653f1 commitshttps://lab.nexedi.com/nexedi/slapos/-/commits/e35a7b9bc064aabe4206e543306b01775c1653f12019-10-07T04:24:00+02:00https://lab.nexedi.com/nexedi/slapos/-/commit/e35a7b9bc064aabe4206e543306b01775c1653f1slapos-testing: install slapos and supervisor scripts2019-10-07T04:24:00+02:00Jérome Perrinjerome@nexedi.com
and make sure we really use the develop version, by clearing version pin
that might be for another version.
Also clean up comments in version section.
This will be needed for standalone tests.https://lab.nexedi.com/nexedi/slapos/-/commit/008379cf2a22161851983159bdcb7a62cfca1e90stack/slapos: slapos.recipe.cmmi version ↑ 0.112019-10-07T04:23:30+02:00Jérome Perrinjerome@nexedi.com
This will support shared builds from multiple directorieshttps://lab.nexedi.com/nexedi/slapos/-/commit/ed707d3b2122a8cb207158d13e5db853ece57257do not create two wrappers for the same executable if hash change2019-10-04T17:20:17+02:00Thomas Gambierthomas.gambier@nexedi.com
Prevent creating 2 wrapper for the same service if hash changed. Here, one service is exited because port is used by the firt to service to start:
slappart6:runner-sshd-4248650e36a9a26a6481df1baffd9f58-on-watch RUNNING pid 27835, uptime 0:03:45
slappart6:runner-sshd-b3b68f4278ceb84691ec27521ea229eb-on-watch EXITED Mar 06 04:52 PM
To achieve that, update slapos.cookbook and use hash-existing-files option of wrapper recipe
hash-existing-files list all the files used for hash that are not
handled by buildout. For those files, the hash is calculated as soon as
the __init__ function so that if there is a change in those files,
buildout will remove the existing wrapper (it will uninstall the
section) and replace it with the new wrapper.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/525" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/525" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2812" data-project-path="nexedi/slapos" data-iid="525" data-mr-title="wrapper recipe: do not create two wrappers for the same executable if hash change" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!525</a>https://lab.nexedi.com/nexedi/slapos/-/commit/26883fea1b691ef60e4700da8f944b25e2d38bf8version up: qemu 4.1.02019-10-03T20:25:08+02:00Julien Muchembledjm@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/9d38218c8978a7a45c01ef3056c16a869910e801Release slapos.cookbook (1.0.123)2019-10-03T19:47:18+02:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/8764854964335a966eaf44056559cf0d341cd126wrapper recipe: accept hash-files already generated inside partition directory2019-10-03T12:05:58+02:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/0e0e8d1935cb472948e132697a9b2a35c2bed716Fix connection-parameter-hash2019-10-03T09:48:06+02:00Lukasz Nowakluke@nexedi.com
Fixed slapos.core stabilises connection_dict during publish, so it is able
to calculate connection-parameter-hash the same way on client and on server, this
having same results when it is expected to have them.
Tasks:
- [x] release `slapos.core` with <a href="https://lab.nexedi.com/nexedi/slapos.core/merge_requests/131" data-original="https://lab.nexedi.com/nexedi/slapos.core/merge_requests/131" data-link="false" data-link-reference="true" data-project="77" data-merge-request="3245" data-project-path="nexedi/slapos.core" data-iid="131" data-mr-title="Stabilise dict generation on the client to be like on the server" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">slapos.core!131</a> and use the version here
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/625" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/625" data-link="false" data-link-reference="true" data-project="15" data-merge-request="3248" data-project-path="nexedi/slapos" data-iid="625" data-mr-title="Fix connection-parameter-hash" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!625</a>https://lab.nexedi.com/nexedi/slapos/-/commit/6743fbd1bc8d3ff4dd95004b73245940e743a60eversion up: tmux, libevent2019-10-03T08:52:50+02:00Nicolas Wavrantnicolas.wavrant@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/50b80c860136a7da69504365efc19a3e07318d12version up: erp5.util2019-10-03T08:37:30+03:00Ivan Tyagovivan@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/09f3342e90750073b6953670bc4a7e1f0417764bComponents updates for shared and rpath2019-10-03T06:55:52+02:00Jérome Perrinjerome@nexedi.com
These are changes to profiles to satisfy the requirements from "checkSoftware" function from `slapos.testing`, ie:
1. rpath is properly set on all executables.
2. shared parts are not referencing non shared parts.
Eventhough current shared was working, we had several component with the problem 2. This was a problem in the following conditions:
- because their hash was computed with a signature including the software installation path ( eg `/opt/slapgrid/e96b88e28dac4de1ba005bb48c6daac9/parts/something/`), shared parts were in practice never shared with other softwares. It was effective when re-installing the same software from scratch a second time, but not when using other softwares.
- when the software was uninstalled, the shared parts stopped working because of missing paths.
As a result of these changes, some parts which used to be shared are no longer shared, but this MR also tries to share a few more parts, the goal was that all parts needed until rebootstrap were shared and also gcc and golang that are significantly large.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/628" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/628" data-link="false" data-link-reference="true" data-project="15" data-merge-request="3286" data-project-path="nexedi/slapos" data-iid="628" data-mr-title="Components updates for shared and rpath" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!628</a>https://lab.nexedi.com/nexedi/slapos/-/commit/0b377eb4655851863f7d77710fd600d5d89b616cerp5: set mariadb timezone to UTC2019-10-02T04:05:39+02:00Jérome Perrinjerome@nexedi.com
ERP5Catalog assumes that dates in catalog are UTC, this works
fine with DATETIME columns that does not carry any timezone
information, but TIMESTAMP columns are converted to mariadb timezone,
which is by default system timezone.
If we want ERP5Catalog to query on TIMESTAMP columns with the existing
logic of converting dates to UTC (because "dates are in UTC in
catalog"), we need to have TIMESTAMP columns in UTC.
This also generally seem a better default than falling back to system
timezone.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/623" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/623" data-link="false" data-link-reference="true" data-project="15" data-merge-request="3242" data-project-path="nexedi/slapos" data-iid="623" data-mr-title="erp5: set mariadb timezone to UTC" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!623</a>https://lab.nexedi.com/nexedi/slapos/-/commit/81870136426496c0d8874ce32975a21924c7c71dfix "caddy-frontend: Test bin/trafficserver-logrotate utility"2019-10-01T11:08:24+02:00Lukasz Nowakluke@nexedi.com
backports.lzma was missing from dependencies.https://lab.nexedi.com/nexedi/slapos/-/commit/2bf01f82a4d272b56b89c5f1f2eb45f85152c431caddy-frontend: Improve README for exposing the node2019-10-01T09:48:39+02:00Lukasz Nowakluke@nexedi.com
Based on current experiences, update the documentation regarding iptables
and network capability documentation.https://lab.nexedi.com/nexedi/slapos/-/commit/46485789124a4a2948639a868d73ae60d66de039caddy-frontend: Do not pass needless openssl to caucase macro2019-10-01T08:13:11+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/7d7a59d607edf54142c70a6c87fd37c5aa25a5adstack/cacuase: Make rerequest updatable2019-10-01T08:13:11+02:00Lukasz Nowakluke@nexedi.com
It will generate new csr and key if the template changes, also if beacuse of
some reason key or csr is not present anymore.
This change makes the part resist to cases when it is becoming uninstalled and
installed again, so that it will not shoot its own foot and leaving the macro
user in inconsistent state.https://lab.nexedi.com/nexedi/slapos/-/commit/e0b1a5d7224ab46f4880ee599a5cdb3207057580caddy-frontend: Use SR openssl instead of uncontrolled one2019-10-01T08:13:11+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/dd065a57455a0836ce57cd2ccc59c6a94e4cf3facomponent/nginx: don't share2019-10-01T07:44:00+02:00Jérome Perrinjerome@nexedi.com
depend on not shared nginx-dav-ext-modulehttps://lab.nexedi.com/nexedi/slapos/-/commit/e0b3a6ae2256209e5636d3ee6489f83cdb4bca69component/*: don't share components depending on mariadb2019-10-01T07:43:59+02:00Jérome Perrinjerome@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/9469a1fa7de4d884d1aea4892b0ff58e8e80dfbacomponent/*: don't share components depending on apache2019-10-01T07:43:59+02:00Jérome Perrinjerome@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/67a66051e150f5716bbd8d63b35cff353a8c89d2component/*: don't share components depending on fonts2019-10-01T07:43:59+02:00Jérome Perrinjerome@nexedi.com
because fonts-* all write in same parts/fonts/ this cannot be shared
yet.https://lab.nexedi.com/nexedi/slapos/-/commit/5e97448e38170150958d0e2d04f84ccdc9a4a1c7component/gtk*: add missing harfbuzz rpath2019-10-01T07:43:58+02:00Jérome Perrinjerome@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/252198ff8d91dfa326a9507f17a05ed858486af6component/xorg: don't share xserver2019-10-01T07:43:58+02:00Jérome Perrinjerome@nexedi.com
xserver tries to write in xkeyboard-config:
make[2]: Nothing to be done for 'install-exec-am'.
/bin//mkdir -p '/tmp/slaps/shared/xkeyboard-config/02d353dc7c1ab898ea120142e33b42f6/share/X11/xkb/compiled'
/bin//mkdir: cannot create directory ‘/tmp/slaps/shared/xkeyboard-config/02d353dc7c1ab898ea120142e33b42f6/share/X11/xkb/compiled’: Permission denied
Makefile:730: recipe for target 'install-dist_xkbcompiledDATA' failed
make[2]: *** [install-dist_xkbcompiledDATA] Error 1https://lab.nexedi.com/nexedi/slapos/-/commit/de33fa14268911240eccc95d5160922045c58dd0component/harfbuzz: fix missing rpath2019-10-01T07:43:58+02:00Jérome Perrinjerome@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/14d04008789db3206099a320a76dec90981e422dcomponent/icu: enable shared slapos.recipe.cmmi2019-10-01T07:43:57+02:00Jérome Perrinjerome@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/491e6e2824ea0bf3bcb143ca2d34978fc3ab0116component/libzip: add missing rpath and make shareable2019-10-01T07:43:57+02:00Jérome Perrinjerome@nexedi.com
find . -type f -executable | xargs ldd | egrep '(^\S|not found)' | grep -B1 'not found'
reported that this component creates binaries that are missing missing
rpath because libzip cannot be found.
Also enable shared as it looks shareable.https://lab.nexedi.com/nexedi/slapos/-/commit/5e82b0d269d03edb595b68f3a37e440224113cc7component/file: rewrite msooxml as a "traditional" patch2019-10-01T07:43:57+02:00Jérome Perrinjerome@nexedi.com
Now this component can be shared.
Maybe newer versions of file in
<a href="https://github.com/file/file/commits/master/magic/Magdir/msooxml" rel="nofollow noreferrer noopener" target="_blank">https://github.com/file/file/commits/master/magic/Magdir/msooxml</a> have an
equivalent fix and the patch is no longer needed. I have kept the change
minimal.https://lab.nexedi.com/nexedi/slapos/-/commit/90ebf2961bce893901aba254921a48d6829450bccomponent/perl: enable shared option for slapos.recipe.cmmi2019-10-01T07:43:57+02:00Jérome Perrinjerome@nexedi.com
Most components depend on perl.https://lab.nexedi.com/nexedi/slapos/-/commit/a2c4d71504784ee58348167fd41d4c0ae4b0337acomponent/golang: make go1.4 shared2019-10-01T07:43:56+02:00Jérome Perrinjerome@nexedi.com
We'll use "go1.4-bootstrap-20171003.tar.gz, which contains the Go
1.4 source code plus accumulated fixes to keep the tools running on
newer operating systems." as described in
<a href="https://golang.org/doc/install/source#bootstrapFromSource" rel="nofollow noreferrer noopener" target="_blank">https://golang.org/doc/install/source#bootstrapFromSource</a>
(this archive contains the "time: Skip TestParseInLocation test."
commit)https://lab.nexedi.com/nexedi/slapos/-/commit/206f9717b52f612ac389a7c9ed7bed4185ec6e6acaddy-frontend: Stabilise json dumps2019-09-27T18:58:39+02:00Lukasz Nowakluke@nexedi.com
Sorting will make dumped data "canonical", so it will limit amount of order
based changes.https://lab.nexedi.com/nexedi/slapos/-/commit/67447e2893a1b086329033b967dc7fea10f62f25caddy-frontend: Drop additional keys for destroyed nodes2019-09-27T18:58:39+02:00Lukasz Nowakluke@nexedi.com
Destroyed nodes shall be just destroyed, and there is no need to send whole
configuration to them.https://lab.nexedi.com/nexedi/slapos/-/commit/bbd144330b444fdc841b354dd8e9f1405c3b44ebcaddy-frontend: Sort list of authorised slaves2019-09-27T18:58:39+02:00Lukasz Nowakluke@nexedi.com
This will stabilise list of published slaves.https://lab.nexedi.com/nexedi/slapos/-/commit/c1e580e5d597d25365b46a14ef56134fed768b4ecaddy-frontend: Remove "server" pollution on slaves2019-09-27T18:58:39+02:00Lukasz Nowakluke@nexedi.com
Server returns slave list with request and publish keys, but only request keys
are important.
In order to avoid needless updates and nonsense data remove those polluted
keys before publishing information about each slave.https://lab.nexedi.com/nexedi/slapos/-/commit/7fa64ad5009d4368a03216ea0f8fa603d293a948caddy-frontend: Pick up Kedifa with timeouts2019-09-25T15:38:37+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/1843f35e9d10d7d9a12848b37c86d0b832c31a89Release slapos.cookbook (1.0.122)2019-09-24T14:52:50+02:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/9976017e793191fd50aa5217d692bb5ad934e9e6wrapper recipe: add hash-existing-files option2019-09-24T12:04:31+02:00Thomas Gambierthomas.gambier@nexedi.com
hash-existing-files list all the files used for hash that are not
handled by buildout. For those files, the hash is calculated as soon as
the __init__ function so that if there is a change in those files,
buildout will remove the existing wrapper (it will uninstall the
section) and replace it with the new wrapper.https://lab.nexedi.com/nexedi/slapos/-/commit/1a89ce842dfdd60dc18a2dfa248aff37942c35d6version up: Debian 9/10/11 netinst2019-09-23T19:17:29+02:00Julien Muchembledjm@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/7d279ba895f0a18b1804af02bb8f6cb58adc1750version up: slapos.core and erp5.util2019-09-20T12:40:26+03:00Ivan Tyagovivan@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/c7fbae2859583b2f578dad7577f2d120fdc1554bkvm: use 'ip' command instead of 'ifconfig' which is deprecated2019-09-19T14:36:30+02:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos/-/commit/8aaf82a9e2a5709c32f47c22707182f71430c71fpyodide: Remove embedded get-pip2019-09-17T18:31:20+02:00Boxiang Sunboxiang.sun@nexedi.com
Extract get-pip change in a separate commit
cc <a href="/jm" data-user="30" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Julien Muchembled">@jm</a> <a href="/romain" data-user="6" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Romain Courteaud">@romain</a>
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/621" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/621" data-link="false" data-link-reference="true" data-project="15" data-merge-request="3238" data-project-path="nexedi/slapos" data-iid="621" data-mr-title="pyodide: Remove embedded get-pip" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!621</a>https://lab.nexedi.com/nexedi/slapos/-/commit/d82a4ee8dd57f80855250023ab38a1e92bca856aNEO: fix instanciation with several subpartitions2019-09-16T16:46:26+02:00Julien Muchembledjm@nexedi.com