slapos.toolbox:eaad8c02bdfea3fa3ce6c7d145b44631f917f734 commitshttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commits/eaad8c02bdfea3fa3ce6c7d145b44631f917f7342019-07-22T14:54:26+02:00https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/eaad8c02bdfea3fa3ce6c7d145b44631f917f734fixup! Add support for Python 32019-07-22T14:54:26+02:00Bryton Lacquementbryton.lacquement@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/1c8269b2b12414846dab010abbc289a99f1faf1dAdd support for Python 32019-06-27T14:17:40+02:00Bryton Lacquementbryton.lacquement@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/51" data-original="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/51" data-link="false" data-link-reference="true" data-project="78" data-merge-request="2748" data-project-path="nexedi/slapos.toolbox" data-iid="51" data-mr-title="Add support for Python 3" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!51</a>https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/eba2c149486f3ec8d6bda3fb32c9ea50889b4132Release 0.942019-06-19T14:59:19+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/1218b0359a8d5433725da5472e6068becf45da48promise/plugin: Implement check_file_state promise plugin2019-06-19T14:56:50+02:00Lukasz Nowakluke@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/59" data-original="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/59" data-link="false" data-link-reference="true" data-project="78" data-merge-request="3050" data-project-path="nexedi/slapos.toolbox" data-iid="59" data-mr-title="promise/plugin: Implement check_file_state promise plugin" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!59</a>https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/7b07fd8e162158458256c352084d8342ba45daa4promise/plugin: Set good default timeout for check_url_available2019-06-17T09:30:38+02:00Lukasz Nowakluke@nexedi.com
promise-timeout provides global timeout for the promise, so use it as
base for calculating default timeout.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/58" data-original="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/58" data-link="false" data-link-reference="true" data-project="78" data-merge-request="3040" data-project-path="nexedi/slapos.toolbox" data-iid="58" data-mr-title="promise/plugin: Set good default timeout for check_url_available" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!58</a>https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/3f508c118b4c05b5f7e7aefcbd9701996245c48cRelease 0.932019-06-13T16:20:25+02:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/76e8a1968f3f4286b404ca5c6ba33eac9ed70cfepromise/plugin: Implement enhancements to check_url_available2019-06-13T15:28:59+02:00Lukasz Nowakluke@nexedi.com
Enhancements:
* implement ignore-code
* cover http_code
* cover timeout
* implement verify
* correctly cover ca-cert-file
* use SLAPOS_TEST_IPV4https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/c7c262198345169eebda83cb98655aab9be1eb20promise/plugin: Generally improve check_url_available2019-06-13T15:28:59+02:00Lukasz Nowakluke@nexedi.com
Improvements:
* flake8ize test_check_url_available and check_url_available
* cover more of check_url_availablehttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/cd0fb8f8eb5a1f0c237ebe1e73515ddc2b07238apromise/plugin: Convert check_url_available to requests2019-06-13T15:28:59+02:00Lukasz Nowakluke@nexedi.com
It will be easier to improve it soon.https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/d5aaf7060ebdf5a735de82afc2d651752ba49ce2monitor: Catch timeout rise by ssl.SSLError2019-06-06T10:19:33+02:00Lukasz Nowakluke@nexedi.com
Additionally print exact exception message.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/56" data-original="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/56" data-link="false" data-link-reference="true" data-project="78" data-merge-request="3012" data-project-path="nexedi/slapos.toolbox" data-iid="56" data-mr-title="monitor: Catch timeout rise by ssl.SSLError" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!56</a>https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/76b353faa4cd10a18f4d33ac2e460dcac90cb356execution-time decreased to 0.5 at slapos.core2019-05-22T19:47:50+02:00Rafael Monneratrafael@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/91bf2ff61f8dbe82faa636e0071f405426ff3b72[runner] more robust resiliency2019-04-10T09:42:42+02:00Thomas Gambierthomas.gambier@nexedi.com
support broken symlink and don't care about modified files that wouldn't be transferred anyway.
/cc <a href="/jm" data-user="30" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Julien Muchembled">@jm</a> for python review :)
/cc <a href="/luke" data-user="302" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Łukasz Nowak">@luke</a> <a href="/Nicolas" data-user="34" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Nicolas Wavrant">@Nicolas</a> to be sure it's what we want
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/55" data-original="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/55" data-link="false" data-link-reference="true" data-project="78" data-merge-request="2872" data-project-path="nexedi/slapos.toolbox" data-iid="55" data-mr-title="[runner] more robust resiliency" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!55</a>https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/886b6002ca3f5e1e768549f5d4a5cb9a5d53c5f0[runner] don't check modified files that wouldn't be rsynced anyway2019-04-09T17:30:56+02:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/c915b5d7ff5fe8bf995b1464525f16138812c54ecleanup: remove pytest warning2019-04-08T10:40:51+02:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/0ac11c835329834ff6e2f46bc2ae07220a4304b0[runner] support broken symlinks in writeSignatureFile2019-04-08T10:40:51+02:00Thomas Gambierthomas.gambier@gmail.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/0177ace58e62293feb06d3a3641a3e57aadcef0fmonitor: Escape title when generating OPML 2019-04-05T04:54:25+02:00Rafael Monneratrafael@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/1c2a96583ab5e00b4325de1b3d47b095ac7ab4cbmonitor: Escape root title when generating OPML2019-04-05T04:49:34+02:00Guillaume Hervierguillaume.hervier@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/34" data-original="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/34" data-link="false" data-link-reference="true" data-project="78" data-merge-request="2188" data-project-path="nexedi/slapos.toolbox" data-iid="34" data-mr-title="monitor: Escape root title when generating OPML" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!34</a>https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/29e4311189f2b8e46308ba5721e7da708c42ef5aresilient: Sort rsync argument lists2019-04-02T09:53:57+02:00Lukasz Nowakluke@nexedi.com
source and exclude can be in artbitrary order, so sort them in order to have
stable calls.
This simplifies assertions in tests and is no-op for the code.https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/613f9b9405ad32d7b90f098cffe6455cddab55b8resilient: Provide more information on error2019-04-02T09:53:57+02:00Lukasz Nowakluke@nexedi.com
It is important for DevOps to understand which files were modified during
synchronisation procedure in order to track issues fast.https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/4a363799093d9ef9cd10e7841147a779f77ca3e8Release 0.912019-03-28T09:58:44+01:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/e757256069e87f0a14e4cd12fc4a5e642311b9fcresilient/runner_exporter: look for modified backup files in the original fol...2019-03-27T11:28:10+01:00Nicolas Wavrantnicolas.wavrant@nexedi.com
and not in the backuped files.
If we look in the backup files, then of course we find modified files, which are
the ones that have just been copied from the instance foldershttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/349f82433bf4d9094318b2819b30997103f3902fRelease 0.902019-03-20T09:56:52+01:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/e1e00feacab7639e87c81e550d9d99831d73bed2Release 0.892019-03-20T09:32:09+01:00Lukasz Nowakluke@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/fbcba5b3dd03d8a64f76b11f26d85e2efb36fca9promise/plugin: Support ATS with traffic_ctl2019-03-20T09:28:01+01:00Lukasz Nowakluke@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/53" data-original="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/53" data-link="false" data-link-reference="true" data-project="78" data-merge-request="2841" data-project-path="nexedi/slapos.toolbox" data-iid="53" data-mr-title="promise/plugin: Support ATS with traffic_ctl" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!53</a>https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/cfdbaaf1a6202ef3efaba195cf74d59bb6a5e75aresiliencytest: remove some slapparts hardcoded in test code2019-03-08T06:30:16+01:00Nicolas Wavrantnicolas.wavrant@nexedi.com
As these slapparts are unstable and are updated every couples of months.
Do so by using the API-ification of inspectInstance which can now
return a JSON (thus output can be easily processed)https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/b71946162f26d92a96211f6cf13d760e888c82d4resiliencytest: get ERP5 connection paramater from slappart02019-03-08T06:30:16+01:00Nicolas Wavrantnicolas.wavrant@nexedi.com
As in webrunner slappart0 is always the root instance and
all needed parameters are bubbled up to ithttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/28019db4ebbd6391a0e2606fc8d68e57745d0777runner: API-fy inspectInstance2019-03-08T06:30:16+01:00Nicolas Wavrantnicolas.wavrant@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/0d084fb6d0662e0222012b7b7a2dd89ad6e75c1cpromise.plugin: fix test ipv6_is_faster failing when ping outside is not poss...2019-03-07T11:58:19+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/766937d4e4b6a7c8a4b7ceae35d2b75dfe365f53Release 0.882019-03-06T11:18:40+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/76ad5861c11cdda26fe02ef3c414d92b0400f10b[runner] add logging when we remove all instances inside a webrunner2019-03-06T10:33:59+01:00Thomas Gambierthomas.gambier@nexedi.com
This shall be helpful when debugging why the data disappeared from a webrunner.
/cc <a href="/cedric.leninivin" data-user="4" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Cédric Le Ninivin">@cedric.leninivin</a> <a href="/jerome" data-user="9" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Jérome Perrin">@jerome</a> <a href="/Nicolas" data-user="34" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Nicolas Wavrant">@Nicolas</a> <a href="/alain.takoudjou" data-user="3" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Alain Takoudjou">@alain.takoudjou</a> <a href="/rafael" data-user="11" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Rafael Monnerat">@rafael</a>
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/52" data-original="https://lab.nexedi.com/nexedi/slapos.toolbox/merge_requests/52" data-link="false" data-link-reference="true" data-project="78" data-merge-request="2806" data-project-path="nexedi/slapos.toolbox" data-iid="52" data-mr-title="[runner] add logging when we remove all instances inside a webrunner" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!52</a>https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/d7496eaf1301c78fea9c026af60d76aba5d91085[runner] add logging when we remove all instances inside a webrunner.2019-03-05T11:41:40+01:00Thomas Gambierthomas.gambier@nexedi.com
This shall be helpful when debugging why the data disappeared from a
webrunner.https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/7344877947ccd7997d4981cc442b657b36714e08[runner] cleanup: do not use list as a variable2019-03-05T11:15:07+01:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/eeed319f160745a2b2d445c8dd24447f1e392491Release 0.872019-02-28T12:57:14+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/69bd6500ecceb717f1220bb6f2e6561b43bdbe7cmonitor.runpromise: exit with non zero code if a promise has failed2019-02-28T11:45:58+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/35979a0510af6cdb69c39bc87e20e519f70eabfdpromise check_port_listening: port parameter should be int or str, unicode is...2019-02-15T15:34:01+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/9b4a52876650929a40510cee3def416e8224bef5Release 0.862019-02-06T09:54:20+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/7b1cd1364400d105ef7c76c2c86e2e36b9ea42a6promise: disable test check for some promises2019-02-05T18:17:07+01:00Alain Takoudjoualain.takoudjou@nexedi.com
This promises are used in caddy-frontend to check slave frontend status. We don't want to run them everytime buildout will deploy frontend because:
- there is too many slaves, check all slave frontend promises while deploying frontend will slow down slave frontend deployment.
- we don't want to reprocess frontend if one of slave frontend promise is failinghttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/55ad3276db5ffaf4c71d12b3012cc43d123d16a3promise: remove old version of promises used for caddy-frontend2019-02-05T18:17:07+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/98bd30c9d078ea1b0cfeef9176e709c408362c57migrates old promises used in caddy-frontend SR to new format2019-02-05T18:17:07+01:00Alain Takoudjoualain.takoudjou@nexedi.com
First start of promise migration to new python promises format. Promises migrated here are
used in caddy-frontend and monitor stack.https://lab.nexedi.com/nexedi/slapos.toolbox/-/commit/47b0ebc0978b438725ce57c79693c2726129b3c9release 0.852019-01-09T16:49:29+01:00Xiaowu Zhangxiaowu.zhang@nexedi.com