Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
S slapos.core
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Labels
    • Labels
  • Merge requests 26
    • Merge requests 26
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Environments
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Members
    • Members
  • Activity
  • Graph
  • Jobs
  • Commits
Collapse sidebar
  • nexedi
  • slapos.core
  • Merge requests
  • !362

Closed
Created Jan 18, 2022 by Ophélie Gagnard@OphelieContributor
  • Report abuse
Report abuse

WIP: Scan filesystem

  • Overview 0
  • Commits 26
  • Changes 164

This Merge Request is part of the project of scanning Rapid.Space servers' system at startup for security purpose. The result of the scan is sent to a Wendelin instance for further analysis right before the server's OS takes over.

Here, I add a Business Template containing the whole data processing code for a Wendelin instance. What it does:

  • receive the data (Data Ingestion)
  • transform it and integrate it in the current data base (if exists) (Data Transformation)
  • compare each scan with existing reference data bases to detect errors (DiffND)

Along with the actual code comes a Business Template providing a test suite to test the code.

ASSUMED ORIGIN OF PERFORMANCE ISSUES:

On one of my instances, when wcfs is (re)started, we get those logs. In particular: "you need kernel which includes git.kernel.org/linus/ad2ba64dd489". On this instance, when I run my tests they do not stop and I think it is related to this warning as my tests run on another instance where there is not this warning (newer Linux Kernel version).

W0127 15:22:49.561776 28781 storage.go:152] zodb: FIXME: open zeo://10.0.222.0:2100?storage=root: raw cache is not ready for invalidations -> NoCache forced

E0127 15:22:49.564967 28781 wcfs.go:2509] kernel FUSE (API 7.27) does not support explicit data cache invalidation

E0127 15:22:49.565087 28781 wcfs.go:2509] -> performance will be AWFUL.

E0127 15:22:49.565097 28781 wcfs.go:2509] -> you need kernel which includes git.kernel.org/linus/ad2ba64dd489.

E0127 15:22:49.565117 28781 wcfs.go:2509] -> (Linux 5.2+, or nxd-fuse-dkms package installed from navytux.spb.ru/pkg)

W: wcfs: kernel FUSE (API 7.27) does not support explicit data cache invalidation

W: wcfs: -> performance will be AWFUL.

W: wcfs: -> you need kernel which includes git.kernel.org/linus/ad2ba64dd489.

W: wcfs: -> (Linux 5.2+, or nxd-fuse-dkms package installed from navytux.spb.ru/pkg)

Edited Jan 27, 2022 by Ophélie Gagnard
Assignee
Assign to
Reviewer
Request review from
None
Milestone
None
Assign milestone
Time tracking
Source branch: scan-filesystem
GitLab Nexedi Edition | About GitLab | About Nexedi | 沪ICP备2021021310号-2 | 沪ICP备2021021310号-7