1. 19 Mar, 2024 3 commits
  2. 12 Mar, 2024 16 commits
    • Linus Torvalds's avatar
      Merge tag 'x86_tdx_for_6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 855684c7
      Linus Torvalds authored
      Pull x86 tdx update from Dave Hansen:
      
       - Fix sparse warning from TDX use of movdir64b()
      
      * tag 'x86_tdx_for_6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86/asm: Remove the __iomem annotation of movdir64b()'s dst argument
      855684c7
    • Linus Torvalds's avatar
      Merge tag 'x86_mm_for_6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 555b6841
      Linus Torvalds authored
      Pull x86 mm updates from Dave Hansen:
      
       - Add a warning when memory encryption conversions fail. These
         operations require VMM cooperation, even in CoCo environments where
         the VMM is untrusted. While it's _possible_ that memory pressure
         could trigger the new warning, the odds are that a guest would only
         see this from an attacking VMM.
      
       - Simplify page fault code by re-enabling interrupts unconditionally
      
       - Avoid truncation issues when pfns are passed in to pfn_to_kaddr()
         with small (<64-bit) types.
      
      * tag 'x86_mm_for_6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86/mm/cpa: Warn for set_memory_XXcrypted() VMM fails
        x86/mm: Get rid of conditional IF flag handling in page fault path
        x86/mm: Ensure input to pfn_to_kaddr() is treated as a 64-bit type
      555b6841
    • Linus Torvalds's avatar
      Merge tag 'x86-core-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 685d9821
      Linus Torvalds authored
      Pull core x86 updates from Ingo Molnar:
      
       - The biggest change is the rework of the percpu code, to support the
         'Named Address Spaces' GCC feature, by Uros Bizjak:
      
            - This allows C code to access GS and FS segment relative memory
              via variables declared with such attributes, which allows the
              compiler to better optimize those accesses than the previous
              inline assembly code.
      
            - The series also includes a number of micro-optimizations for
              various percpu access methods, plus a number of cleanups of %gs
              accesses in assembly code.
      
            - These changes have been exposed to linux-next testing for the
              last ~5 months, with no known regressions in this area.
      
       - Fix/clean up __switch_to()'s broken but accidentally working handling
         of FPU switching - which also generates better code
      
       - Propagate more RIP-relative addressing in assembly code, to generate
         slightly better code
      
       - Rework the CPU mitigations Kconfig space to be less idiosyncratic, to
         make it easier for distros to follow & maintain these options
      
       - Rework the x86 idle code to cure RCU violations and to clean up the
         logic
      
       - Clean up the vDSO Makefile logic
      
       - Misc cleanups and fixes
      
      * tag 'x86-core-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip: (52 commits)
        x86/idle: Select idle routine only once
        x86/idle: Let prefer_mwait_c1_over_halt() return bool
        x86/idle: Cleanup idle_setup()
        x86/idle: Clean up idle selection
        x86/idle: Sanitize X86_BUG_AMD_E400 handling
        sched/idle: Conditionally handle tick broadcast in default_idle_call()
        x86: Increase brk randomness entropy for 64-bit systems
        x86/vdso: Move vDSO to mmap region
        x86/vdso/kbuild: Group non-standard build attributes and primary object file rules together
        x86/vdso: Fix rethunk patching for vdso-image-{32,64}.o
        x86/retpoline: Ensure default return thunk isn't used at runtime
        x86/vdso: Use CONFIG_COMPAT_32 to specify vdso32
        x86/vdso: Use $(addprefix ) instead of $(foreach )
        x86/vdso: Simplify obj-y addition
        x86/vdso: Consolidate targets and clean-files
        x86/bugs: Rename CONFIG_RETHUNK              => CONFIG_MITIGATION_RETHUNK
        x86/bugs: Rename CONFIG_CPU_SRSO             => CONFIG_MITIGATION_SRSO
        x86/bugs: Rename CONFIG_CPU_IBRS_ENTRY       => CONFIG_MITIGATION_IBRS_ENTRY
        x86/bugs: Rename CONFIG_CPU_UNRET_ENTRY      => CONFIG_MITIGATION_UNRET_ENTRY
        x86/bugs: Rename CONFIG_SLS                  => CONFIG_MITIGATION_SLS
        ...
      685d9821
    • Linus Torvalds's avatar
      Merge tag 'x86-cleanups-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · fcc19657
      Linus Torvalds authored
      Pull x86 cleanups from Ingo Molnar:
       "Misc cleanups, including a large series from Thomas Gleixner to cure
        sparse warnings"
      
      * tag 'x86-cleanups-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86/nmi: Drop unused declaration of proc_nmi_enabled()
        x86/callthunks: Use EXPORT_PER_CPU_SYMBOL_GPL() for per CPU variables
        x86/cpu: Provide a declaration for itlb_multihit_kvm_mitigation
        x86/cpu: Use EXPORT_PER_CPU_SYMBOL_GPL() for x86_spec_ctrl_current
        x86/uaccess: Add missing __force to casts in __access_ok() and valid_user_address()
        x86/percpu: Cure per CPU madness on UP
        smp: Consolidate smp_prepare_boot_cpu()
        x86/msr: Add missing __percpu annotations
        x86/msr: Prepare for including <linux/percpu.h> into <asm/msr.h>
        perf/x86/amd/uncore: Fix __percpu annotation
        x86/nmi: Remove an unnecessary IS_ENABLED(CONFIG_SMP)
        x86/apm_32: Remove dead function apm_get_battery_status()
        x86/insn-eval: Fix function param name in get_eff_addr_sib()
      fcc19657
    • Linus Torvalds's avatar
      Merge tag 'x86-build-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · d69ad12c
      Linus Torvalds authored
      Pull x86 build updates from Ingo Molnar:
      
       - Reduce <asm/bootparam.h> dependencies
      
       - Simplify <asm/efi.h>
      
       - Unify *_setup_data definitions into <asm/setup_data.h>
      
       - Reduce the size of <asm/bootparam.h>
      
      * tag 'x86-build-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86: Do not include <asm/bootparam.h> in several files
        x86/efi: Implement arch_ima_efi_boot_mode() in source file
        x86/setup: Move internal setup_data structures into setup_data.h
        x86/setup: Move UAPI setup structures into setup_data.h
      d69ad12c
    • Linus Torvalds's avatar
      Merge tag 'x86-asm-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 73f0d1d7
      Linus Torvalds authored
      Pull x86 asm updates from Ingo Molnar:
       "Two changes to simplify the x86 decoder logic a bit"
      
      * tag 'x86-asm-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86/insn: Directly assign x86_64 state in insn_init()
        x86/insn: Remove superfluous checks from instruction decoding routines
      73f0d1d7
    • Linus Torvalds's avatar
      Merge tag 'sched-core-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 89c572e2
      Linus Torvalds authored
      Pull scheduler updates from Ingo Molnar:
      
       - Fix inconsistency in misfit task load-balancing
      
       - Fix CPU isolation bugs in the task-wakeup logic
      
       - Rework and unify the sched_use_asym_prio() and sched_asym_prefer()
         logic
      
       - Clean up and simplify ->avg_* accesses
      
       - Misc cleanups and fixes
      
      * tag 'sched-core-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        sched/topology: Rename SD_SHARE_PKG_RESOURCES to SD_SHARE_LLC
        sched/fair: Check the SD_ASYM_PACKING flag in sched_use_asym_prio()
        sched/fair: Rework sched_use_asym_prio() and sched_asym_prefer()
        sched/fair: Remove unused parameter from sched_asym()
        sched/topology: Remove duplicate descriptions from TOPOLOGY_SD_FLAGS
        sched/fair: Simplify the update_sd_pick_busiest() logic
        sched/fair: Do strict inequality check for busiest misfit task group
        sched/fair: Remove unnecessary goto in update_sd_lb_stats()
        sched/fair: Take the scheduling domain into account in select_idle_core()
        sched/fair: Take the scheduling domain into account in select_idle_smt()
        sched/fair: Add READ_ONCE() and use existing helper function to access ->avg_irq
        sched/fair: Use existing helper functions to access ->avg_rt and ->avg_dl
        sched/core: Simplify code by removing duplicate #ifdefs
      89c572e2
    • Linus Torvalds's avatar
      Merge tag 'locking-core-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · a5b1a017
      Linus Torvalds authored
      Pull locking updates from Ingo Molnar:
      
       - Micro-optimize local_xchg() and the rtmutex code on x86
      
       - Fix percpu-rwsem contention tracepoints
      
       - Simplify debugging Kconfig dependencies
      
       - Update/clarify the documentation of atomic primitives
      
       - Misc cleanups
      
      * tag 'locking-core-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        locking/rtmutex: Use try_cmpxchg_relaxed() in mark_rt_mutex_waiters()
        locking/x86: Implement local_xchg() using CMPXCHG without the LOCK prefix
        locking/percpu-rwsem: Trigger contention tracepoints only if contended
        locking/rwsem: Make DEBUG_RWSEMS and PREEMPT_RT mutually exclusive
        locking/rwsem: Clarify that RWSEM_READER_OWNED is just a hint
        locking/mutex: Simplify <linux/mutex.h>
        locking/qspinlock: Fix 'wait_early' set but not used warning
        locking/atomic: scripts: Clarify ordering of conditional atomics
      a5b1a017
    • Linus Torvalds's avatar
      Merge tag 'edac_updates_for_v6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/ras/ras · b0402403
      Linus Torvalds authored
      Pull EDAC updates from Borislav Petkov:
      
       - Add a FRU (Field Replaceable Unit) memory poison manager which
         collects and manages previously encountered hw errors in order to
         save them to persistent storage across reboots. Previously recorded
         errors are "replayed" upon reboot in order to poison memory which has
         caused said errors in the past.
      
         The main use case is stacked, on-chip memory which cannot simply be
         replaced so poisoning faulty areas of it and thus making them
         inaccessible is the only strategy to prolong its lifetime.
      
       - Add an AMD address translation library glue which converts the
         reported addresses of hw errors into system physical addresses in
         order to be used by other subsystems like memory failure, for
         example. Add support for MI300 accelerators to that library.
      
       - igen6: Add support for Alder Lake-N SoC
      
       - i10nm: Add Grand Ridge support
      
       - The usual fixlets and cleanups
      
      * tag 'edac_updates_for_v6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/ras/ras:
        EDAC/versal: Convert to platform remove callback returning void
        RAS/AMD/FMPM: Fix off by one when unwinding on error
        RAS/AMD/FMPM: Add debugfs interface to print record entries
        RAS/AMD/FMPM: Save SPA values
        RAS: Export helper to get ras_debugfs_dir
        RAS/AMD/ATL: Fix bit overflow in denorm_addr_df4_np2()
        RAS: Introduce a FRU memory poison manager
        RAS/AMD/ATL: Add MI300 row retirement support
        Documentation: Move RAS section to admin-guide
        EDAC/versal: Make the bit position of injected errors configurable
        EDAC/i10nm: Add Intel Grand Ridge micro-server support
        EDAC/igen6: Add one more Intel Alder Lake-N SoC support
        RAS/AMD/ATL: Add MI300 DRAM to normalized address translation support
        RAS/AMD/ATL: Fix array overflow in get_logical_coh_st_fabric_id_mi300()
        RAS/AMD/ATL: Add MI300 support
        Documentation: RAS: Add index and address translation section
        EDAC/amd64: Use new AMD Address Translation Library
        RAS: Introduce AMD Address Translation Library
        EDAC/synopsys: Convert to devm_platform_ioremap_resource()
      b0402403
    • Linus Torvalds's avatar
      Merge tag 'x86_misc_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 1f75619a
      Linus Torvalds authored
      Pull misc x86 fixes from Borislav Petkov:
      
       - Fix a wrong check in the function reporting whether a CPU executes
         (or not) a NMI handler
      
       - Ratelimit unknown NMIs messages in order to not potentially slow down
         the machine
      
       - Other fixlets
      
      * tag 'x86_misc_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86/nmi: Fix the inverse "in NMI handler" check
        Documentation/maintainer-tip: Add C++ tail comments exception
        Documentation/maintainer-tip: Add Closes tag
        x86/nmi: Rate limit unknown NMI messages
        Documentation/kernel-parameters: Add spec_rstack_overflow to mitigations=off
      1f75619a
    • Linus Torvalds's avatar
      Merge tag 'x86_sev_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 38b334fc
      Linus Torvalds authored
      Pull x86 SEV updates from Borislav Petkov:
      
       - Add the x86 part of the SEV-SNP host support.
      
         This will allow the kernel to be used as a KVM hypervisor capable of
         running SNP (Secure Nested Paging) guests. Roughly speaking, SEV-SNP
         is the ultimate goal of the AMD confidential computing side,
         providing the most comprehensive confidential computing environment
         up to date.
      
         This is the x86 part and there is a KVM part which did not get ready
         in time for the merge window so latter will be forthcoming in the
         next cycle.
      
       - Rework the early code's position-dependent SEV variable references in
         order to allow building the kernel with clang and -fPIE/-fPIC and
         -mcmodel=kernel
      
       - The usual set of fixes, cleanups and improvements all over the place
      
      * tag 'x86_sev_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip: (36 commits)
        x86/sev: Disable KMSAN for memory encryption TUs
        x86/sev: Dump SEV_STATUS
        crypto: ccp - Have it depend on AMD_IOMMU
        iommu/amd: Fix failure return from snp_lookup_rmpentry()
        x86/sev: Fix position dependent variable references in startup code
        crypto: ccp: Make snp_range_list static
        x86/Kconfig: Remove CONFIG_AMD_MEM_ENCRYPT_ACTIVE_BY_DEFAULT
        Documentation: virt: Fix up pre-formatted text block for SEV ioctls
        crypto: ccp: Add the SNP_SET_CONFIG command
        crypto: ccp: Add the SNP_COMMIT command
        crypto: ccp: Add the SNP_PLATFORM_STATUS command
        x86/cpufeatures: Enable/unmask SEV-SNP CPU feature
        KVM: SEV: Make AVIC backing, VMSA and VMCB memory allocation SNP safe
        crypto: ccp: Add panic notifier for SEV/SNP firmware shutdown on kdump
        iommu/amd: Clean up RMP entries for IOMMU pages during SNP shutdown
        crypto: ccp: Handle legacy SEV commands when SNP is enabled
        crypto: ccp: Handle non-volatile INIT_EX data when SNP is enabled
        crypto: ccp: Handle the legacy TMR allocation when SNP is enabled
        x86/sev: Introduce an SNP leaked pages list
        crypto: ccp: Provide an API to issue SEV and SNP commands
        ...
      38b334fc
    • Linus Torvalds's avatar
      Merge tag 'x86_cache_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 2edfd104
      Linus Torvalds authored
      Pull resource control updates from Borislav Petkov:
      
       - Rework different aspects of the resctrl code like adding
         arch-specific accessors and splitting the locking, in order to
         accomodate ARM's MPAM implementation of hw resource control and be
         able to use the same filesystem control interface like on x86. Work
         by James Morse
      
       - Improve the memory bandwidth throttling heuristic to handle workloads
         with not too regular load levels which end up penalized unnecessarily
      
       - Use CPUID to detect the memory bandwidth enforcement limit on AMD
      
       - The usual set of fixes
      
      * tag 'x86_cache_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip: (30 commits)
        x86/resctrl: Remove lockdep annotation that triggers false positive
        x86/resctrl: Separate arch and fs resctrl locks
        x86/resctrl: Move domain helper migration into resctrl_offline_cpu()
        x86/resctrl: Add CPU offline callback for resctrl work
        x86/resctrl: Allow overflow/limbo handlers to be scheduled on any-but CPU
        x86/resctrl: Add CPU online callback for resctrl work
        x86/resctrl: Add helpers for system wide mon/alloc capable
        x86/resctrl: Make rdt_enable_key the arch's decision to switch
        x86/resctrl: Move alloc/mon static keys into helpers
        x86/resctrl: Make resctrl_mounted checks explicit
        x86/resctrl: Allow arch to allocate memory needed in resctrl_arch_rmid_read()
        x86/resctrl: Allow resctrl_arch_rmid_read() to sleep
        x86/resctrl: Queue mon_event_read() instead of sending an IPI
        x86/resctrl: Add cpumask_any_housekeeping() for limbo/overflow
        x86/resctrl: Move CLOSID/RMID matching and setting to use helpers
        x86/resctrl: Allocate the cleanest CLOSID by searching closid_num_dirty_rmid
        x86/resctrl: Use __set_bit()/__clear_bit() instead of open coding
        x86/resctrl: Track the number of dirty RMID a CLOSID has
        x86/resctrl: Allow RMID allocation to be scoped by CLOSID
        x86/resctrl: Access per-rmid structures by index
        ...
      2edfd104
    • Linus Torvalds's avatar
      Merge tag 'x86_mtrr_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · bfdb395a
      Linus Torvalds authored
      Pull x86 MTRR update from Borislav Petkov:
      
       - Relax the PAT MSR programming which was unnecessarily using the MTRR
         programming protocol of disabling the cache around the changes. The
         reason behind this is the current algorithm triggering a #VE
         exception for TDX guests and unnecessarily complicating things
      
      * tag 'x86_mtrr_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86/pat: Simplify the PAT programming protocol
      bfdb395a
    • Linus Torvalds's avatar
      Merge tag 'x86_cpu_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 742582ac
      Linus Torvalds authored
      Pull x86 cpu update from Borislav Petkov:
      
       - Have AMD Zen common init code run on all families from Zen1 onwards
         in order to save some future enablement effort
      
      * tag 'x86_cpu_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86/CPU/AMD: Do the common init on future Zens too
      742582ac
    • Linus Torvalds's avatar
      Merge tag 'ras_core_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · d8941ce5
      Linus Torvalds authored
      Pull RAS fixlet from Borislav Petkov:
      
       - Constify yet another static struct bus_type instance now that the
         driver core can handle that
      
      * tag 'ras_core_for_v6.9_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86/mce: Make mce_subsys const
      d8941ce5
    • Linus Torvalds's avatar
      Revert "dm: use queue_limits_set" · bff4b746
      Linus Torvalds authored
      This reverts commit 8e0ef412.
      
      It's broken, and causes the boot to fail on encrypted volumes.
      Reported-and-bisected-by: default avatarJohannes Weiner <hannes@cmpxchg.org>
      Link: https://lore.kernel.org/all/20240311235023.GA1205@cmpxchg.org/Acked-by: default avatarJens Axboe <axboe@kernel.dk>
      Signed-off-by: default avatarLinus Torvalds <torvalds@linux-foundation.org>
      bff4b746
  3. 11 Mar, 2024 21 commits
    • Linus Torvalds's avatar
      Merge tag 'x86-entry-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 86833aec
      Linus Torvalds authored
      Pull x86 entry update from Thomas Gleixner:
       "A single update for the x86 entry code:
      
        The current CR3 handling for kernel page table isolation in the
        paranoid return paths which are relevant for #NMI, #MCE, #VC, #DB and
        #DF is unconditionally writing CR3 with the value retrieved on
        exception entry.
      
        In the vast majority of cases when returning to the kernel this is a
        pointless exercise because CR3 was not modified on exception entry.
        The only situation where this is necessary is when the exception
        interrupts a entry from user before switching to kernel CR3 or
        interrupts an exit to user after switching back to user CR3.
      
        As CR3 writes can be expensive on some systems this becomes measurable
        overhead with high frequency #NMIs such as perf.
      
        Avoid this overhead by checking the CR3 value, which was saved on
        entry, and write it back to CR3 only when it is a user CR3"
      
      * tag 'x86-entry-2024-03-11' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        x86/entry: Avoid redundant CR3 write on paranoid returns
      86833aec
    • Linus Torvalds's avatar
      Merge tag 'x86-fred-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 720c8579
      Linus Torvalds authored
      Pull x86 FRED support from Thomas Gleixner:
       "Support for x86 Fast Return and Event Delivery (FRED).
      
        FRED is a replacement for IDT event delivery on x86 and addresses most
        of the technical nightmares which IDT exposes:
      
         1) Exception cause registers like CR2 need to be manually preserved
            in nested exception scenarios.
      
         2) Hardware interrupt stack switching is suboptimal for nested
            exceptions as the interrupt stack mechanism rewinds the stack on
            each entry which requires a massive effort in the low level entry
            of #NMI code to handle this.
      
         3) No hardware distinction between entry from kernel or from user
            which makes establishing kernel context more complex than it needs
            to be especially for unconditionally nestable exceptions like NMI.
      
         4) NMI nesting caused by IRET unconditionally reenabling NMIs, which
            is a problem when the perf NMI takes a fault when collecting a
            stack trace.
      
         5) Partial restore of ESP when returning to a 16-bit segment
      
         6) Limitation of the vector space which can cause vector exhaustion
            on large systems.
      
         7) Inability to differentiate NMI sources
      
        FRED addresses these shortcomings by:
      
         1) An extended exception stack frame which the CPU uses to save
            exception cause registers. This ensures that the meta information
            for each exception is preserved on stack and avoids the extra
            complexity of preserving it in software.
      
         2) Hardware interrupt stack switching is non-rewinding if a nested
            exception uses the currently interrupt stack.
      
         3) The entry points for kernel and user context are separate and GS
            BASE handling which is required to establish kernel context for
            per CPU variable access is done in hardware.
      
         4) NMIs are now nesting protected. They are only reenabled on the
            return from NMI.
      
         5) FRED guarantees full restore of ESP
      
         6) FRED does not put a limitation on the vector space by design
            because it uses a central entry points for kernel and user space
            and the CPUstores the entry type (exception, trap, interrupt,
            syscall) on the entry stack along with the vector number. The
            entry code has to demultiplex this information, but this removes
            the vector space restriction.
      
            The first hardware implementations will still have the current
            restricted vector space because lifting this limitation requires
            further changes to the local APIC.
      
         7) FRED stores the vector number and meta information on stack which
            allows having more than one NMI vector in future hardware when the
            required local APIC changes are in place.
      
        The series implements the initial FRED support by:
      
         - Reworking the existing entry and IDT handling infrastructure to
           accomodate for the alternative entry mechanism.
      
         - Expanding the stack frame to accomodate for the extra 16 bytes FRED
           requires to store context and meta information
      
         - Providing FRED specific C entry points for events which have
           information pushed to the extended stack frame, e.g. #PF and #DB.
      
         - Providing FRED specific C entry points for #NMI and #MCE
      
         - Implementing the FRED specific ASM entry points and the C code to
           demultiplex the events
      
         - Providing detection and initialization mechanisms and the necessary
           tweaks in context switching, GS BASE handling etc.
      
        The FRED integration aims for maximum code reuse vs the existing IDT
        implementation to the extent possible and the deviation in hot paths
        like context switching are handled with alternatives to minimalize the
        impact. The low level entry and exit paths are seperate due to the
        extended stack frame and the hardware based GS BASE swichting and
        therefore have no impact on IDT based systems.
      
        It has been extensively tested on existing systems and on the FRED
        simulation and as of now there are no outstanding problems"
      
      * tag 'x86-fred-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip: (38 commits)
        x86/fred: Fix init_task thread stack pointer initialization
        MAINTAINERS: Add a maintainer entry for FRED
        x86/fred: Fix a build warning with allmodconfig due to 'inline' failing to inline properly
        x86/fred: Invoke FRED initialization code to enable FRED
        x86/fred: Add FRED initialization functions
        x86/syscall: Split IDT syscall setup code into idt_syscall_init()
        KVM: VMX: Call fred_entry_from_kvm() for IRQ/NMI handling
        x86/entry: Add fred_entry_from_kvm() for VMX to handle IRQ/NMI
        x86/entry/calling: Allow PUSH_AND_CLEAR_REGS being used beyond actual entry code
        x86/fred: Fixup fault on ERETU by jumping to fred_entrypoint_user
        x86/fred: Let ret_from_fork_asm() jmp to asm_fred_exit_user when FRED is enabled
        x86/traps: Add sysvec_install() to install a system interrupt handler
        x86/fred: FRED entry/exit and dispatch code
        x86/fred: Add a machine check entry stub for FRED
        x86/fred: Add a NMI entry stub for FRED
        x86/fred: Add a debug fault entry stub for FRED
        x86/idtentry: Incorporate definitions/declarations of the FRED entries
        x86/fred: Make exc_page_fault() work for FRED
        x86/fred: Allow single-step trap and NMI when starting a new task
        x86/fred: No ESPFIX needed when FRED is enabled
        ...
      720c8579
    • Linus Torvalds's avatar
      Merge tag 'x86-apic-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · ca7e9177
      Linus Torvalds authored
      Pull x86 APIC updates from Thomas Gleixner:
       "Rework of APIC enumeration and topology evaluation.
      
        The current implementation has a couple of shortcomings:
      
         - It fails to handle hybrid systems correctly.
      
         - The APIC registration code which handles CPU number assignents is
           in the middle of the APIC code and detached from the topology
           evaluation.
      
         - The various mechanisms which enumerate APICs, ACPI, MPPARSE and
           guest specific ones, tweak global variables as they see fit or in
           case of XENPV just hack around the generic mechanisms completely.
      
         - The CPUID topology evaluation code is sprinkled all over the vendor
           code and reevaluates global variables on every hotplug operation.
      
         - There is no way to analyze topology on the boot CPU before bringing
           up the APs. This causes problems for infrastructure like PERF which
           needs to size certain aspects upfront or could be simplified if
           that would be possible.
      
         - The APIC admission and CPU number association logic is
           incomprehensible and overly complex and needs to be kept around
           after boot instead of completing this right after the APIC
           enumeration.
      
        This update addresses these shortcomings with the following changes:
      
         - Rework the CPUID evaluation code so it is common for all vendors
           and provides information about the APIC ID segments in a uniform
           way independent of the number of segments (Thread, Core, Module,
           ..., Die, Package) so that this information can be computed instead
           of rewriting global variables of dubious value over and over.
      
         - A few cleanups and simplifcations of the APIC, IO/APIC and related
           interfaces to prepare for the topology evaluation changes.
      
         - Seperation of the parser stages so the early evaluation which tries
           to find the APIC address can be seperately overridden from the late
           evaluation which enumerates and registers the local APIC as further
           preparation for sanitizing the topology evaluation.
      
         - A new registration and admission logic which
      
             - encapsulates the inner workings so that parsers and guest logic
               cannot longer fiddle in it
      
             - uses the APIC ID segments to build topology bitmaps at
               registration time
      
             - provides a sane admission logic
      
             - allows to detect the crash kernel case, where CPU0 does not run
               on the real BSP, automatically. This is required to prevent
               sending INIT/SIPI sequences to the real BSP which would reset
               the whole machine. This was so far handled by a tedious command
               line parameter, which does not even work in nested crash
               scenarios.
      
             - Associates CPU number after the enumeration completed and
               prevents the late registration of APICs, which was somehow
               tolerated before.
      
         - Converting all parsers and guest enumeration mechanisms over to the
           new interfaces.
      
           This allows to get rid of all global variable tweaking from the
           parsers and enumeration mechanisms and sanitizes the XEN[PV]
           handling so it can use CPUID evaluation for the first time.
      
         - Mopping up existing sins by taking the information from the APIC ID
           segment bitmaps.
      
           This evaluates hybrid systems correctly on the boot CPU and allows
           for cleanups and fixes in the related drivers, e.g. PERF.
      
        The series has been extensively tested and the minimal late fallout
        due to a broken ACPI/MADT table has been addressed by tightening the
        admission logic further"
      
      * tag 'x86-apic-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip: (76 commits)
        x86/topology: Ignore non-present APIC IDs in a present package
        x86/apic: Build the x86 topology enumeration functions on UP APIC builds too
        smp: Provide 'setup_max_cpus' definition on UP too
        smp: Avoid 'setup_max_cpus' namespace collision/shadowing
        x86/bugs: Use fixed addressing for VERW operand
        x86/cpu/topology: Get rid of cpuinfo::x86_max_cores
        x86/cpu/topology: Provide __num_[cores|threads]_per_package
        x86/cpu/topology: Rename topology_max_die_per_package()
        x86/cpu/topology: Rename smp_num_siblings
        x86/cpu/topology: Retrieve cores per package from topology bitmaps
        x86/cpu/topology: Use topology logical mapping mechanism
        x86/cpu/topology: Provide logical pkg/die mapping
        x86/cpu/topology: Simplify cpu_mark_primary_thread()
        x86/cpu/topology: Mop up primary thread mask handling
        x86/cpu/topology: Use topology bitmaps for sizing
        x86/cpu/topology: Let XEN/PV use topology from CPUID/MADT
        x86/xen/smp_pv: Count number of vCPUs early
        x86/cpu/topology: Assign hotpluggable CPUIDs during init
        x86/cpu/topology: Reject unknown APIC IDs on ACPI hotplug
        x86/topology: Add a mechanism to track topology via APIC IDs
        ...
      ca7e9177
    • Linus Torvalds's avatar
      Merge tag 'timers-core-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · d08c407f
      Linus Torvalds authored
      Pull timer updates from Thomas Gleixner:
       "A large set of updates and features for timers and timekeeping:
      
         - The hierarchical timer pull model
      
           When timer wheel timers are armed they are placed into the timer
           wheel of a CPU which is likely to be busy at the time of expiry.
           This is done to avoid wakeups on potentially idle CPUs.
      
           This is wrong in several aspects:
      
             1) The heuristics to select the target CPU are wrong by
                definition as the chance to get the prediction right is
                close to zero.
      
             2) Due to #1 it is possible that timers are accumulated on
                a single target CPU
      
             3) The required computation in the enqueue path is just overhead
                for dubious value especially under the consideration that the
                vast majority of timer wheel timers are either canceled or
                rearmed before they expire.
      
           The timer pull model avoids the above by removing the target
           computation on enqueue and queueing timers always on the CPU on
           which they get armed.
      
           This is achieved by having separate wheels for CPU pinned timers
           and global timers which do not care about where they expire.
      
           As long as a CPU is busy it handles both the pinned and the global
           timers which are queued on the CPU local timer wheels.
      
           When a CPU goes idle it evaluates its own timer wheels:
      
             - If the first expiring timer is a pinned timer, then the global
               timers can be ignored as the CPU will wake up before they
               expire.
      
             - If the first expiring timer is a global timer, then the expiry
               time is propagated into the timer pull hierarchy and the CPU
               makes sure to wake up for the first pinned timer.
      
           The timer pull hierarchy organizes CPUs in groups of eight at the
           lowest level and at the next levels groups of eight groups up to
           the point where no further aggregation of groups is required, i.e.
           the number of levels is log8(NR_CPUS). The magic number of eight
           has been established by experimention, but can be adjusted if
           needed.
      
           In each group one busy CPU acts as the migrator. It's only one CPU
           to avoid lock contention on remote timer wheels.
      
           The migrator CPU checks in its own timer wheel handling whether
           there are other CPUs in the group which have gone idle and have
           global timers to expire. If there are global timers to expire, the
           migrator locks the remote CPU timer wheel and handles the expiry.
      
           Depending on the group level in the hierarchy this handling can
           require to walk the hierarchy downwards to the CPU level.
      
           Special care is taken when the last CPU goes idle. At this point
           the CPU is the systemwide migrator at the top of the hierarchy and
           it therefore cannot delegate to the hierarchy. It needs to arm its
           own timer device to expire either at the first expiring timer in
           the hierarchy or at the first CPU local timer, which ever expires
           first.
      
           This completely removes the overhead from the enqueue path, which
           is e.g. for networking a true hotpath and trades it for a slightly
           more complex idle path.
      
           This has been in development for a couple of years and the final
           series has been extensively tested by various teams from silicon
           vendors and ran through extensive CI.
      
           There have been slight performance improvements observed on network
           centric workloads and an Intel team confirmed that this allows them
           to power down a die completely on a mult-die socket for the first
           time in a mostly idle scenario.
      
           There is only one outstanding ~1.5% regression on a specific
           overloaded netperf test which is currently investigated, but the
           rest is either positive or neutral performance wise and positive on
           the power management side.
      
         - Fixes for the timekeeping interpolation code for cross-timestamps:
      
           cross-timestamps are used for PTP to get snapshots from hardware
           timers and interpolated them back to clock MONOTONIC. The changes
           address a few corner cases in the interpolation code which got the
           math and logic wrong.
      
         - Simplifcation of the clocksource watchdog retry logic to
           automatically adjust to handle larger systems correctly instead of
           having more incomprehensible command line parameters.
      
         - Treewide consolidation of the VDSO data structures.
      
         - The usual small improvements and cleanups all over the place"
      
      * tag 'timers-core-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip: (62 commits)
        timer/migration: Fix quick check reporting late expiry
        tick/sched: Fix build failure for CONFIG_NO_HZ_COMMON=n
        vdso/datapage: Quick fix - use asm/page-def.h for ARM64
        timers: Assert no next dyntick timer look-up while CPU is offline
        tick: Assume timekeeping is correctly handed over upon last offline idle call
        tick: Shut down low-res tick from dying CPU
        tick: Split nohz and highres features from nohz_mode
        tick: Move individual bit features to debuggable mask accesses
        tick: Move got_idle_tick away from common flags
        tick: Assume the tick can't be stopped in NOHZ_MODE_INACTIVE mode
        tick: Move broadcast cancellation up to CPUHP_AP_TICK_DYING
        tick: Move tick cancellation up to CPUHP_AP_TICK_DYING
        tick: Start centralizing tick related CPU hotplug operations
        tick/sched: Don't clear ts::next_tick again in can_stop_idle_tick()
        tick/sched: Rename tick_nohz_stop_sched_tick() to tick_nohz_full_stop_tick()
        tick: Use IS_ENABLED() whenever possible
        tick/sched: Remove useless oneshot ifdeffery
        tick/nohz: Remove duplicate between lowres and highres handlers
        tick/nohz: Remove duplicate between tick_nohz_switch_to_nohz() and tick_setup_sched_timer()
        hrtimer: Select housekeeping CPU during migration
        ...
      d08c407f
    • Linus Torvalds's avatar
      Merge tag 'timers-ptp-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 80a76c60
      Linus Torvalds authored
      Pull clocksource updates from Thomas Gleixner:
       "Updates for timekeeping and PTP core.
      
        The cross-timestamp mechanism which allows to correlate hardware
        clocks uses clocksource pointers for describing the correlation.
      
        That's suboptimal as drivers need to obtain the pointer, which
        requires needless exports and exposing internals. This can all be
        completely avoided by assigning clocksource IDs and using them for
        describing the correlated clock source.
      
        So this adds clocksource IDs to all clocksources in the tree which can
        be exposed to this mechanism and removes the pointer and now needless
        exports.
      
        A related improvement for the core and the correlation handling has
        not made it this time, but is expected to get ready for the next
        round"
      
      * tag 'timers-ptp-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        kvmclock: Unexport kvmclock clocksource
        treewide: Remove system_counterval_t.cs, which is never read
        timekeeping: Evaluate system_counterval_t.cs_id instead of .cs
        ptp/kvm, arm_arch_timer: Set system_counterval_t.cs_id to constant
        x86/kvm, ptp/kvm: Add clocksource ID, set system_counterval_t.cs_id
        x86/tsc: Add clocksource ID, set system_counterval_t.cs_id
        timekeeping: Add clocksource ID to struct system_counterval_t
        x86/tsc: Correct kernel-doc notation
      80a76c60
    • Linus Torvalds's avatar
      Merge tag 'smp-core-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 397935e3
      Linus Torvalds authored
      Pull cpu core updates from Thomas Gleixner:
       "A small boring set of cleanups for the SMP and CPU hotplug code"
      
      * tag 'smp-core-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip:
        cpu: Remove stray semicolon
        smp: Make __smp_processor_id() 0-argument macro
        cpu: Mark cpu_possible_mask as __ro_after_init
        kernel/cpu: Convert snprintf() to sysfs_emit()
        cpu/hotplug: Delete an extraneous kernel-doc description
      397935e3
    • Linus Torvalds's avatar
      Merge tag 'irq-msi-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 4527e837
      Linus Torvalds authored
      Pull MSI updates from Thomas Gleixner:
       "Updates for the MSI interrupt subsystem and initial RISC-V MSI
        support.
      
        The core changes have been adopted from previous work which converted
        ARM[64] to the new per device MSI domain model, which was merged to
        support multiple MSI domain per device. The ARM[64] changes are being
        worked on too, but have not been ready yet. The core and platform-MSI
        changes have been split out to not hold up RISC-V and to avoid that
        RISC-V builds on the scheduled for removal interfaces.
      
        The core support provides new interfaces to handle wire to MSI bridges
        in a straight forward way and introduces new platform-MSI interfaces
        which are built on top of the per device MSI domain model.
      
        Once ARM[64] is converted over the old platform-MSI interfaces and the
        related ugliness in the MSI core code will be removed.
      
        The actual MSI parts for RISC-V were finalized late and have been
        post-poned for the next merge window.
      
        Drivers:
      
         - Add a new driver for the Andes hart-level interrupt controller
      
         - Rework the SiFive PLIC driver to prepare for MSI suport
      
         - Expand the RISC-V INTC driver to support the new RISC-V AIA
           controller which provides the basis for MSI on RISC-V
      
         - A few fixup for the fallout of the core changes"
      
      * tag 'irq-msi-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip: (29 commits)
        irqchip/riscv-intc: Fix low-level interrupt handler setup for AIA
        x86/apic/msi: Use DOMAIN_BUS_GENERIC_MSI for HPET/IO-APIC domain search
        genirq/matrix: Dynamic bitmap allocation
        irqchip/riscv-intc: Add support for RISC-V AIA
        irqchip/sifive-plic: Improve locking safety by using irqsave/irqrestore
        irqchip/sifive-plic: Parse number of interrupts and contexts early in plic_probe()
        irqchip/sifive-plic: Cleanup PLIC contexts upon irqdomain creation failure
        irqchip/sifive-plic: Use riscv_get_intc_hwnode() to get parent fwnode
        irqchip/sifive-plic: Use devm_xyz() for managed allocation
        irqchip/sifive-plic: Use dev_xyz() in-place of pr_xyz()
        irqchip/sifive-plic: Convert PLIC driver into a platform driver
        irqchip/riscv-intc: Introduce Andes hart-level interrupt controller
        irqchip/riscv-intc: Allow large non-standard interrupt number
        genirq/irqdomain: Don't call ops->select for DOMAIN_BUS_ANY tokens
        irqchip/imx-intmux: Handle pure domain searches correctly
        genirq/msi: Provide MSI_FLAG_PARENT_PM_DEV
        genirq/irqdomain: Reroute device MSI create_mapping
        genirq/msi: Provide allocation/free functions for "wired" MSI interrupts
        genirq/msi: Optionally use dev->fwnode for device domain
        genirq/msi: Provide DOMAIN_BUS_WIRED_TO_MSI
        ...
      4527e837
    • Linus Torvalds's avatar
      Merge tag 'irq-core-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip · 02d4df78
      Linus Torvalds authored
      Pull irq updates from Thomas Gleixner:
       "Core:
      
         - Make affinity changes take effect immediately for interrupt
           threads. This reduces the impact on isolated CPUs as it pulls over
           the thread right away instead of doing it after the next hardware
           interrupt arrived.
      
         - Cleanup and improvements for the interrupt chip simulator
      
         - Deduplication of the interrupt descriptor initialization code so
           the sparse and non-sparse mode share more code.
      
        Drivers:
      
         - A set of conversions to platform_drivers::remove_new() which gets
           rid of the pointless return value.
      
         - A new driver for the Starfive JH8100 SoC
      
         - Support for Amlogic-T7 SoCs
      
         - Improvement for the interrupt handling and EOI management for the
           loongson interrupt controller.
      
         - The usual fixes and improvements all over the place"
      
      * tag 'irq-core-2024-03-10' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip: (33 commits)
        irqchip/ts4800: Convert to platform_driver::remove_new() callback
        irqchip/stm32-exti: Convert to platform_driver::remove_new() callback
        irqchip/renesas-rza1: Convert to platform_driver::remove_new() callback
        irqchip/renesas-irqc: Convert to platform_driver::remove_new() callback
        irqchip/renesas-intc-irqpin: Convert to platform_driver::remove_new() callback
        irqchip/pruss-intc: Convert to platform_driver::remove_new() callback
        irqchip/mvebu-pic: Convert to platform_driver::remove_new() callback
        irqchip/madera: Convert to platform_driver::remove_new() callback
        irqchip/ls-scfg-msi: Convert to platform_driver::remove_new() callback
        irqchip/keystone: Convert to platform_driver::remove_new() callback
        irqchip/imx-irqsteer: Convert to platform_driver::remove_new() callback
        irqchip/imx-intmux: Convert to platform_driver::remove_new() callback
        irqchip/imgpdc: Convert to platform_driver::remove_new() callback
        irqchip: Add StarFive external interrupt controller
        dt-bindings: interrupt-controller: Add starfive,jh8100-intc
        arm64: dts: Add gpio_intc node for Amlogic-T7 SoCs
        irqchip/meson-gpio: Add support for Amlogic-T7 SoCs
        dt-bindings: interrupt-controller: Add support for Amlogic-T7 SoCs
        irqchip/vic: Fix a kernel-doc warning
        genirq: Wake interrupt threads immediately when changing affinity
        ...
      02d4df78
    • Linus Torvalds's avatar
      Merge tag 'cgroup-for-6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup · 045395d8
      Linus Torvalds authored
      Pull cgroup updates from Tejun Heo:
       "A quiet cycle. One trivial doc update patch. Two patches to drop the
        now defunct memory_spread_slab feature from cgroup1 cpuset"
      
      * tag 'cgroup-for-6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup:
        cgroup/cpuset: Mark memory_spread_slab as obsolete
        cgroup/cpuset: Remove cpuset_do_slab_mem_spread()
        docs: cgroup-v1: add missing code-block tags
      045395d8
    • Linus Torvalds's avatar
      Merge tag 'wq-for-6.9-bh-conversions' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/wq · 1a1e0989
      Linus Torvalds authored
      Pull workqueue BH conversions from Tejun Heo:
       "This contains two patches that convert tasklet users to BH workqueues:
        backtracetest and usb hcd.
      
        DM conversions are being routed through the respective subsystem tree.
        Hopefully, the next cycle will see a lot more conversions"
      
      * tag 'wq-for-6.9-bh-conversions' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/wq:
        usb: core: hcd: Convert from tasklet to BH workqueue
        backtracetest: Convert from tasklet to BH workqueue
      1a1e0989
    • Linus Torvalds's avatar
      Merge tag 'wq-for-6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/wq · ff887eb0
      Linus Torvalds authored
      Pull workqueue updates from Tejun Heo:
       "This cycle, a lot of workqueue changes including some that are
        significant and invasive.
      
         - During v6.6 cycle, unbound workqueues were updated so that they are
           more topology aware and flexible, which among other things improved
           workqueue behavior on modern multi-L3 CPUs. In the process, commit
           636b927e ("workqueue: Make unbound workqueues to use per-cpu
           pool_workqueues") switched unbound workqueues to use per-CPU
           frontend pool_workqueues as a part of increasing front-back mapping
           flexibility.
      
           An unwelcome side effect of this change was that this made max
           concurrency enforcement per-CPU blowing up the maximum number of
           allowed concurrent executions. I incorrectly assumed that this
           wouldn't cause practical problems as most unbound workqueue users
           are self-regulate max concurrency; however, there definitely are
           which don't (e.g. on IO paths) and the drastic increase in the
           allowed max concurrency led to noticeable perf regressions in some
           use cases.
      
           This is now addressed by separating out max concurrency enforcement
           to a separate struct - wq_node_nr_active - which makes @max_active
           consistently mean system-wide max concurrency regardless of the
           number of CPUs or (finally) NUMA nodes. This is a rather invasive
           and, in places, a bit clunky; however, the clunkiness rises from
           the the inherent requirement to handle the disagreement between the
           execution locality domain and max concurrency enforcement domain on
           some modern machines.
      
           See commit 5797b1c1 ("workqueue: Implement system-wide
           nr_active enforcement for unbound workqueues") for more details.
      
         - BH workqueue support is added.
      
           They are similar to per-CPU workqueues but execute work items in
           the softirq context. This is expected to replace tasklet. However,
           currently, it's missing the ability to disable and enable work
           items which is needed to convert many tasklet users. To avoid
           crowding this merge window too much, this will be included in the
           next merge window. A separate pull request will be sent for the
           couple conversion patches that are currently pending.
      
         - Waiman plugged a long-standing hole in workqueue CPU isolation
           where ordered workqueues didn't follow wq_unbound_cpumask updates.
           Ordered workqueues now follow the same rules as other unbound
           workqueues.
      
         - More CPU isolation improvements: Juri fixed another deficit in
           workqueue isolation where unbound rescuers don't respect
           wq_unbound_cpumask. Leonardo fixed delayed_work timers firing on
           isolated CPUs.
      
         - Other misc changes"
      
      * tag 'wq-for-6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/wq: (54 commits)
        workqueue: Drain BH work items on hot-unplugged CPUs
        workqueue: Introduce from_work() helper for cleaner callback declarations
        workqueue: Control intensive warning threshold through cmdline
        workqueue: Make @flags handling consistent across set_work_data() and friends
        workqueue: Remove clear_work_data()
        workqueue: Factor out work_grab_pending() from __cancel_work_sync()
        workqueue: Clean up enum work_bits and related constants
        workqueue: Introduce work_cancel_flags
        workqueue: Use variable name irq_flags for saving local irq flags
        workqueue: Reorganize flush and cancel[_sync] functions
        workqueue: Rename __cancel_work_timer() to __cancel_timer_sync()
        workqueue: Use rcu_read_lock_any_held() instead of rcu_read_lock_held()
        workqueue: Cosmetic changes
        workqueue, irq_work: Build fix for !CONFIG_IRQ_WORK
        workqueue: Fix queue_work_on() with BH workqueues
        async: Use a dedicated unbound workqueue with raised min_active
        workqueue: Implement workqueue_set_min_active()
        workqueue: Fix kernel-doc comment of unplug_oldest_pwq()
        workqueue: Bind unbound workqueue rescuer to wq_unbound_cpumask
        kernel/workqueue: Let rescuers follow unbound wq cpumask changes
        ...
      ff887eb0
    • Linus Torvalds's avatar
      Merge tag 'rust-6.9' of https://github.com/Rust-for-Linux/linux · 8ede842f
      Linus Torvalds authored
      Pull Rust updates from Miguel Ojeda:
       "Another routine one in terms of features. We got two version upgrades
        this time, but in terms of lines, 'alloc' changes are not very large.
      
        Toolchain and infrastructure:
      
         - Upgrade to Rust 1.76.0
      
           This time around, due to how the kernel and Rust schedules have
           aligned, there are two upgrades in fact. These allow us to remove
           two more unstable features ('const_maybe_uninit_zeroed' and
           'ptr_metadata') from the list, among other improvements
      
         - Mark 'rustc' (and others) invocations as recursive, which fixes a
           new warning and prepares us for the future in case we eventually
           take advantage of the Make jobserver
      
        'kernel' crate:
      
         - Add the 'container_of!' macro
      
         - Stop using the unstable 'ptr_metadata' feature by employing the now
           stable 'byte_sub' method to implement 'Arc::from_raw()'
      
         - Add the 'time' module with a 'msecs_to_jiffies()' conversion
           function to begin with, to be used by Rust Binder
      
         - Add 'notify_sync()' and 'wait_interruptible_timeout()' methods to
           'CondVar', to be used by Rust Binder
      
         - Update integer types for 'CondVar'
      
         - Rename 'wait_list' field to 'wait_queue_head' in 'CondVar'
      
         - Implement 'Display' and 'Debug' for 'BStr'
      
         - Add the 'try_from_foreign()' method to the 'ForeignOwnable' trait
      
         - Add reexports for macros so that they can be used from the right
           module (in addition to the root)
      
         - A series of code documentation improvements, including adding
           intra-doc links, consistency improvements, typo fixes...
      
        'macros' crate:
      
         - Place generated 'init_module()' function in '.init.text'
      
        Documentation:
      
         - Add documentation on Rust doctests and how they work"
      
      * tag 'rust-6.9' of https://github.com/Rust-for-Linux/linux: (29 commits)
        rust: upgrade to Rust 1.76.0
        kbuild: mark `rustc` (and others) invocations as recursive
        rust: add `container_of!` macro
        rust: str: implement `Display` and `Debug` for `BStr`
        rust: module: place generated init_module() function in .init.text
        rust: types: add `try_from_foreign()` method
        docs: rust: Add description of Rust documentation test as KUnit ones
        docs: rust: Move testing to a separate page
        rust: kernel: stop using ptr_metadata feature
        rust: kernel: add reexports for macros
        rust: locked_by: shorten doclink preview
        rust: kernel: remove unneeded doclink targets
        rust: kernel: add doclinks
        rust: kernel: add blank lines in front of code blocks
        rust: kernel: mark code fragments in docs with backticks
        rust: kernel: unify spelling of refcount in docs
        rust: str: move SAFETY comment in front of unsafe block
        rust: str: use `NUL` instead of 0 in doc comments
        rust: kernel: add srctree-relative doclinks
        rust: ioctl: end top-level module docs with full stop
        ...
      8ede842f
    • Linus Torvalds's avatar
      Merge tag 'compiler-attributes-6.9' of https://github.com/ojeda/linux · 5a2a15cd
      Linus Torvalds authored
      Pull compiler attributes update from Miguel Ojeda:
       "Trivial fixes to the __counted_by comments"
      
      * tag 'compiler-attributes-6.9' of https://github.com/ojeda/linux:
        Compiler Attributes: counted_by: fixup clang URL
        Compiler Attributes: counted_by: bump min gcc version
      5a2a15cd
    • Linus Torvalds's avatar
      Merge tag 'rcu.next.v6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/boqun/linux · e5a3878c
      Linus Torvalds authored
      Pull RCU updates from Boqun Feng:
      
       - Eliminate deadlocks involving do_exit() and RCU tasks, by Paul:
         Instead of SRCU read side critical sections, now a percpu list is
         used in do_exit() for scaning yet-to-exit tasks
      
       - Fix a deadlock due to the dependency between workqueue and RCU
         expedited grace period, reported by Anna-Maria Behnsen and Thomas
         Gleixner and fixed by Frederic: Now RCU expedited always uses its own
         kthread worker instead of a workqueue
      
       - RCU NOCB updates, code cleanups, unnecessary barrier removals and
         minor bug fixes
      
       - Maintain real-time response in rcu_tasks_postscan() and a minor fix
         for tasks trace quiescence check
      
       - Misc updates, comments and readibility improvement, boot time
         parameter for lazy RCU and rcutorture improvement
      
       - Documentation updates
      
      * tag 'rcu.next.v6.9' of git://git.kernel.org/pub/scm/linux/kernel/git/boqun/linux: (34 commits)
        rcu-tasks: Maintain real-time response in rcu_tasks_postscan()
        rcu-tasks: Eliminate deadlocks involving do_exit() and RCU tasks
        rcu-tasks: Maintain lists to eliminate RCU-tasks/do_exit() deadlocks
        rcu-tasks: Initialize data to eliminate RCU-tasks/do_exit() deadlocks
        rcu-tasks: Initialize callback lists at rcu_init() time
        rcu-tasks: Add data to eliminate RCU-tasks/do_exit() deadlocks
        rcu-tasks: Repair RCU Tasks Trace quiescence check
        rcu/sync: remove un-used rcu_sync_enter_start function
        rcutorture: Suppress rtort_pipe_count warnings until after stalls
        srcu: Improve comments about acceleration leak
        rcu: Provide a boot time parameter to control lazy RCU
        rcu: Rename jiffies_till_flush to jiffies_lazy_flush
        doc: Update checklist.rst discussion of callback execution
        doc: Clarify use of slab constructors and SLAB_TYPESAFE_BY_RCU
        context_tracking: Fix kerneldoc headers for __ct_user_{enter,exit}()
        doc: Add EARLY flag to early-parsed kernel boot parameters
        doc: Add CONFIG_RCU_STRICT_GRACE_PERIOD to checklist.rst
        doc: Make checklist.rst note that spinlocks are implied RCU readers
        doc: Make whatisRCU.rst note that spinlocks are RCU readers
        doc: Spinlocks are implied RCU readers
        ...
      e5a3878c
    • Linus Torvalds's avatar
      Merge tag 'for-6.9/block-20240310' of git://git.kernel.dk/linux · 1ddeeb2a
      Linus Torvalds authored
      Pull block updates from Jens Axboe:
      
       - MD pull requests via Song:
            - Cleanup redundant checks (Yu Kuai)
            - Remove deprecated headers (Marc Zyngier, Song Liu)
            - Concurrency fixes (Li Lingfeng)
            - Memory leak fix (Li Nan)
            - Refactor raid1 read_balance (Yu Kuai, Paul Luse)
            - Clean up and fix for md_ioctl (Li Nan)
            - Other small fixes (Gui-Dong Han, Heming Zhao)
            - MD atomic limits (Christoph)
      
       - NVMe pull request via Keith:
            - RDMA target enhancements (Max)
            - Fabrics fixes (Max, Guixin, Hannes)
            - Atomic queue_limits usage (Christoph)
            - Const use for class_register (Ricardo)
            - Identification error handling fixes (Shin'ichiro, Keith)
      
       - Improvement and cleanup for cached request handling (Christoph)
      
       - Moving towards atomic queue limits. Core changes and driver bits so
         far (Christoph)
      
       - Fix UAF issues in aoeblk (Chun-Yi)
      
       - Zoned fix and cleanups (Damien)
      
       - s390 dasd cleanups and fixes (Jan, Miroslav)
      
       - Block issue timestamp caching (me)
      
       - noio scope guarding for zoned IO (Johannes)
      
       - block/nvme PI improvements (Kanchan)
      
       - Ability to terminate long running discard loop (Keith)
      
       - bdev revalidation fix (Li)
      
       - Get rid of old nr_queues hack for kdump kernels (Ming)
      
       - Support for async deletion of ublk (Ming)
      
       - Improve IRQ bio recycling (Pavel)
      
       - Factor in CPU capacity for remote vs local completion (Qais)
      
       - Add shared_tags configfs entry for null_blk (Shin'ichiro
      
       - Fix for a regression in page refcounts introduced by the folio
         unification (Tony)
      
       - Misc fixes and cleanups (Arnd, Colin, John, Kunwu, Li, Navid,
         Ricardo, Roman, Tang, Uwe)
      
      * tag 'for-6.9/block-20240310' of git://git.kernel.dk/linux: (221 commits)
        block: partitions: only define function mac_fix_string for CONFIG_PPC_PMAC
        block/swim: Convert to platform remove callback returning void
        cdrom: gdrom: Convert to platform remove callback returning void
        block: remove disk_stack_limits
        md: remove mddev->queue
        md: don't initialize queue limits
        md/raid10: use the atomic queue limit update APIs
        md/raid5: use the atomic queue limit update APIs
        md/raid1: use the atomic queue limit update APIs
        md/raid0: use the atomic queue limit update APIs
        md: add queue limit helpers
        md: add a mddev_is_dm helper
        md: add a mddev_add_trace_msg helper
        md: add a mddev_trace_remap helper
        bcache: move calculation of stripe_size and io_opt into bcache_device_init
        virtio_blk: Do not use disk_set_max_open/active_zones()
        aoe: fix the potential use-after-free problem in aoecmd_cfg_pkts
        block: move capacity validation to blkpg_do_ioctl()
        block: prevent division by zero in blk_rq_stat_sum()
        drbd: atomically update queue limits in drbd_reconsider_queue_parameters
        ...
      1ddeeb2a
    • Linus Torvalds's avatar
      Merge tag 'for-6.9/io_uring-20240310' of git://git.kernel.dk/linux · d2c84bdc
      Linus Torvalds authored
      Pull io_uring updates from Jens Axboe:
      
       - Make running of task_work internal loops more fair, and unify how the
         different methods deal with them (me)
      
       - Support for per-ring NAPI. The two minor networking patches are in a
         shared branch with netdev (Stefan)
      
       - Add support for truncate (Tony)
      
       - Export SQPOLL utilization stats (Xiaobing)
      
       - Multishot fixes (Pavel)
      
       - Fix for a race in manipulating the request flags via poll (Pavel)
      
       - Cleanup the multishot checking by making it generic, moving it out of
         opcode handlers (Pavel)
      
       - Various tweaks and cleanups (me, Kunwu, Alexander)
      
      * tag 'for-6.9/io_uring-20240310' of git://git.kernel.dk/linux: (53 commits)
        io_uring: Fix sqpoll utilization check racing with dying sqpoll
        io_uring/net: dedup io_recv_finish req completion
        io_uring: refactor DEFER_TASKRUN multishot checks
        io_uring: fix mshot io-wq checks
        io_uring/net: add io_req_msg_cleanup() helper
        io_uring/net: simplify msghd->msg_inq checking
        io_uring/kbuf: rename REQ_F_PARTIAL_IO to REQ_F_BL_NO_RECYCLE
        io_uring/net: remove dependency on REQ_F_PARTIAL_IO for sr->done_io
        io_uring/net: correctly handle multishot recvmsg retry setup
        io_uring/net: clear REQ_F_BL_EMPTY in the multishot retry handler
        io_uring: fix io_queue_proc modifying req->flags
        io_uring: fix mshot read defer taskrun cqe posting
        io_uring/net: fix overflow check in io_recvmsg_mshot_prep()
        io_uring/net: correct the type of variable
        io_uring/sqpoll: statistics of the true utilization of sq threads
        io_uring/net: move recv/recvmsg flags out of retry loop
        io_uring/kbuf: flag request if buffer pool is empty after buffer pick
        io_uring/net: improve the usercopy for sendmsg/recvmsg
        io_uring/net: move receive multishot out of the generic msghdr path
        io_uring/net: unify how recvmsg and sendmsg copy in the msghdr
        ...
      d2c84bdc
    • Linus Torvalds's avatar
      Merge tag 'vfs-6.9.uuid' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs · 0f1a8766
      Linus Torvalds authored
      Pull vfs uuid updates from Christian Brauner:
       "This adds two new ioctl()s for getting the filesystem uuid and
        retrieving the sysfs path based on the path of a mounted filesystem.
        Getting the filesystem uuid has been implemented in filesystem
        specific code for a while it's now lifted as a generic ioctl"
      
      * tag 'vfs-6.9.uuid' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs:
        xfs: add support for FS_IOC_GETFSSYSFSPATH
        fs: add FS_IOC_GETFSSYSFSPATH
        fat: Hook up sb->s_uuid
        fs: FS_IOC_GETUUID
        ovl: convert to super_set_uuid()
        fs: super_set_uuid()
      0f1a8766
    • Linus Torvalds's avatar
      Merge tag 'vfs-6.9.super' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs · 910202f0
      Linus Torvalds authored
      Pull block handle updates from Christian Brauner:
       "Last cycle we changed opening of block devices, and opening a block
        device would return a bdev_handle. This allowed us to implement
        support for restricting and forbidding writes to mounted block
        devices. It was accompanied by converting and adding helpers to
        operate on bdev_handles instead of plain block devices.
      
        That was already a good step forward but ultimately it isn't necessary
        to have special purpose helpers for opening block devices internally
        that return a bdev_handle.
      
        Fundamentally, opening a block device internally should just be
        equivalent to opening files. So now all internal opens of block
        devices return files just as a userspace open would. Instead of
        introducing a separate indirection into bdev_open_by_*() via struct
        bdev_handle bdev_file_open_by_*() is made to just return a struct
        file. Opening and closing a block device just becomes equivalent to
        opening and closing a file.
      
        This all works well because internally we already have a pseudo fs for
        block devices and so opening block devices is simple. There's a few
        places where we needed to be careful such as during boot when the
        kernel is supposed to mount the rootfs directly without init doing it.
        Here we need to take care to ensure that we flush out any asynchronous
        file close. That's what we already do for opening, unpacking, and
        closing the initramfs. So nothing new here.
      
        The equivalence of opening and closing block devices to regular files
        is a win in and of itself. But it also has various other advantages.
        We can remove struct bdev_handle completely. Various low-level helpers
        are now private to the block layer. Other helpers were simply
        removable completely.
      
        A follow-up series that is already reviewed build on this and makes it
        possible to remove bdev->bd_inode and allows various clean ups of the
        buffer head code as well. All places where we stashed a bdev_handle
        now just stash a file and use simple accessors to get to the actual
        block device which was already the case for bdev_handle"
      
      * tag 'vfs-6.9.super' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs: (35 commits)
        block: remove bdev_handle completely
        block: don't rely on BLK_OPEN_RESTRICT_WRITES when yielding write access
        bdev: remove bdev pointer from struct bdev_handle
        bdev: make struct bdev_handle private to the block layer
        bdev: make bdev_{release, open_by_dev}() private to block layer
        bdev: remove bdev_open_by_path()
        reiserfs: port block device access to file
        ocfs2: port block device access to file
        nfs: port block device access to files
        jfs: port block device access to file
        f2fs: port block device access to files
        ext4: port block device access to file
        erofs: port device access to file
        btrfs: port device access to file
        bcachefs: port block device access to file
        target: port block device access to file
        s390: port block device access to file
        nvme: port block device access to file
        block2mtd: port device access to files
        bcache: port block device access to files
        ...
      910202f0
    • Linus Torvalds's avatar
      Merge tag 'vfs-6.9.file' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs · 0c750012
      Linus Torvalds authored
      Pull file locking updates from Christian Brauner:
       "A few years ago struct file_lock_context was added to allow for
        separate lists to track different types of file locks instead of using
        a singly-linked list for all of them.
      
        Now leases no longer need to be tracked using struct file_lock.
        However, a lot of the infrastructure is identical for leases and locks
        so separating them isn't trivial.
      
        This splits a group of fields used by both file locks and leases into
        a new struct file_lock_core. The new core struct is embedded in struct
        file_lock. Coccinelle was used to convert a lot of the callers to deal
        with the move, with the remaining 25% or so converted by hand.
      
        Afterwards several internal functions in fs/locks.c are made to work
        with struct file_lock_core. Ultimately this allows to split struct
        file_lock into struct file_lock and struct file_lease. The file lease
        APIs are then converted to take struct file_lease"
      
      * tag 'vfs-6.9.file' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs: (51 commits)
        filelock: fix deadlock detection in POSIX locking
        filelock: always define for_each_file_lock()
        smb: remove redundant check
        filelock: don't do security checks on nfsd setlease calls
        filelock: split leases out of struct file_lock
        filelock: remove temporary compatibility macros
        smb/server: adapt to breakup of struct file_lock
        smb/client: adapt to breakup of struct file_lock
        ocfs2: adapt to breakup of struct file_lock
        nfsd: adapt to breakup of struct file_lock
        nfs: adapt to breakup of struct file_lock
        lockd: adapt to breakup of struct file_lock
        fuse: adapt to breakup of struct file_lock
        gfs2: adapt to breakup of struct file_lock
        dlm: adapt to breakup of struct file_lock
        ceph: adapt to breakup of struct file_lock
        afs: adapt to breakup of struct file_lock
        9p: adapt to breakup of struct file_lock
        filelock: convert seqfile handling to use file_lock_core
        filelock: convert locks_translate_pid to take file_lock_core
        ...
      0c750012
    • Linus Torvalds's avatar
      Merge tag 'vfs-6.9.pidfd' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs · b5683a37
      Linus Torvalds authored
      Pull pdfd updates from Christian Brauner:
      
       - Until now pidfds could only be created for thread-group leaders but
         not for threads. There was no technical reason for this. We simply
         had no users that needed support for this. Now we do have users that
         need support for this.
      
         This introduces a new PIDFD_THREAD flag for pidfd_open(). If that
         flag is set pidfd_open() creates a pidfd that refers to a specific
         thread.
      
         In addition, we now allow clone() and clone3() to be called with
         CLONE_PIDFD | CLONE_THREAD which wasn't possible before.
      
         A pidfd that refers to an individual thread differs from a pidfd that
         refers to a thread-group leader:
      
          (1) Pidfds are pollable. A task may poll a pidfd and get notified
              when the task has exited.
      
              For thread-group leader pidfds the polling task is woken if the
              thread-group is empty. In other words, if the thread-group
              leader task exits when there are still threads alive in its
              thread-group the polling task will not be woken when the
              thread-group leader exits but rather when the last thread in the
              thread-group exits.
      
              For thread-specific pidfds the polling task is woken if the
              thread exits.
      
          (2) Passing a thread-group leader pidfd to pidfd_send_signal() will
              generate thread-group directed signals like kill(2) does.
      
              Passing a thread-specific pidfd to pidfd_send_signal() will
              generate thread-specific signals like tgkill(2) does.
      
              The default scope of the signal is thus determined by the type
              of the pidfd.
      
              Since use-cases exist where the default scope of the provided
              pidfd needs to be overriden the following flags are added to
              pidfd_send_signal():
      
               - PIDFD_SIGNAL_THREAD
                 Send a thread-specific signal.
      
               - PIDFD_SIGNAL_THREAD_GROUP
                 Send a thread-group directed signal.
      
               - PIDFD_SIGNAL_PROCESS_GROUP
                 Send a process-group directed signal.
      
              The scope change will only work if the struct pid is actually
              used for this scope.
      
              For example, in order to send a thread-group directed signal the
              provided pidfd must be used as a thread-group leader and
              similarly for PIDFD_SIGNAL_PROCESS_GROUP the struct pid must be
              used as a process group leader.
      
       - Move pidfds from the anonymous inode infrastructure to a tiny pseudo
         filesystem. This will unblock further work that we weren't able to do
         simply because of the very justified limitations of anonymous inodes.
         Moving pidfds to a tiny pseudo filesystem allows for statx on pidfds
         to become useful for the first time. They can now be compared by
         inode number which are unique for the system lifetime.
      
         Instead of stashing struct pid in file->private_data we can now stash
         it in inode->i_private. This makes it possible to introduce concepts
         that operate on a process once all file descriptors have been closed.
         A concrete example is kill-on-last-close. Another side-effect is that
         file->private_data is now freed up for per-file options for pidfds.
      
         Now, each struct pid will refer to a different inode but the same
         struct pid will refer to the same inode if it's opened multiple
         times. In contrast to now where each struct pid refers to the same
         inode.
      
         The tiny pseudo filesystem is not visible anywhere in userspace
         exactly like e.g., pipefs and sockfs. There's no lookup, there's no
         complex inode operations, nothing. Dentries and inodes are always
         deleted when the last pidfd is closed.
      
         We allocate a new inode and dentry for each struct pid and we reuse
         that inode and dentry for all pidfds that refer to the same struct
         pid. The code is entirely optional and fairly small. If it's not
         selected we fallback to anonymous inodes. Heavily inspired by nsfs.
      
         The dentry and inode allocation mechanism is moved into generic
         infrastructure that is now shared between nsfs and pidfs. The
         path_from_stashed() helper must be provided with a stashing location,
         an inode number, a mount, and the private data that is supposed to be
         used and it will provide a path that can be passed to dentry_open().
      
         The helper will try retrieve an existing dentry from the provided
         stashing location. If a valid dentry is found it is reused. If not a
         new one is allocated and we try to stash it in the provided location.
         If this fails we retry until we either find an existing dentry or the
         newly allocated dentry could be stashed. Subsequent openers of the
         same namespace or task are then able to reuse it.
      
       - Currently it is only possible to get notified when a task has exited,
         i.e., become a zombie and userspace gets notified with EPOLLIN. We
         now also support waiting until the task has been reaped, notifying
         userspace with EPOLLHUP.
      
       - Ensure that ESRCH is reported for getfd if a task is exiting instead
         of the confusing EBADF.
      
       - Various smaller cleanups to pidfd functions.
      
      * tag 'vfs-6.9.pidfd' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs: (23 commits)
        libfs: improve path_from_stashed()
        libfs: add stashed_dentry_prune()
        libfs: improve path_from_stashed() helper
        pidfs: convert to path_from_stashed() helper
        nsfs: convert to path_from_stashed() helper
        libfs: add path_from_stashed()
        pidfd: add pidfs
        pidfd: move struct pidfd_fops
        pidfd: allow to override signal scope in pidfd_send_signal()
        pidfd: change pidfd_send_signal() to respect PIDFD_THREAD
        signal: fill in si_code in prepare_kill_siginfo()
        selftests: add ESRCH tests for pidfd_getfd()
        pidfd: getfd should always report ESRCH if a task is exiting
        pidfd: clone: allow CLONE_THREAD | CLONE_PIDFD together
        pidfd: exit: kill the no longer used thread_group_exited()
        pidfd: change do_notify_pidfd() to use __wake_up(poll_to_key(EPOLLIN))
        pid: kill the obsolete PIDTYPE_PID code in transfer_pid()
        pidfd: kill the no longer needed do_notify_pidfd() in de_thread()
        pidfd_poll: report POLLHUP when pid_task() == NULL
        pidfd: implement PIDFD_THREAD flag for pidfd_open()
        ...
      b5683a37
    • Linus Torvalds's avatar
      Merge tag 'vfs-6.9.iomap' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs · 54126faf
      Linus Torvalds authored
      Pull iomap updates from Christian Brauner:
      
       - Restore read-write hints in struct bio through the bi_write_hint
         member for the sake of UFS devices in mobile applications. This can
         result in up to 40% lower write amplification in UFS devices. The
         patch series that builds on this will be coming in via the SCSI
         maintainers (Bart)
      
       - Overhaul the iomap writeback code. Afterwards ->map_blocks() is able
         to map multiple blocks at once as long as they're in the same folio.
         This reduces CPU usage for buffered write workloads on e.g., xfs on
         systems with lots of cores (Christoph)
      
       - Record processed bytes in iomap_iter() trace event (Kassey)
      
       - Extend iomap_writepage_map() trace event after Christoph's
         ->map_block() changes to map mutliple blocks at once (Zhang)
      
      * tag 'vfs-6.9.iomap' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs: (22 commits)
        iomap: Add processed for iomap_iter
        iomap: add pos and dirty_len into trace_iomap_writepage_map
        block, fs: Restore the per-bio/request data lifetime fields
        fs: Propagate write hints to the struct block_device inode
        fs: Move enum rw_hint into a new header file
        fs: Split fcntl_rw_hint()
        fs: Verify write lifetime constants at compile time
        fs: Fix rw_hint validation
        iomap: pass the length of the dirty region to ->map_blocks
        iomap: map multiple blocks at a time
        iomap: submit ioends immediately
        iomap: factor out a iomap_writepage_map_block helper
        iomap: only call mapping_set_error once for each failed bio
        iomap: don't chain bios
        iomap: move the iomap_sector sector calculation out of iomap_add_to_ioend
        iomap: clean up the iomap_alloc_ioend calling convention
        iomap: move all remaining per-folio logic into iomap_writepage_map
        iomap: factor out a iomap_writepage_handle_eof helper
        iomap: move the PF_MEMALLOC check to iomap_writepages
        iomap: move the io_folios field out of struct iomap_ioend
        ...
      54126faf