• Uladzislau Rezki (Sony)'s avatar
    mm: vmalloc: offload free_vmap_area_lock lock · 72210662
    Uladzislau Rezki (Sony) authored
    Concurrent access to a global vmap space is a bottle-neck.  We can
    simulate a high contention by running a vmalloc test suite.
    
    To address it, introduce an effective vmap node logic.  Each node behaves
    as independent entity.  When a node is accessed it serves a request
    directly(if possible) from its pool.
    
    This model has a size based pool for requests, i.e.  pools are serialized
    and populated based on object size and real demand.  A maximum object size
    that pool can handle is set to 256 pages.
    
    This technique reduces a pressure on the global vmap lock.
    
    Link: https://lkml.kernel.org/r/20240102184633.748113-8-urezki@gmail.comSigned-off-by: default avatarUladzislau Rezki (Sony) <urezki@gmail.com>
    Cc: Baoquan He <bhe@redhat.com>
    Cc: Christoph Hellwig <hch@lst.de>
    Cc: Dave Chinner <david@fromorbit.com>
    Cc: Joel Fernandes (Google) <joel@joelfernandes.org>
    Cc: Kazuhito Hagio <k-hagio-ab@nec.com>
    Cc: Liam R. Howlett <Liam.Howlett@oracle.com>
    Cc: Lorenzo Stoakes <lstoakes@gmail.com>
    Cc: Matthew Wilcox (Oracle) <willy@infradead.org>
    Cc: Oleksiy Avramchenko <oleksiy.avramchenko@sony.com>
    Cc: Paul E. McKenney <paulmck@kernel.org>
    Signed-off-by: default avatarAndrew Morton <akpm@linux-foundation.org>
    72210662
vmalloc.c 126 KB