• Yosry Ahmed's avatar
    mm: vmscan: ignore non-LRU-based reclaim in memcg reclaim · 583c27a1
    Yosry Ahmed authored
    Patch series "Ignore non-LRU-based reclaim in memcg reclaim", v6.
    
    Upon running some proactive reclaim tests using memory.reclaim, we noticed
    some tests flaking where writing to memory.reclaim would be successful
    even though we did not reclaim the requested amount fully Looking further
    into it, I discovered that *sometimes* we overestimate the number of
    reclaimed pages in memcg reclaim.
    
    Reclaimed pages through other means than LRU-based reclaim are tracked
    through reclaim_state in struct scan_control, which is stashed in current
    task_struct.  These pages are added to the number of reclaimed pages
    through LRUs.  For memcg reclaim, these pages generally cannot be linked
    to the memcg under reclaim and can cause an overestimated count of
    reclaimed pages.  This short series tries to address that.
    
    Patch 1 ignores pages reclaimed outside of LRU reclaim in memcg reclaim. 
    The pages are uncharged anyway, so even if we end up under-reporting
    reclaimed pages we will still succeed in making progress during charging.
    
    Patches 2-3 are just refactoring.  Patch 2 moves set_reclaim_state()
    helper next to flush_reclaim_state().  Patch 3 adds a helper that wraps
    updating current->reclaim_state, and renames reclaim_state->reclaimed_slab
    to reclaim_state->reclaimed.
    
    
    This patch (of 3):
    
    We keep track of different types of reclaimed pages through
    reclaim_state->reclaimed_slab, and we add them to the reported number of
    reclaimed pages.  For non-memcg reclaim, this makes sense.  For memcg
    reclaim, we have no clue if those pages are charged to the memcg under
    reclaim.
    
    Slab pages are shared by different memcgs, so a freed slab page may have
    only been partially charged to the memcg under reclaim.  The same goes for
    clean file pages from pruned inodes (on highmem systems) or xfs buffer
    pages, there is no simple way to currently link them to the memcg under
    reclaim.
    
    Stop reporting those freed pages as reclaimed pages during memcg reclaim. 
    This should make the return value of writing to memory.reclaim, and may
    help reduce unnecessary reclaim retries during memcg charging.  Writing to
    memory.reclaim on the root memcg is considered as cgroup_reclaim(), but
    for this case we want to include any freed pages, so use the
    global_reclaim() check instead of !cgroup_reclaim().
    
    Generally, this should make the return value of
    try_to_free_mem_cgroup_pages() more accurate.  In some limited cases (e.g.
    freed a slab page that was mostly charged to the memcg under reclaim),
    the return value of try_to_free_mem_cgroup_pages() can be underestimated,
    but this should be fine.  The freed pages will be uncharged anyway, and we
    can charge the memcg the next time around as we usually do memcg reclaim
    in a retry loop.
    
    Link: https://lkml.kernel.org/r/20230413104034.1086717-1-yosryahmed@google.com
    Link: https://lkml.kernel.org/r/20230413104034.1086717-2-yosryahmed@google.com
    Fixes: f2fe7b09 ("mm: memcg/slab: charge individual slab objects
    instead of pages")
    Signed-off-by: default avatarYosry Ahmed <yosryahmed@google.com>
    Acked-by: default avatarDavid Hildenbrand <david@redhat.com>
    Acked-by: default avatarMichal Hocko <mhocko@suse.com>
    Cc: Alexander Viro <viro@zeniv.linux.org.uk>
    Cc: Christoph Lameter <cl@linux.com>
    Cc: Darrick J. Wong <djwong@kernel.org>
    Cc: Dave Chinner <david@fromorbit.com>
    Cc: David Rientjes <rientjes@google.com>
    Cc: Hyeonggon Yoo <42.hyeyoo@gmail.com>
    Cc: Johannes Weiner <hannes@cmpxchg.org>
    Cc: Joonsoo Kim <iamjoonsoo.kim@lge.com>
    Cc: Matthew Wilcox <willy@infradead.org>
    Cc: Miaohe Lin <linmiaohe@huawei.com>
    Cc: NeilBrown <neilb@suse.de>
    Cc: Peter Xu <peterx@redhat.com>
    Cc: Roman Gushchin <roman.gushchin@linux.dev>
    Cc: Shakeel Butt <shakeelb@google.com>
    Cc: Tim Chen <tim.c.chen@linux.intel.com>
    Cc: Vlastimil Babka <vbabka@suse.cz>
    Cc: Yu Zhao <yuzhao@google.com>
    Signed-off-by: default avatarAndrew Morton <akpm@linux-foundation.org>
    583c27a1
vmscan.c 223 KB