• Joao Martins's avatar
    hugetlb: batch PMD split for bulk vmemmap dedup · f4b7e3ef
    Joao Martins authored
    In an effort to minimize amount of TLB flushes, batch all PMD splits
    belonging to a range of pages in order to perform only 1 (global) TLB
    flush.
    
    Add a flags field to the walker and pass whether it's a bulk allocation or
    just a single page to decide to remap.  First value
    (VMEMMAP_SPLIT_NO_TLB_FLUSH) designates the request to not do the TLB
    flush when we split the PMD.
    
    Rebased and updated by Mike Kravetz
    
    Link: https://lkml.kernel.org/r/20231019023113.345257-7-mike.kravetz@oracle.comSigned-off-by: default avatarJoao Martins <joao.m.martins@oracle.com>
    Signed-off-by: default avatarMike Kravetz <mike.kravetz@oracle.com>
    Reviewed-by: default avatarMuchun Song <songmuchun@bytedance.com>
    Cc: Anshuman Khandual <anshuman.khandual@arm.com>
    Cc: Barry Song <21cnbao@gmail.com>
    Cc: David Hildenbrand <david@redhat.com>
    Cc: David Rientjes <rientjes@google.com>
    Cc: James Houghton <jthoughton@google.com>
    Cc: Konrad Dybcio <konradybcio@kernel.org>
    Cc: Matthew Wilcox (Oracle) <willy@infradead.org>
    Cc: Miaohe Lin <linmiaohe@huawei.com>
    Cc: Michal Hocko <mhocko@suse.com>
    Cc: Naoya Horiguchi <naoya.horiguchi@linux.dev>
    Cc: Oscar Salvador <osalvador@suse.de>
    Cc: Sergey Senozhatsky <senozhatsky@chromium.org>
    Cc: Usama Arif <usama.arif@bytedance.com>
    Cc: Xiongchun Duan <duanxiongchun@bytedance.com>
    Signed-off-by: default avatarAndrew Morton <akpm@linux-foundation.org>
    f4b7e3ef
hugetlb_vmemmap.c 21.1 KB