Commit ff5bc793 authored by Nicholas Piggin's avatar Nicholas Piggin Committed by Michael Ellerman

powerpc/64s/radix: Fix missing ptesync in flush_cache_vmap

There is a typo in f1cb8f9b ("powerpc/64s/radix: avoid ptesync after
set_pte and ptep_set_access_flags") config ifdef, which results in the
necessary ptesync not being issued after vmalloc.

This causes random kernel faults in module load, bpf load, anywhere
that vmalloc mappings are used.

After correcting the code, this survives a guest kernel booting
hundreds of times where previously there would be a crash every few
boots (I haven't noticed the crash on host, perhaps due to different
TLB and page table walking behaviour in hardware).

A memory clobber is also added to the flush, just to be sure it won't
be reordered with the pte set or the subsequent mapping access.

Fixes: f1cb8f9b ("powerpc/64s/radix: avoid ptesync after set_pte and ptep_set_access_flags")
Signed-off-by: default avatarNicholas Piggin <npiggin@gmail.com>
Signed-off-by: default avatarMichael Ellerman <mpe@ellerman.id.au>
parent 0a4ec6aa
...@@ -23,10 +23,9 @@ ...@@ -23,10 +23,9 @@
#define flush_cache_range(vma, start, end) do { } while (0) #define flush_cache_range(vma, start, end) do { } while (0)
#define flush_cache_page(vma, vmaddr, pfn) do { } while (0) #define flush_cache_page(vma, vmaddr, pfn) do { } while (0)
#define flush_icache_page(vma, page) do { } while (0) #define flush_icache_page(vma, page) do { } while (0)
#define flush_cache_vmap(start, end) do { } while (0)
#define flush_cache_vunmap(start, end) do { } while (0) #define flush_cache_vunmap(start, end) do { } while (0)
#ifdef CONFIG_BOOK3S_64 #ifdef CONFIG_PPC_BOOK3S_64
/* /*
* Book3s has no ptesync after setting a pte, so without this ptesync it's * Book3s has no ptesync after setting a pte, so without this ptesync it's
* possible for a kernel virtual mapping access to return a spurious fault * possible for a kernel virtual mapping access to return a spurious fault
...@@ -34,7 +33,7 @@ ...@@ -34,7 +33,7 @@
* not expect this type of fault. flush_cache_vmap is not exactly the right * not expect this type of fault. flush_cache_vmap is not exactly the right
* place to put this, but it seems to work well enough. * place to put this, but it seems to work well enough.
*/ */
#define flush_cache_vmap(start, end) do { asm volatile("ptesync"); } while (0) #define flush_cache_vmap(start, end) do { asm volatile("ptesync" ::: "memory"); } while (0)
#else #else
#define flush_cache_vmap(start, end) do { } while (0) #define flush_cache_vmap(start, end) do { } while (0)
#endif #endif
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment