Commit 2ba06323 authored by David S. Miller's avatar David S. Miller Committed by Greg Kroah-Hartman

sparc64: Handle extremely large kernel TSB range flushes sanely.

[ Upstream commit 849c4987 ]

If the number of pages we are flushing is more than twice the number
of entries in the TSB, just scan the TSB table for matches rather
than probing each and every page in the range.

Based upon a patch and report by James Clarke.
Signed-off-by: default avatarDavid S. Miller <davem@davemloft.net>
Signed-off-by: default avatarGreg Kroah-Hartman <gregkh@linuxfoundation.org>
parent 75931800
...@@ -27,6 +27,20 @@ static inline int tag_compare(unsigned long tag, unsigned long vaddr) ...@@ -27,6 +27,20 @@ static inline int tag_compare(unsigned long tag, unsigned long vaddr)
return (tag == (vaddr >> 22)); return (tag == (vaddr >> 22));
} }
static void flush_tsb_kernel_range_scan(unsigned long start, unsigned long end)
{
unsigned long idx;
for (idx = 0; idx < KERNEL_TSB_NENTRIES; idx++) {
struct tsb *ent = &swapper_tsb[idx];
unsigned long match = idx << 13;
match |= (ent->tag << 22);
if (match >= start && match < end)
ent->tag = (1UL << TSB_TAG_INVALID_BIT);
}
}
/* TSB flushes need only occur on the processor initiating the address /* TSB flushes need only occur on the processor initiating the address
* space modification, not on each cpu the address space has run on. * space modification, not on each cpu the address space has run on.
* Only the TLB flush needs that treatment. * Only the TLB flush needs that treatment.
...@@ -36,6 +50,9 @@ void flush_tsb_kernel_range(unsigned long start, unsigned long end) ...@@ -36,6 +50,9 @@ void flush_tsb_kernel_range(unsigned long start, unsigned long end)
{ {
unsigned long v; unsigned long v;
if ((end - start) >> PAGE_SHIFT >= 2 * KERNEL_TSB_NENTRIES)
return flush_tsb_kernel_range_scan(start, end);
for (v = start; v < end; v += PAGE_SIZE) { for (v = start; v < end; v += PAGE_SIZE) {
unsigned long hash = tsb_hash(v, PAGE_SHIFT, unsigned long hash = tsb_hash(v, PAGE_SHIFT,
KERNEL_TSB_NENTRIES); KERNEL_TSB_NENTRIES);
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment