Commit ff0ceb9d authored by David Rientjes's avatar David Rientjes Committed by Linus Torvalds

oom: serialize out of memory calls

A final allocation attempt with a very high watermark needs to be attempted
before invoking out_of_memory().  OOM killer serialization needs to occur
before this final attempt, otherwise tasks attempting to OOM-lock all zones in
its zonelist may spin and acquire the lock unnecessarily after the OOM
condition has already been alleviated.

If the final allocation does succeed, the zonelist is simply OOM-unlocked and
__alloc_pages() returns the page.  Otherwise, the OOM killer is invoked.

If the task cannot acquire OOM-locks on all zones in its zonelist, it is put
to sleep and the allocation is retried when it gets rescheduled.  One of its
zones is already marked as being in the OOM killer so it'll hopefully be
getting some free memory soon, at least enough to satisfy a high watermark
allocation attempt.  This prevents needlessly killing a task when the OOM
condition would have already been alleviated if it had simply been given
enough time.

Cc: Andrea Arcangeli <andrea@suse.de>
Acked-by: default avatarChristoph Lameter <clameter@sgi.com>
Signed-off-by: default avatarDavid Rientjes <rientjes@google.com>
Signed-off-by: default avatarAndrew Morton <akpm@linux-foundation.org>
Signed-off-by: default avatarLinus Torvalds <torvalds@linux-foundation.org>
parent 098d7f12
...@@ -1587,6 +1587,11 @@ __alloc_pages(gfp_t gfp_mask, unsigned int order, ...@@ -1587,6 +1587,11 @@ __alloc_pages(gfp_t gfp_mask, unsigned int order,
if (page) if (page)
goto got_pg; goto got_pg;
} else if ((gfp_mask & __GFP_FS) && !(gfp_mask & __GFP_NORETRY)) { } else if ((gfp_mask & __GFP_FS) && !(gfp_mask & __GFP_NORETRY)) {
if (!try_set_zone_oom(zonelist)) {
schedule_timeout_uninterruptible(1);
goto restart;
}
/* /*
* Go through the zonelist yet one more time, keep * Go through the zonelist yet one more time, keep
* very high watermark here, this is only to catch * very high watermark here, this is only to catch
...@@ -1595,14 +1600,19 @@ __alloc_pages(gfp_t gfp_mask, unsigned int order, ...@@ -1595,14 +1600,19 @@ __alloc_pages(gfp_t gfp_mask, unsigned int order,
*/ */
page = get_page_from_freelist(gfp_mask|__GFP_HARDWALL, order, page = get_page_from_freelist(gfp_mask|__GFP_HARDWALL, order,
zonelist, ALLOC_WMARK_HIGH|ALLOC_CPUSET); zonelist, ALLOC_WMARK_HIGH|ALLOC_CPUSET);
if (page) if (page) {
clear_zonelist_oom(zonelist);
goto got_pg; goto got_pg;
}
/* The OOM killer will not help higher order allocs so fail */ /* The OOM killer will not help higher order allocs so fail */
if (order > PAGE_ALLOC_COSTLY_ORDER) if (order > PAGE_ALLOC_COSTLY_ORDER) {
clear_zonelist_oom(zonelist);
goto nopage; goto nopage;
}
out_of_memory(zonelist, gfp_mask, order); out_of_memory(zonelist, gfp_mask, order);
clear_zonelist_oom(zonelist);
goto restart; goto restart;
} }
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment