Commit 12adfd88 authored by Chris Wilson's avatar Chris Wilson Committed by Paul E. McKenney

list: Expand list_first_entry_or_null()

Due to the use of READ_ONCE() in list_empty() the compiler cannot
optimise !list_empty() ? list_first_entry() : NULL very well. By
manually expanding list_first_entry_or_null() we can take advantage of
the READ_ONCE() to avoid the list element changing under the test while
the compiler can generate smaller code.
Signed-off-by: default avatarChris Wilson <chris@chris-wilson.co.uk>
Cc: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Dan Williams <dan.j.williams@intel.com>
Cc: Jan Kara <jack@suse.cz>
Cc: Josef Bacik <jbacik@fb.com>
Cc: linux-kernel@vger.kernel.org
Signed-off-by: default avatarPaul E. McKenney <paulmck@linux.vnet.ibm.com>
parent 3563a438
...@@ -381,8 +381,11 @@ static inline void list_splice_tail_init(struct list_head *list, ...@@ -381,8 +381,11 @@ static inline void list_splice_tail_init(struct list_head *list,
* *
* Note that if the list is empty, it returns NULL. * Note that if the list is empty, it returns NULL.
*/ */
#define list_first_entry_or_null(ptr, type, member) \ #define list_first_entry_or_null(ptr, type, member) ({ \
(!list_empty(ptr) ? list_first_entry(ptr, type, member) : NULL) struct list_head *head__ = (ptr); \
struct list_head *pos__ = READ_ONCE(head__->next); \
pos__ != head__ ? list_entry(pos__, type, member) : NULL; \
})
/** /**
* list_next_entry - get the next element in list * list_next_entry - get the next element in list
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment