• Nicolai Hähnle's avatar
    locking/ww_mutex: Optimize ww-mutexes by waking at most one waiter for backoff... · 659cf9f5
    Nicolai Hähnle authored
    locking/ww_mutex: Optimize ww-mutexes by waking at most one waiter for backoff when acquiring the lock
    
    The wait list is sorted by stamp order, and the only waiting task that may
    have to back off is the first waiter with a context.
    
    The regular slow path does not have to wake any other tasks at all, since
    all other waiters that would have to back off were either woken up when
    the waiter was added to the list, or detected the condition before they
    added themselves.
    
    Median timings taken of a contention-heavy GPU workload:
    
    Without this series:
    
      real    0m59.900s
      user    0m7.516s
      sys     2m16.076s
    
    With changes up to and including this patch:
    
      real    0m52.946s
      user    0m7.272s
      sys     1m55.964s
    Signed-off-by: default avatarNicolai Hähnle <Nicolai.Haehnle@amd.com>
    Signed-off-by: default avatarPeter Zijlstra (Intel) <peterz@infradead.org>
    Cc: Andrew Morton <akpm@linux-foundation.org>
    Cc: Chris Wilson <chris@chris-wilson.co.uk>
    Cc: Daniel Vetter <daniel@ffwll.ch>
    Cc: Linus Torvalds <torvalds@linux-foundation.org>
    Cc: Maarten Lankhorst <dev@mblankhorst.nl>
    Cc: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
    Cc: Peter Zijlstra <peterz@infradead.org>
    Cc: Thomas Gleixner <tglx@linutronix.de>
    Cc: dri-devel@lists.freedesktop.org
    Link: http://lkml.kernel.org/r/1482346000-9927-9-git-send-email-nhaehnle@gmail.comSigned-off-by: default avatarIngo Molnar <mingo@kernel.org>
    659cf9f5
mutex.c 29.3 KB