Commit 4dac3e98 authored by Christoph Lameter's avatar Christoph Lameter Committed by Tejun Heo

this_cpu: Use this_cpu ops for VM statistics

Using per cpu atomics for the vm statistics reduces their overhead.
And in the case of x86 we are guaranteed that they will never race even
in the lax form used for vm statistics.
Acked-by: default avatarTejun Heo <tj@kernel.org>
Signed-off-by: default avatarChristoph Lameter <cl@linux-foundation.org>
Signed-off-by: default avatarTejun Heo <tj@kernel.org>
parent 0b44f486
...@@ -76,24 +76,22 @@ DECLARE_PER_CPU(struct vm_event_state, vm_event_states); ...@@ -76,24 +76,22 @@ DECLARE_PER_CPU(struct vm_event_state, vm_event_states);
static inline void __count_vm_event(enum vm_event_item item) static inline void __count_vm_event(enum vm_event_item item)
{ {
__get_cpu_var(vm_event_states).event[item]++; __this_cpu_inc(per_cpu_var(vm_event_states).event[item]);
} }
static inline void count_vm_event(enum vm_event_item item) static inline void count_vm_event(enum vm_event_item item)
{ {
get_cpu_var(vm_event_states).event[item]++; this_cpu_inc(per_cpu_var(vm_event_states).event[item]);
put_cpu();
} }
static inline void __count_vm_events(enum vm_event_item item, long delta) static inline void __count_vm_events(enum vm_event_item item, long delta)
{ {
__get_cpu_var(vm_event_states).event[item] += delta; __this_cpu_add(per_cpu_var(vm_event_states).event[item], delta);
} }
static inline void count_vm_events(enum vm_event_item item, long delta) static inline void count_vm_events(enum vm_event_item item, long delta)
{ {
get_cpu_var(vm_event_states).event[item] += delta; this_cpu_add(per_cpu_var(vm_event_states).event[item], delta);
put_cpu();
} }
extern void all_vm_events(unsigned long *); extern void all_vm_events(unsigned long *);
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment