Commit 1f85f87d authored by Arjan van de Ven's avatar Arjan van de Ven Committed by Linus Torvalds

cpuidle: add a repeating pattern detector to the menu governor

Currently, the menu governor uses the (corrected) next timer as key item
for predicting the idle duration.

It turns out that there are specific cases where this breaks down: There
are cases where we have a very repetitive pattern of idle durations, where
the idle period is pretty much the same, for reasons completely unrelated
to the next timer event.  Examples of such repeating patterns are network
loads with irq mitigation, the mouse moving but in theory also the wifi
beacons.

This patch adds a relatively simple detector for such repeating patterns,
where the standard deviation of the last 8 idle periods is compared to a
threshold.

With this extra predictor in place, measurements show that the DECAY
factor can now be increased (the decaying average will now decay slower)
to get an even more stable result.

[arjan@infradead.org: fix bug identified by Frank]
Signed-off-by: default avatarArjan van de Ven <arjan@linux.intel.com>
Cc: Corrado Zoccolo <czoccolo@gmail.com>
Cc: Frank Rowand <frank.rowand@am.sony.com>
Signed-off-by: default avatarAndrew Morton <akpm@linux-foundation.org>
Signed-off-by: default avatarLinus Torvalds <torvalds@linux-foundation.org>
parent 6cdafaae
...@@ -21,9 +21,12 @@ ...@@ -21,9 +21,12 @@
#include <linux/math64.h> #include <linux/math64.h>
#define BUCKETS 12 #define BUCKETS 12
#define INTERVALS 8
#define RESOLUTION 1024 #define RESOLUTION 1024
#define DECAY 4 #define DECAY 8
#define MAX_INTERESTING 50000 #define MAX_INTERESTING 50000
#define STDDEV_THRESH 400
/* /*
* Concepts and ideas behind the menu governor * Concepts and ideas behind the menu governor
...@@ -64,6 +67,16 @@ ...@@ -64,6 +67,16 @@
* indexed based on the magnitude of the expected duration as well as the * indexed based on the magnitude of the expected duration as well as the
* "is IO outstanding" property. * "is IO outstanding" property.
* *
* Repeatable-interval-detector
* ----------------------------
* There are some cases where "next timer" is a completely unusable predictor:
* Those cases where the interval is fixed, for example due to hardware
* interrupt mitigation, but also due to fixed transfer rate devices such as
* mice.
* For this, we use a different predictor: We track the duration of the last 8
* intervals and if the stand deviation of these 8 intervals is below a
* threshold value, we use the average of these intervals as prediction.
*
* Limiting Performance Impact * Limiting Performance Impact
* --------------------------- * ---------------------------
* C states, especially those with large exit latencies, can have a real * C states, especially those with large exit latencies, can have a real
...@@ -104,6 +117,8 @@ struct menu_device { ...@@ -104,6 +117,8 @@ struct menu_device {
unsigned int exit_us; unsigned int exit_us;
unsigned int bucket; unsigned int bucket;
u64 correction_factor[BUCKETS]; u64 correction_factor[BUCKETS];
u32 intervals[INTERVALS];
int interval_ptr;
}; };
...@@ -175,6 +190,42 @@ static u64 div_round64(u64 dividend, u32 divisor) ...@@ -175,6 +190,42 @@ static u64 div_round64(u64 dividend, u32 divisor)
return div_u64(dividend + (divisor / 2), divisor); return div_u64(dividend + (divisor / 2), divisor);
} }
/*
* Try detecting repeating patterns by keeping track of the last 8
* intervals, and checking if the standard deviation of that set
* of points is below a threshold. If it is... then use the
* average of these 8 points as the estimated value.
*/
static void detect_repeating_patterns(struct menu_device *data)
{
int i;
uint64_t avg = 0;
uint64_t stddev = 0; /* contains the square of the std deviation */
/* first calculate average and standard deviation of the past */
for (i = 0; i < INTERVALS; i++)
avg += data->intervals[i];
avg = avg / INTERVALS;
/* if the avg is beyond the known next tick, it's worthless */
if (avg > data->expected_us)
return;
for (i = 0; i < INTERVALS; i++)
stddev += (data->intervals[i] - avg) *
(data->intervals[i] - avg);
stddev = stddev / INTERVALS;
/*
* now.. if stddev is small.. then assume we have a
* repeating pattern and predict we keep doing this.
*/
if (avg && stddev < STDDEV_THRESH)
data->predicted_us = avg;
}
/** /**
* menu_select - selects the next idle state to enter * menu_select - selects the next idle state to enter
* @dev: the CPU * @dev: the CPU
...@@ -218,6 +269,8 @@ static int menu_select(struct cpuidle_device *dev) ...@@ -218,6 +269,8 @@ static int menu_select(struct cpuidle_device *dev)
data->predicted_us = div_round64(data->expected_us * data->correction_factor[data->bucket], data->predicted_us = div_round64(data->expected_us * data->correction_factor[data->bucket],
RESOLUTION * DECAY); RESOLUTION * DECAY);
detect_repeating_patterns(data);
/* /*
* We want to default to C1 (hlt), not to busy polling * We want to default to C1 (hlt), not to busy polling
* unless the timer is happening really really soon. * unless the timer is happening really really soon.
...@@ -310,6 +363,11 @@ static void menu_update(struct cpuidle_device *dev) ...@@ -310,6 +363,11 @@ static void menu_update(struct cpuidle_device *dev)
new_factor = 1; new_factor = 1;
data->correction_factor[data->bucket] = new_factor; data->correction_factor[data->bucket] = new_factor;
/* update the repeating-pattern data */
data->intervals[data->interval_ptr++] = last_idle_us;
if (data->interval_ptr >= INTERVALS)
data->interval_ptr = 0;
} }
/** /**
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment