The device is generally not succeptible to the issues that cause this to
be an issue.
Signed-off-by: Mark Brown <broonie@opensource.wolfsonmicro.com>