After the GPIO driver move, some symbols became selectable when they
shouldn't be.  Tighten the dependencies.
Reported-by: Randy Dunlap <rdunlap@xenotime.net>
Signed-off-by: Grant Likely <grant.likely@secretlab.ca>