Numpy was hitting this a lot

I love optimizing things we haven't approached before.  This small change
improved numpy.test() performance by 20%.