Interesting. The only thing I could think is that your bearings are actually roached and binding, causing the inner race to slip against the spindle.

Have you changed them since this started?