I definately wouldn't grind your hub.

Get a brass wire brush for a dremel tool (or for a drill if you don't have a dremel) and go to cleaning that thing (the hub surface) off and see what that does for you.

Or just use some sand paper.