I'm inclined to think it's one of your ball joints. You should be able to move them when they're not attached to the knuckle. They'll be tight, but should move by hand. If not, they could be binding up and freeing up only when under a heavy load, meaning moisture got in and everything is corroded. And I know I don't have to explain how dangerous bad ball joints can be.