[Yosemite Sam]

Your gut is probably right Chris.

The yoke where it contacts the shift collar will wear, the pin hole in the yoke and the pin can also wear and the hole in the handle can wear as well.

Some of these points can wear naturally but more often the wear is caused from the lever being forced. It usually takes years of use for this wear to be noticeable from the operators seat.