You want some clearance, but, slop bothers some of us!!
On one machine, I got a thick washer and custom bored it so there was a "step" bore in the washer that eliminated the slop.
I had tried a washer before, depending on usage, sometimes thin washers do not last.