Twisting isn't the problems I see on the sleeve hitch adapter. The lack of support on the outside can and will cause the holes to elongate some. The only way I found to cure the problem is to go to support on both sides of your sleeve hitch adapter.
International Harvester design and build a tiller, box blade and a rear blade/rake. All 3 attachments have support on both sides.
Some use a rod that goes between both arms of their sleeve hitch adapter. That helps....rod could bend.