Here is the mods I do to the chain tensioner.
Here is the screwdriver pointing to the sockethead set screw it taped and drilled to hold the tensioner form rotating you will notice I also have a sheet metal screw holding it as well it was used to hold the metal shimms in place.I decided to try both at once and now I don't know why?! the bolt does not go all the way through. threads are taped in the bikes frame and I think its fine threads 1/4-28
in this you can see the metal shims a little better