Thats what I thought. I don't have a jig saw, but I have a keyhole hacksaw and some files.
I saw this KORE Downhill frame stay mounted roller on another thread . Its high, but cheaper than a new wheel.
Chain Tensioner - Kore Silver - Choppers U.S., LLC
Update: This did not work as a singlespeed tensioner on either side.