if you have a coaster brake you can buy a rear sprocket with one more tooth and that should take up the slack.
a chain tensioner won't work well on the pedal side if you have a coaster brake. the force it takes to pedal backwards to stop will loosen it up, and probably twist it into your spokes. that's not good.