Well since I'm on my second rum and coke, I think I should respond
If I understand you correctly, then yes. That should be a fastener you can find at a decently stocked hardware store.
Are you not able to bend that bracket in a way that keeps your chain aligned, and still get's it in to where you need it? I would try that first, if it's an option.