Just be careful not to OVER tighten things, specifically anything that is aluminum. The nut on the drive sprocket is one thing that can be tightened really good, cause none of the parts are aluminum. But be careful with the motor mounts, the intake/exhaust mounts, the screws that hold the motor together and covers on etc. These all screw into aluminum and can strip out really easy if you over tighten them or re-tighten them too often. And the kit studs are pretty crappy and can wear out from too much re-tightening.
My first season went pretty much like your experience.. I popped the woodruff key (and broke the chain to bits) in the first couple days. Got myself a new woodruff key and a socket to tighten it all up (adding some blue loctite) and I was back on the road. I decided at that point to keep checking/tightening things regularly. That season I seemed to be always wrenching on something, and stripped out this stud and that nut etc etc.
Over that winter I stripped down my bike, ordered a upgrade hardware kit (studs, nuts etc) from SickBikeParts.com, installed all the studs with red loctite (be warned RED is the non removable type, DO NOT use RED loctite on the crappy kit studs or other hardware, some people say NEVER use it but so far so good for me) then I used blue loctite when I put the nuts on the studs. (figuring red loctite will keep the studs in place when I remove the nuts that have blue loctite on them) I bought a compact click style torque wrench (with a head the size of a 1/4" socket wrench) and used it to torque everything properly when I built up the motor and mounted it on the bike. The next season I didn't have to re-tighten ANYTHING! I am really pleased how this worked out for me. I do recomend that you build the bike, ride it, test it, tweak it, THEN do the loctite thing if you are going to do it. You don't want to secure things in place with loctite before you have all the bugs worked out of your build.
I also changed over to a #41 industrial chain and got rid of the chain tensioner altogether, I hated that thing. The kit chain I got was total crap and kept breaking, #41 chain is rock solid, I can't see me breaking it. Without the tensioner my the bike is much smoother, quieter, and there is MUCH less resistance when pedaling with the motor off, and there is no chance of the tensioner turning into your spokes and making you crash! If you have a clear line for your chain to ride without the tensioner you might want to give that a try...
Be safe and have fun!