40 sounds like a heat wave to me. To answer your question, no, cold temps will not harm your engine. Think 'snow blowers'. Cold weather starting is sometimes an issue but if you're already riding, go for it, bundle up, have fun and watch for ice.
Tom
