An olive parka and sweatpants are a nice go-to outfit to keep in your casual closet. Introduce a pair of athletic shoes to your ensemble and off you go looking amazing. This combination should erase any doubts you had about dressing casually as a 40-year-old.