Go for smart style in an overcoat and dark brown chinos. Finishing off with a pair of brown athletic shoes is a guaranteed way to bring a touch of stylish nonchalance to this getup. This outfit should clear any doubts you had about dressing casually as a middle-aged man.