For an outfit that's very simple but can be worn in a variety of different ways, team a black floral short sleeve shirt with tobacco chinos. Dial down the casualness of this getup by sporting a pair of loafers. When it comes to casual outfit ideas for guys in their 40s, this outfit looks nice on almost any man.