Team a puffer jacket with olive sweatpants to achieve an interesting and current off-duty outfit. Multi colored athletic shoes will add a playful touch to an otherwise sober outfit. When it comes to casual dressing ideas for 40-something gentlemen, this combination looks nice on most.