When you want to go about your day with confidence in your ensemble, dress in a mint shirt jacket and a grey crew-neck t-shirt. For times when this ensemble looks all-too-dressy, tone it down by sporting a pair of grey athletic shoes. When it comes to casual dressing ideas for men in their 40s, this ensemble is perfect.