If you like relaxed dressing, rock a navy and white crew-neck t-shirt with shorts. Complement your look with brown leather flip flops to immediately step up the fashion factor of your look. When it comes to casual fashion for men in their 40s, this look looks good on most men.