Dress in an olive polo and white chinos for a simple outfit that's also well put together. When it comes to shoes, this outfit is complemented wonderfully with white slip-on sneakers. And if we're talking casual clothing for middle-aged men, this look is perfect.