For something more on the casually cool end, wear this combo of a hoodie and white chinos. You can take a more casual approach with footwear and complete your outfit with work boots. This combination is a really smart option, especially for autumn, when the temperature is getting lower. This pairing should clear any doubts you had about wearing casual clothes as a middle-aged man.