If you're after an off-duty and at the same time stylish getup, wear a cardigan with navy jeans. For something more on the cool and laid-back side to finish this outfit, add a pair of athletic shoes to the equation. When it comes to casual outfit ideas for middle-aged gents, this ensemble is a good look on almost anyone.