As you can see here, it doesn't require that much effort for a man to look casually polished. Wear a navy shawl cardigan with a turtleneck and be sure you'll look awesome. If you don't know how to finish, a pair of navy suede casual boots is a good choice.