For comfort dressing with a modernized spin, wear a tan wool turtleneck with dark brown chinos. If you need to immediately class up your outfit with one piece, why not complete your look with a pair of brown leather casual boots? There's no better way to spice up a dreary fall afternoon than a cool look like this one. If you're wondering what you should wear as a middle-aged gentleman, this getup gives a fair idea.