Opt for a navy dress shirt and navy chinos to ooze manly elegance and class. If you feel like dialing it up, add brown suede oxford shoes to the equation. This pairing illustrates that figuring out how to dress stylishly as a man in his 40s is not that daunting a task.