For casual refinement with a masculine spin, consider wearing a brown plaid wool blazer and a white dress shirt. Brown leather loafers will easily spruce up even the laziest of ensembles. And if we're talking dressing ideas for 50-year-old guys, this ensemble looks great on most.