For a casual outfit with a modern finish, you can dress in a military jacket and black shorts. Complete your ensemble with a pair of black athletic shoes to keep the getup fresh. And if we're talking casual outfit ideas for guys in their 40s, this outfit is ideal.