A white and blue plaid long sleeve shirt and light blue jeans are a wonderful pairing to have in your wardrobe. Go ahead and complete your look with tan athletic shoes for a fun feel. This combination should clear any doubts you had about wearing casual clothes as a middle-aged man.