Go for a pared down yet casual and cool option teaming a white crew-neck t-shirt and black chinos. Introduce a pair of white and black athletic shoes to the mix to give a dose of stylish casualness to this ensemble. This combination should clear any doubts you had about wearing casual clothes in your sixties.