Channel your inner fashionisto and choose a tan shirt jacket and navy chinos. For a more laid-back take, introduce a pair of white canvas high top sneakers to the mix. This combo should encourage anyone who had doubts about wearing casual clothing in your forties.