Get a Size Down
Linen trousers are a great alternative to Khaki for summer; they are more comfortable, with more flex and give where you need it.
The trick is to buy a size smaller than you normally wear; tight after laundering, but they stretch out quickly to the perfect size.