Move comes in response to investor criticism but leaves Brufau as most influential figure