If a rogue trustee is failing in their duties then either their fellow trustees or beneficiaries of the trust can request that a trustee voluntarily steps down. As long as there are enough trustees remaining then the trustee can simply retire or else they can appoint someone else in their place before stepping down.