If I want to exit the trust, do I have to get permission from the rest of the pool?

Edited

No, you do not. You may exit the trust individually and become a direct shareholder of the company by terminating the individual trust relationship with bunch.