This is only possible on the premium version, since there is no organization admin on the free version.
If their account email address is on your company email server, then another option is to request a password reset for their accounts, then have your IT department forward the password reset email to you. You can use this to access their accounts and leave the organization from there.
Hope that can help!
/Jacquelyn - Podio