SSO Permissions With Microsoft 365

Our company requires the use of SSO but does not want to give permission to access all contacts, calendars, and content for each of our users. We just want the ability use SSO to login and nothing further.