It would be better in my opinion to only show the list of users in the collection versus having all users shown with checks on ones that are in the collection. And if you want to add a user, there can be an "Add User" option which redirects to a list of all users. It would also be nice to show the number of users in a collection in a column in the main Collections page.