It seems more intuitive to be able to edit Contacts in Contact Center address books directly from the client (assuming the Agent has the correct permissions dictated by their assigned Role) as opposed to having to go to the Web Portal each time or wait for an engagement to be in progress.
Just making changes (add/remove/edit contacts/create groups), to the address book in general from the client would make sense.