Turns out that routing the request to enable deleting in meeting chats for our account to the support works. The support folks enabled the feature in our account and then the option to be able to delete the in-meeting chat appeared. Thanks
For reference this article led us to the solution: delete in-meeting chat - Zoom Community