Of the ones I’ve tried that are fully open-source, zulip is the best one regarding UX functionality.
I’ve found Matrix is a UX nightmare, with many different clients implementing different features, or having issues if a non-default login mode is used, ending in people getting locked out after the browser logged them out because they forgot to copy a key when they were logged in.
Others like rocketchat are opencore like matter most, which means they can do the switcheroo.
The things I would care the most when checking this kind of service are:
- UX: how easy it is to use for nontechnical users
- how well-backed is the project, socially and financially, to ensure it lasts a long time
- how easy it is to get the (public) conversations out, as an exit strategy, if the one above isn’t looking so good.



You might want to take a look at https://github.com/olivierlambert/calrs
it was made as a reaction to cal.com not meeting the needs of the creator, like being selfhood table and being caldav compatible.
Note that I cannot vouch for it since I have not used it.