I’m trying radicale now, it seems to work with the clients I’m using, even HomeAssistant. What I like about it is it’s simplicity, it just stores stuff in the file system. But yes setting it up is a bit finicky. I installed the debian package and that makes it a bit better.