Yes, it does not protect metadata great. It is visible that you and your interlocutor are talking together and when.
But noone figured out how to prevent that in federated systems. You rather have less metadata in centralized place for everyone or more metadata but only for small subset of people.