I can't speak for everyone else, but I know I was taken aback by the prospect that selfhosting meant I'd be caching copies of media uploaded to other instances without any way to opt out of that. It's one thing to provide links, it's another thing to be functioning as a knockoff CDN. That's a bit more than I'm willing to do for the sake of a vanity instance.