Not at all. You can still search and see everything that you federate with, but posts, likes, etc. will not populate on your server automatically unless you follow them. Otherwise, the entire fediverse would have to populate every minute on your personal server. I don’t know how Lemmy handles that.