Appreciate the clarification! I’ve been trying to wrap my head around how the fediverse works but I’m far from a programmer so some parts are still a bit confusing to me.
Is it just a different approach to reach the same goal or is there some inherent limitation to how the fediverse works that prevents instances from using crawlers?