Great for the fediverse! I suspect that these changes to twitter and reddit are mainly a response to the growing hunger of generative artificial intelligence companies who are hoovering up data, basically for free. Change is never easy, but i’m optimistic that this is the break open source and federated communities needed to start taking off. I hope people can see the value in decentralizing and help support these open source projects financially so that they can really start to scale. The reality is, scaling is expensive, and we all need to help where we can. These Ai companies will not hesitate to suck up federated data also. If we want to live in an ad free world its gonna cost us.
Question: Can’t AI companies just as easily Hoover up language content from the fediverse? Or is it something that we just kind of accept but don’t care about since it isn’t eating into fediverse finances?
I would assume it’s even worse for the fediverse considering the limited resources we have to run the servers. I wonder how the devs/server owners will handle this.
I don’t think (completely wild guess here) AI content crawlers should have any more impact than the dozens and dozens of spiders that make up must of my own site’s traffic.
The impact was magnified for Twitter because it generates so much new content every second. That wasn’t an issue when Twitter had a nice, properly cached API and it shouldn’t be an issue for fediverse instances either because we have RSS and caching and we’re not so stupid as to turn those off. Like, what kind of moron would do that?
The issue comes when those AI bots start commenting and posting here. From what I understand, bots are a large reason why Beehaw keeps defederating from instances with open registration: bots are difficult to moderate without good moderation tools.
to be fair, that argument operates under the assumption that elon wasn’t just lying to cover up that he didn’t pay his google cloud bill. the amount of users who view and create that content still create a much higher load on the servers than AI scrapers that want to read it once and save it somewhere for training
I don’t think (completely wild guess here) AI content crawlers should have any more impact than the dozens and dozens of search spiders that make up must of my own site’s traffic.
The impact was magnified for Twitter because it generates so much new content every second. That wasn’t an issue when Twitter had a nice, properly cached API and it shouldn’t be an issue for fediverse instances going forward because we have RSS and caching and we’re not so stupid as to turn those off. Like, what kind of moron would do that?
yeah, fediverse platforms not only have no measures against scraping, they willingly send out content in a computer-readable way. kind of the whole point of federation. and we can’t really stop them, even if we clamp down on federation we’d only hurt ourselves.
besides, up until the latest change twitter was still easy to scrape (and now the problem is that even registered users can’t see that much of it), and reddit is trivial to scrape even without the api. yes, that includes new reddit too. there’s very little you can do against scraping in an open space, especially against someone wielding the full power of chatgpt, and even less so if you want to keep your site accessible to blind people.
lmao, you know you fucked up when a browser pushes an update specifically to circumvent your rate limits
but yeah, if opera can do it, i highly doubt that openai can’t easily do it either. the ai concerns are posturing (and probably a personal grudge, given that elon was a founding member of openai until he got kicked out), the real issue is somewhere between incompetence and attempted monetization.
i’m actually kinda interested how that could work. a regular user using “near infinitely less” resources than a scraping engine sounds like some absolutely stupid design, either on reddit’s or the scraping engine’s side
except most of the weight of the site is in easily cachable assets that don’t get reloaded at all. probably not even loaded to begin with, since even though new reddit is a single-page app, it does have seed data in the html content itself, which a well-written scraper (or one that automatically parses the site with chatgpt) can easily extract. constantly reloading styles and scripts would be a ridiculously stupid design on the scraper’s part, and on reddit’s if they necessitated it.
the html page itself is slightly heavier than just the json data but compared to all the images and videos real clients load and the giant piles of tracking data being sent back every second, a scraper is def going to be lighter. plus the site does reload itself every time you enter a new subreddit, that doesn’t happen through the api for some reason.
My parents were there yesterday, and sent me the same view! They also got pickpocketed by a group of scammers that were dumping bird shit on people and claiming to try to help them clean off.
Not gonna lie, even though I love futurama to death, this episode list is worrying me - seems like they are focusing too much on (soon to be, if not already) dated pop culture trends.
Same. The “topical” episodes are rarely great, and they’re often among my least favorite. Who looks forward to Decision 3012, Proposition Infinity, or Attack of the Killer App coming up in their playlist? I generally skip those. There are some good ones, like A Clockwork Origin, but they seem to be the exception. Those episodes also tend not to age well (Attack of the Killer App being the worst offender here in my opinion), and, as you said, several of these themes have been old news for several years now. I’m definitely looking forward to the second half of the season more than the first.
What’s to stop a single Lemmy instance from going “this is taking too much time and money to run, I’m shutting this server down”? I guess that can apply to any service, but monetization sometimes prevents that from happening. But in this case it’s all volunteer work and running a server takes resources.
What happens to all the users created under that Lemmy instance?
If it happened right now, we’d need to go make new accounts on a new instance to keep accessing content. Of course, content hosted on the disappeared instance would also be gone, which is another reason spreading everyone out onto smaller instances is a good idea to avoid one central server holding 90% of the good content.
What we have on Mastodon is an easy way to migrate account from one instance to another, so I’m hopeful a similar feature will be added here in due time once the devs have everything a bit more stable. The added complication with Lemmy of course is that we’d also need a way to migrate communities or at least the content thereof, but I’ve seen various discussions of how that could work so it is something that they’re thinking about already.
Ultimately, don’t get permanently attached to content you put out on the internet, because if this sounds terrifyingly precarious to you you probably weren’t online in the early 2000s when that’s just sort of how things worked. Somehow we thrived anyway!
lemmy.world
Hot