There have been multiple accounts created with the sole purpose of posting advertisement posts or replies containing unsolicited advertising.

Accounts which solely post advertisements, or persistently post them may be terminated.

barsquid ,

It is their own fault for poisoning the internet with their slop.

db2 ,

In case anyone doesn’t get what’s happening, imagine feeding an animal nothing but its own shit.

BassTurd ,

Not shit, but isn’t that what brought about mad cow disease? Farmers were feeding cattle brain matter that had infected prions. Idk if it was cows eating cow brains or other animals though.

_cnt0 ,
@_cnt0@sh.itjust.works avatar

It was the remains of fish which we ground into powder and fed to other fish and sheep, whose remains we ground into powder and fed to other sheep and cows, whose remains we ground to powder and fed to other cows.

Snowclone ,

So yes. That’s what’s happening.

prole ,

Maybe the internet will get a prion and die

Stern OP ,
@Stern@lemmy.world avatar

I use the “Sistermother and me are gonna have a baby!” example personally, but I am a awful human so

leftzero ,

Photocopy of a photocopy is my go-to metaphor for model collapse.

Cock_Inspecting_Asexual ,
@Cock_Inspecting_Asexual@lemmy.world avatar

DUDE ITS SO FUCKING ANNOYING TRYNNA USE GOOGLE IMAGES ANYMORE–

ALL IT GIVES ME IS AI ART. IM SO FUCKING SICK AND TIRED OF IT.

EgoNo4 ,

More like… Degenerative AI *ba dum tsss

merde , (edited )

deGenerative AI ☞ !degenerate

edit: don’t, if you’re on a bus! i thought lemmynsfw was a warning enough

EgoNo4 ,

No idea this existed.

Also… JFC WHAT THE SHIT?

murmelade ,

deleted_by_author

    •
    merde ,

    comment edited 👍

    CarbonatedPastaSauce ,

    Model collapse is just a euphemism for “we ran out of stuff to steal”

    Snowclone ,

    It’s more ''we are so focused on stealing and eating content, we’re accidently eating the content we or other AI made, which is basically like incest for AI, and they’re all inbred to the point they don’t even know people have more than two thumb shaped fingers anymore."

    rottingleaf ,

    All such news make me want to live to the time when our world is interesting again. Real AI research, something new instead of the Web we have, something new instead of the governments we have. It’s just that I’m scared of what’s between now and then. Parasites die hard.

    jimmy90 ,

    or “we’ve hit a limit on what our new toy can do and here’s our excuse why it won’t get any better and AGI will never happen”

    Adderbox76 ,

    Every single one of us, as kids, learned the concept of “garbage in, garbage out”; most likely in terms of diet and food intake.

    And yet every AI cultist makes the shocked pikachu face when they figure out that trying to improve your LLM by feeding it on data generated by literally the inferior LLM you’re trying to improve, is an exercise in diminishing returns and generational degradation in quality.

    Why has the world gotten both “more intelligent” and yet fundamentally more stupid at the same time? Serious question.

    LANIK2000 ,

    Because the people with power funding this shit have pretty much zero overlap with the people making this tech. The investors saw a talking robot that aced school exams, could make images and videos and just assumed it meant we have artificial humans in the near future and like always, ruined another field by flooding it with money and corruption. These people only know the word “opportunity”, but don’t have the resources or willpower to research that “opportunity”.

    kerrigan778 , (edited )

    Remember Trump every time he’s weighed in on something, like suggesting injecting people with bleach, or putting powerful UV lights inside people, or fighting Covid with a “solid flu vaccine” or preventing wildfires by sweeping the forests, or suggesting using nuclear weapons to disrupt hurricane formation, or asking about sharks and electric boat batteries? Remember these? These are the types of people who are in charge of businesses, they only care about money, they are not particularly smart, they have massive gaps in knowledge and experience but believe that they are profoundly brilliant and insightful because they’ve gotten lucky and either are good at a few things or just had an insane amount of help from generational wealth. They have never had anyone, or very few people genuinely able to tell them no and if people don’t take what they say seriously they get fired and replaced with people who will.

    Croquette ,

    Because the dumdums have access to the whole world at the tip of the fingertip without having to put any efforts in.

    In a time without that, they would be ridiculed for their stupid ideas and told to pipe down.

    Now they can find like minded people and amplify their stupidity, and be loud about it.

    So every dumdum becomes an AI prompt engineer (whatever the fuck that means) and know how to game the LLM, but do not understand how it works. So they are basically just snake oil salesmen that want to get on the gravy train.

    GamingChairModel ,

    Why has the world gotten both “more intelligent” and yet fundamentally more stupid at the same time? Serious question.

    Because it’s not actually always true that garbage in = garbage out. DeepMind’s Alpha Zero trained itself from a very bad chess player to significantly better than any human has ever been, by simply playing chess games against itself and updating its parameters for evaluating which chess positions were better than which. All the system needed was a rule set for chess, a way to define winners and losers and draws, and then a training procedure that optimized for winning rather than drawing, and drawing rather than losing if a win was no longer available.

    Face swaps and deep fakes in general relied on adversarial training as well, where they learned how to trick themselves, then how to detect those tricks, then improve on both ends.

    Some tech guys thought they could bring that adversarial dynamic for improving models to generative AI, where they could train on inputs and improve over those inputs. But the problem is that there isn’t a good definition of “good” or “bad” inputs, and so the feedback loop in this case poisons itself when it starts optimizing on criteria different from what humans would consider good or bad.

    So it’s less like other AI type technologies that came before, and more like how Netflix poisoned its own recommendation engine by producing its own content informed by that recommendation engine. When you can passively observe trends and connections you might be able to model those trends. But once you start actually feeding back into the data by producing shows and movies that you predict will do well, the feedback loop gets unpredictable and doesn’t actually work that well when you’re over-fitting the training data with new stuff your model thinks might be “good.”

    lightsblinken ,

    good commentary, covered a lot of ground - appreciate the effort to write it up :)

    bignate31 ,

    Another great example (from DeepMind) is AlphaFold. Because there’s relatively little amounts of data on protein structures (only 175k in the PDB), you can’t really build a model that requires millions or billions of structures. Coupled with the fact that getting the structure of a new protein in the lab is really hard, and that most proteins are highly synonymous (you share about 60% of your genes with a banana).

    So the researchers generated a bunch of “plausible yet never seen in nature” protein structures (that their model thought were high quality) and used them for training.

    Granted, even though AlphaFold has made incredible progress, it still hasn’t been able to show any biological breakthroughs (e.g. 80% accuracy is much better than the 60% accuracy we were at 10 years ago, but still not nearly where we really need to be).

    Image models, on the other hand, are quite sophisticated, and many of them can “beat” humans or look “more natural” than an actual photograph. Trying to eek the final 0.01% out of a 99.9% accurate model is when the model collapse happens–the model starts to learn from the “nearly accurate to the human eye but containing unseen flaws” images.

    RmDebArc_5 ,
    @RmDebArc_5@sh.itjust.works avatar

    This sounds like AI is literally biting its own tail

    AbidanYre ,

    ChatGPT, what is an ouroboros?

    homesweethomeMrL ,

    Of course! An ChatGPT is an ouroboros, ChatGPT what is an ouroboros.

    casmael ,

    …………………. Good?

    emiellr ,
    @emiellr@lemm.ee avatar

    Tbh I’m a bit lost on the purpose of this

    aggelalex ,

    So AI:

    1. Scraped the entire internet without consent
    2. Trained on it
    3. Polluted it with AI generated rubbish
    4. Trained on that rubbish without consent
    5. Are now in need of lobotomy
    BlackLaZoR ,
    @BlackLaZoR@fedia.io avatar

    So they made garbage AI content, without any filtering for errors, and they fed that garbage to the new model, that turned out to produce more garbage. Incredible discovery!

    RunningInRVA ,

    Indeed. They discovered that:

    shit in = shit out.

    homesweethomeMrL ,

    A fifty year old maxim, to be clear. They “just now” “found that out”.

    Biggest. Scam. Evar.

    stephen01king ,

    Who just found that out?

    kambusha ,

    people equals shit

    pennomi ,

    Yeah, in practice feeding AI its own outputs is totally fine as long as it’s only the outputs that are approved by users.

    Bezier ,
    @Bezier@suppo.fi avatar

    I would expect some kind of small artifacting getting reinforced in the process, if the approved output images aren’t perfect.

    pennomi ,

    Only up to the point where humans notice it. It’ll make AI images easier to detect, but still pretty for humans. Probably a win-win.

    Bezier ,
    @Bezier@suppo.fi avatar

    Didn’t think of that, good point.

    The inbreeding could also affect larger decisions in sneaky ways, like how it wants to compose the image. It would be bad if the generator started to exaggerate and repeat some weird ai tropes.

    WalnutLum ,

    I don’t know if thinking that training data isn’t going to be more and more poisoned by unsupervised training data from this point on counts as “in practice”

    thejml ,

    Ah, the Hapsburg of AI!

    Telorand ,

    Oh, the artificial humanity!

    Davel23 ,

    Are you confusing the Habsburg Dynasty with the Hindenburg?

    Deebster ,
    @Deebster@programming.dev avatar

    Perhapsburg they are

    Telorand ,

    No, I just thought they were vaguely similar enough words to make a dumb internet joke.

    Davel23 ,

    You're right, that's a good dumb internet joke. I'm just being needlessly pedantic today.

    homesweethomeMrL ,

    I see your needless pedantry and raise you abrasive grammarian.

    PapaStevesy ,

    I like to think of it like a Mad Cow or Kuru, you can’t eat your own species’s brains or you could get a super lethal, contagious prion disease.

    CarbonatedPastaSauce , (edited )

    Prion diseases aren’t contagious.

    Edit: for the uninformed people that downvoted - clearly spelled out here merckmanuals.com/…/overview-of-prion-diseases

    PapaStevesy ,

    You can acquire it through direct contact, i.e. consuming prion-disease-contaminated meat. What would you call it?

    CarbonatedPastaSauce ,

    Contagious means you can get it from direct or indirect contact with another person or organism that is infected. Not from eating them.

    That is not possible with prion disease.

    Ingesting a Petri dish full of flu virus doesn’t make the Petri dish ‘contagious’.

    CarbonatedPastaSauce ,

    Also, that’s not what direct contact means when discussing contagion:

    www.ncbi.nlm.nih.gov/pmc/articles/PMC7150340/

    Ingestion is not ‘direct contact’.

    ZILtoid1991 ,

    If only the generated output also looked more and more like how inbred humans do.

    Like insane rambling from LLMs, and the humans generated by AI had various developmental disorders and the Habsburg jaw.

    gravitas_deficiency , (edited )

    Uh, good.

    As an engineer who cares a LOT about engineering ethics, it is absolutely fucking infuriating watching the absolute firehose of shit that comes out of LLMs and public-consumption audio, image, and video ML systems, juxtaposed with the outright refusal of companies and engineers who work there to accept ANY accountability or culpability for the systems THEY FUCKING MADE.

    I understand the nuances of NNs. I understand that they’re much more stochastic than deterministic. So, you know, maybe it wasn’t a great idea to just tell the general public (which runs a WIDE gamut of intelligence and comprehension ability - not to mention, morality) “have at it”. The fact that ML usage and deployment in terms of information generating/kinda-sorta-but-not-really-aggregating “AI oracles” isn’t regulated on the same level as what you’d see in biotech or aerospace is insane to me. It’s a refusal to admit that these systems fundamentally change the entire premise of how “free speech” is generated, and that bad actors (either unrepentantly profit driven, or outright malicious) can and are taking disproportionate advantage of these systems.

    I get it - I am a staunch opponent of censorship, and as a software engineer. But the flippant deployment of literally society-altering technology alongside the outright refusal to accept any responsibility, accountability, or culpability for what that technology does to our society is unconscionable and infuriating to me. I am aware of the potential that ML has - it’s absolutely enormous, and could absolutely change a HUGE number of fields for the better in incredible ways. But that’s not what it’s being used for, and it’s because the field is essentially unregulated right now.

    pyre ,

    oh no are we gonna have to appreciate the art of human beings? ew. what if they want compensation‽

    rickdg ,
    @rickdg@lemmy.world avatar

    Old news? Seems to be a subject of several papers for some time now. Synthetic data has been used successfully already for very specific domains.

    SomeGuy69 ,
    @SomeGuy69@lemmy.world avatar

    Yup, old news and wrong news. Also so many people who hate AI but don’t understand how it works. Pretty disappointing for a technology community.

    ohellidk ,

    Cool, let’s try to ruin it faster!

    draughtcyclist ,

    I’ve been assuming this was going to happen since it’s been haphazardly implemented across the web. Are people just now realizing it?

    DeathbringerThoctar ,

    People are just now acknowledging it. Execs tend to have a disdain for the minutiae. They’re like kids that only want to do the exciting bits. As a result things get fucked because they don’t really understand what they’re doing. As Muskrat would say “move fast and break things.” It’s a terrible mindset.

    pixxelkick ,

    “Move Fast and Break Things” is Zuckerberg/Facebook motto, not Musk, just to note.

    DeathbringerThoctar ,

    Oh, I stand corrected

    Wrufieotnak ,

    It is very much the motto this idiot lives by. He just wasn’t the first to coin that phrase.

    FaceDeer ,
    @FaceDeer@fedia.io avatar

    No, researchers in the field knew about this potential problem ages ago. It's easy enough to work around and prevent.

    People who are just on the lookout for the latest "aha, AI bad!" Headline, on the other hand, discover this every couple of months.

    Lettuceeatlettuce ,
    @Lettuceeatlettuce@lemmy.ml avatar

    Good.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • [email protected]
  • random
  • lifeLocal
  • goranko
  • All magazines
    •