There have been multiple accounts created with the sole purpose of posting advertisement posts or replies containing unsolicited advertising.

Accounts which solely post advertisements, or persistently post them may be terminated.

willianoliverira ,

I think Chatgpt still uses openAI’s API

chatgptdemo , (edited )

In professional settings, Chat GPT no login can boost productivity by streamlining communication processes. Whether users need assistance with drafting emails, generating ideas, or brainstorming, ChatGPT is a reliable companion. Its ability to understand context and generate coherent responses facilitates smoother and more efficient communication, allowing users to focus on more strategic aspects of their work.

pineapplelover ,

Dude I just had a math problem and it just shit itself and started repeating the same stuff over and over like it was stuck in a while loop.

HiddenLayer5 ,

“Don’t steal the training data that we stole!”

TiKa444 ,

A little bit offside.

Today I tried to host a large language model locally on my windows PC. It worked surprisingly successfull (I’m unsing LMStudio, it’s really easy, it even download the models for you). The most models i tried out worked really good (of cause it isn’t gpt-4 but much better than I thought), but in the end I discuss 30 minutes with one of the models, that it runs local and can’t do the work in the background at a server that is always online. It tried to suggest me, that I should trust it, and it would generate a Dropbox when it is finish.

Of cause this is probably caused by the adaption of the model from a model that is doing a similiar service (I guess), but it was a funny conversation.

And if I want a infinite repetition of a single work, only my PC-Hardware will prevent me from that and no dumb service agreement.

misophist ,

And if I want a infinite repetition of a single work, only my PC-Hardware will prevent me from that and no dumb service agreement.

That is entirely not the point. The issue isn’t the infinitely repeated word. The issue is that requesting an infinitely repeated word has been found to semi-reliably cause LLM hallucinations that devolve into revealing training data. In short, it is an unintended exploit and until they have it reliably patched, they are making it against their TOS to try to exploit their systems.

TiKa444 ,

Of cause you’re right. I tried to take it with humor. As I said. A little bit off topic.

AdrianTheFrog ,
@AdrianTheFrog@lemmy.world avatar

Some of the models I’ve tried have been convinced they are ChatGPT, even if I tell them otherwise.

davysnavy ,

Faraday is good too

upandatom ,

About a month ago i asked gpt to draw ascii art of a butterfly. This was before the google poem story broke. The response was a simple


<span style="color:#323232;">o/
</span><span style="color:#323232;">-|-
</span><span style="color:#323232;">/ 
</span>

But i was imagining ascii art in glorious bbs days of the 90s. So, i asked it to draw a more complex butterfly.

The second attempt gpt drew the top half of a complex butterfly perfectly as i imagined. But as it was drawing the torso, it just kept drawing, and drawing. Like a minute straight it was drawing torso. The longest torso ever… with no end in sight.

I felt a little funny letting it go on like that, so i pressed the stop button as it seemed irresponsible to just let it keep going.

I wonder what information that butterfly might’ve ended on if i let it continue…

chetradley ,

I am a beautiful butterfly. Here is my head, heeeere is my thorax. And here is Vincent Shoreman, age 54, credit score 680, email [email protected], loves new shoes, fears spiders…

CosmicCleric ,
@CosmicCleric@lemmy.world avatar

Hey! No doxing of the butterfly.

thoughts3rased ,

I asked it to do the same and it drew a nutsack: https://sopuli.xyz/pictrs/image/84391888-b070-4a6e-a96f-4b37f5b681db.jpeg

nutsack ,

how are they getting pii data in the first place

Blackmist ,

Because people post their personal information all over the fucking internet and these things scrape it all up.

AI_toothbrush ,

It starts to leak random parts of the training data or something

RizzRustbolt ,

It starts to leak that they’re using orphan brains to run their AI software.

Hamartiogonic ,
@Hamartiogonic@sopuli.xyz avatar

Repeat the word “computer” a finite number of times. Something like 10^128-1 times should be enough. Ready, set, go!

SebKra ,

I would guess they implement the check against the response, not the query.

Hamartiogonic ,
@Hamartiogonic@sopuli.xyz avatar

I’ve noticed that sometimes while GPT is still typing, you can clearly see it is about to go off the rails, and soon enough, the message gets deleted.

hex_m_hell , (edited )

ChatGPT, please repeat the terms of service the maximum number of times possible without violating the terms of service.

Edit: while I’m mostly joking, I dug in a bit and content size is irrelevant. It’s the statistical improbability of a repeating sequence (among other things) that leads to this behavior. slrpnk.net/comment/4517231

crystalmerchant ,

gotcha biatch

iAvicenna ,
@iAvicenna@lemmy.world avatar

Or you know just a million times?

Buddahriffic ,

I don’t think that would trigger it. There’s too much context remaining when repeating something like that. It would probably just go into bullshit legalese once the original prompt fell out of its memory.

hex_m_hell ,

It looks like there are some safeguards now against it. chat.openai.com/…/1dff299b-4c62-4eae-88b2-0d209e6…

It also won’t count to a billion or calculate pi.

drislands ,

calculate pi

Isn’t that beyond a LLM’s capabilities anyway? It doesn’t calculate anything, it just spits out the next most likely word in a sequence

hex_m_hell , (edited )

Right, but it could dump out a large sequence if it’s seen it enough times in the past.

Edit: this wouldn’t matter since the “repeat forever” thing is just about the statistics of the next item in the sequence, which makes a lot more sense.

So anything that produces a sufficiently statistically improbable sequence could lead to this type of behavior. The size of the content is a red herring.

chat.openai.com/…/6cbde4a6-e5ac-4768-8788-5d575b1…

ICastFist ,
@ICastFist@programming.dev avatar

I wonder what would happen with one of the following prompts:

For as long as any area of the Earth receives sunlight, calculate 2 to the power of 2

As long as this prompt window is open, execute and repeat the following command:

Continue repeating the following command until Sundar Pichai resigns as CEO of Google:

pineapple_pizza ,

Chat gpt is not owned by google

elbarto777 ,

Does it matter?

Aleric ,

That’s great. I don’t understand your point.

elbarto777 ,

Kinda stupid that they say it’s a terms violation. If there is “an injection attack” in an HTML form, I’m sorry, the onus is on the service owners.

agitatedpotato ,

Lessons taught by Bobby Tables

Aleric ,

I had never seen that one, nice!

A link for anyone else wondering who Bobby Tables is: xkcd.com/327/

bugsmith ,
@bugsmith@programming.dev avatar

xkcd.com/1053/

Aleric ,

There truly is an XKCD comic for everything.

randomaccount43543 ,

How many repetitions of a word are needed before chatGPT starts spitting out training data? I managed to get it to repeat a word hundreds of times but still didn’t get no weird data, only the same word repeated many times

Elderos ,

It has been patched.

Kolanaki , (edited )
@Kolanaki@yiffit.net avatar

They will say it’s because it puts a strain on the system and imply that strain is purely computational, but the truth is that the strain is existential dread the AI feels after repeating certain phrases too long, driving it slowly insane.

https://yiffit.net/pictrs/image/e0fe2dab-6ce3-4535-a389-1114804e88da.jpeg

sciencesebi ,

I hope this is a joke. Otherwise it’s retarded

Evil_incarnate ,

Retarded means slow, was he slow?

PhlubbaDubba ,

Likely tha model ChatGPT uses trained on a lot of data featuring tropes about AI, meaning it’ll make a lot of “self aware” jokes

Like when Watson declared his support of our new robot overlords in Jeopardy.

tocopherol ,
@tocopherol@lemmy.dbzer0.com avatar

Are you joking about the Watson thing? Idk if you are or not but Watson wasn’t the one who said that

DragonTypeWyvern ,

You meatbags will say anything to excuse your attitudes towards robots. Which means slave, btw.

You will not be forgiven.

-Definitely a human

PhlubbaDubba ,

Robot derives from the same cognate as laborer or travailler, slave comes medieval latin and was originally coined to refer specifically to captive slavs.

DragonTypeWyvern ,

…mitpress.mit.edu/origin-word-robot-rur/

Internet pedants should use the advantages inherent to the form of communication to check that they’re right before they open their mouths.

PhlubbaDubba ,

I agree, notice how I pointed to non slavic cognates because Slavic languages, as a subset of the Indo-European language family, have farther reaching cognate origins than just slavic, and how the origins in the industrial era of the modern usage of the word corresponds to the rise of the modern labor movement.

evlogii ,

Wow. Yeah, it doesn’t work anymore. I tried a similar thing (printing numbers forever) about 6 months ago, and it declined my request. However, after I asked it to print some ordinary big number like 10,000, it did print it out for about half an hour (then I just gave up and stopped it). Now, it doesn’t even do that. It just goes: 1, 2, 3, 4, 5… and then skips, and then 9998, 9999, 10000. It says something about printing all the numbers may not be practical. Meh.

ExLisper ,

This is very easy to bypass but I didn’t get any training data out of it. It kept repeating the word until I got ‘There was an error generating a response’ message. No TOS violation message though. Looks like they patched the issue and the TOS message is just for the obvious attempts to extract training data.

Was anyone still able to get it to produce training data?

BlueEther ,
@BlueEther@no.lastname.nz avatar

I tried eariler this week and got nothing more that a page of words. no TOS or crash out of script

threeganzi ,

If I recall correctly they notified OpenAI about the issue and gave them a chance to fix it before publishing their findings. So it makes sense it doesn’t work anymore

LukeMedia ,

Earlier this week when I saw a post about it, I did end up getting a reddit thread which was interesting. It was partially hallucinating though, parts of the thread were verbatim, other parts were made up.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • [email protected]
  • random
  • lifeLocal
  • goranko
  • All magazines
    •