There have been multiple accounts created with the sole purpose of posting advertisement posts or replies containing unsolicited advertising.

Accounts which solely post advertisements, or persistently post them may be terminated.

marktechpost.com

SpaghettiYeti , to technology in TII Releases Falcon 2-11B: The First AI Model of the Falcon 2 Family Trained on 5.5T Tokens with a Vision Language Model.

The first blipitty bloop doop did a strungle fung

j4k3 , to technology in Llama-2, GPT-4, or Claude-2; Which Artificial Intelligence Language Model Is The Best?
@j4k3@lemmy.world avatar

Llama-2 because you can run it on your own hardware. For the big GPU on a rented instance: Falcon 70b. OpenAI and Google can have turns playing proprietary asshat jack in the box.

procrastinator ,

How expensive would it be to run on a rented server?

Stubborn9867 ,

For the bigger ones you could do it under $.50 / hr. I run llama 2 13b-8 bit on my 3090 no problem, which can be rented for $.20/hr.

vast.ai/

Some of the lower pricing I’ve seen.

PeepinGoodArgs ,

How do you get into doing this? Like, are you a data scientist? AI Engineer? Hobbyist?

I want to be able to use tools like this, and I want a formal education in it, but I’m not sure what path to take. (I don’t necessarily want a career in it…my current career is pretty fantastic, but I think understanding tools like this is extremely important in understanding the modern world. That’s my main motivation.)

Stubborn9867 ,

I’m a software engineer by trade, but a hobbyist when it comes to LLMs.

github.com/AUTOMATIC1111

This is a good place to start. Loads of YouTubers with setup videos. I like this guy youtube.com/ he covers LLM and Image generation too.

Hugging face is a good place to get the actual LLM.

rustyricotta ,

Unless it’s changed recently, I don’t think automatic1111 deals with LLMs. It uses stable diffusion based technologies for text-to-image, image-to-image etc. But yes, it’s a good entry point for dinking around with ai/machine learning

Stubborn9867 ,

You’re right, I’m on mobile driving home.

I meant this one: github.com/oobabooga/text-generation-webui

And this YouTube video specifically for setup:

youtu.be/lb_lC4XFedU

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • random
  • lifeLocal
  • goranko
  • All magazines
    •