There have been multiple accounts created with the sole purpose of posting advertisement posts or replies containing unsolicited advertising.

Accounts which solely post advertisements, or persistently post them may be terminated.

bizarroland ,

I have a 4070 sitting around collecting dust that I got from a trade, I've been thinking about setting it up with whispr and TTS and having a way to talk to my house.

I have a couple of smart home integrations, mostly air conditioning, light switches, security, and doors.

What I would like would be to have a few speakers on the walls that can talk to my server where I can say something like, hey computer, turn on the lights in the dining room and the lights in the dining room would turn on without transmitting that information to Google or Amazon.

Banthex ,

github.com/…/paperless_sort_low_quality_ollama let ai tag your paperless ngx files base on content.

yesman ,

Think of LLMs like a stupid office worker. You wouldn’t rely on them to make critical decisions, but they’re valuable for tedious stuff.

For example, my calendar changed the way to enter new events breaking my workflow. Now I just type out a skeletal schedule and have LLM convert that into a .csv that I import.

I’m thinking of Ripping my CD collection again. I’m researching a way to use a LLM to tidy up the metadata.

I had a folder full of random stuff I’ve saved for years. Had a LLM organize and categorize it for me. I had to tweak the prompt enough that this was a medium difficulty task, but still way easier than doing it manually.

WeLoveCastingSpellz ,

playing dnd alone is pretty cool

badcommandorfilename ,

“cool”

RandomLegend ,
@RandomLegend@lemmy.dbzer0.com avatar

Any model recommendation for that?

The ones i tried get stuck in a loop at some point due to the small context windows.

1rre ,

Yeah even gpt4o couldn’t keep track of encounters, run battles etc. in my case…

I think if you wanted to do it mechanically consistently you’d probably need to integrate it into a vtt where you give it context and potentially fine-tune it to give quest related summaries & gming rather than just “stuff”

RandomLegend ,
@RandomLegend@lemmy.dbzer0.com avatar

VTT integration would be one hell of a job to do.

WeLoveCastingSpellz ,

the answer is very spesific to ur pc and amount of vram you have availşble to you. But anything lama 3 even 8b models finetuned to DM or write stories should theoritically work. The other reply that reccomends connecting to another program to make sure rules are consistent sounds like a great idea whşch I have not tried. I use silly tavern as the ui whşch has lots of options and shit to mske thşngs wkrk well. I would reccomend goşng şnto the “KoboldAI” discord and askşng şn the support sectşon folk there are very helpfull sorry for not beşng able to gşve a strsight answer Also boost the context size way up that shit makes dşfference I habe like 16k or sumthin. good luck!

RandomLegend ,
@RandomLegend@lemmy.dbzer0.com avatar

What on earth is going on with your keyboad?!

Besides that, i have 20GB of VRAM and 64GB or RAM. I can run the mixtral 8x7b model relatively usable. Currently i use oobabooga the most.

WeLoveCastingSpellz ,

I type very poorly on my phone. with that much vram ypu csn get somethşng lşke a 70b model defineyly ask around in the koboldai community that shşt’s crszy

slazer2au ,

Wanting answers to things you don’t want google to know that you don’t know.

dwindling7373 ,

There are a huge number of vastly better solutions to get that…

Aquila ,

Such as…?

dwindling7373 ,

A privacy respecting search engine.

RandomLegend ,
@RandomLegend@lemmy.dbzer0.com avatar

It’s a tool like any other. If you don’t have any usecase for it, just don’t use it.

I use it to summarize release notes and generate some minor descriptions for generic stuff in my TTRPG campaigns.

DrinkMonkey ,

generate some minor descriptions for generic stuff in my TTRPG campaigns.

Need a quick 200 word description of the interior of an apothecary? Or a band of marauding orcs? It’s been a huge time saver for me.

RandomLegend ,
@RandomLegend@lemmy.dbzer0.com avatar

Yup, never had to usw “Random NPC Merchant No. 14” again.

just_another_person ,

None

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • [email protected]
  • random
  • lifeLocal
  • goranko
  • All magazines
    •