For people self hosting LLMs.. I have a couple docker images I maintain
github.com/…/text-generation-webui-docker (updated to 1.3.1 and has a fix for gqa to run llama2 70B)...
There have been multiple accounts created with the sole purpose of posting advertisement posts or replies containing unsolicited advertising.
Accounts which solely post advertisements, or persistently post them may be terminated.
This magazine is from a federated server and may be incomplete. Browse more on the original instance.
github.com/…/text-generation-webui-docker (updated to 1.3.1 and has a fix for gqa to run llama2 70B)...
Hi! I’m currently running a bunch of docker containers on an old optiplex desktop I got from a local used PC store a year or so ago. Since I’ve been really enjoying this hobby and it’s stuck around, I now want to upgrade my hardware while also downsizing the physical size. I was thinking of getting an Intel NUC but it...
I use Cloudflare tunnels for most of my self hosted stuff and I wanted to point a subdomain at my piHole, but it seems that you can’t install the cloudflared software on a pi zero. Is there any way to get this working?...
I’m writing my own novice guide to setting up a home server, the stuff I wish I’d been told when I started. Would love feedback from beginners on how useful this is, as well as feedback from veteran self-hosters on how accurate this is, and I welcome suggestions from anyone about what I should add next....
I’ve migrated off of Portainer to standard docker compose recently so that I can script some major tasks like updating all the containers or restarting all of them. I also liked the idea of being able to put the compose files into a git repo and push it up so that they are automatically backed up. I hope to be able to turn...
Is there a software emulates a SATA interface on a USB storage device, tricking Windows into recognizing the USB SSD as a SATA SSD....
Im trying to setup a DNS record in Opnsense to forward ex:( ***.local.mydomain.com ) to (192.168.1.777(nginx proxy)) but every option in Opnsense that I try it doesn’t forward to my reverse proxy machine....
I just discovered this. Sync’s your shell history between multiple servers. You can use their free, open source server (your history is encrypted) or run your own server....
Hi there,...
I use HomeAssistant automations for all my home stuff, it has an official easy to add Node Red integration available. I played with it a little in the past but didn’t really see any value for me at the time. Now I’m looking to set up a new automation tool that’s not necessarily hardware/home type stuff, moreso the kind of...
So, I am running ProxMox with PFSense virtualized on it, and I am having some issues with SSH and Ping access between my physical machines and the rest of the network. The two computers are running into an unmanaged switch before then connecting to the NIC port that is set as the LAN interface....
I was thinking it would be nice to have for backups, but maybe even going as far as mounting ~/home to be able to run from multiple machines. I’m really asking where to get started looking without crashing into marketing department nonsense and search engine steering bias.
I have a cheap Fujitsu Futro S920 running a bunch of services here, but I noticed, that for some tasks its rather weak (and old) CPU simply can’t keep up. The lack of SATA is another weak point....
Howdy folks!...
I’m attempting to get a Lemmy server running on Debian 11 using this documentation:...
I tried to bring up an immich server on a cloud provider server with docker, which is successful, but I’d like to organize multiple services into locations under the top level domain, which is a duckdns.org domain with nginx reverse proxy....
Hello!...
Hi all, a shout-out for assistance. I’m considering hosting a Lemmy instance (assuming I can pass the wife test on costs) and I’m looking for some guidance on specs....
Or maybe a two click solution? :)
cross-posted from: lemmy.world/post/226995...
what is better for single user instance, or maybe something small like under 10 users (no communities)? which is lighter on resources? how much storage should I allocate?...
Hi everybody !...
We’re at a great nexus for Lemmy here, with so many users (including me) giving up Reddit for good and moving to the federated universe....
Hi All!...
The solution has been found, see the “Solution” section for the full write up and config files....