Zelyios

@[email protected]

This profile is from a federated server and may be incomplete. Browse more on the original instance.

Self hosted LLM

Hello internet users. I have tried gpt4all and like it, but it is very slow on my laptop. I was wondering if anyone here knows of any solutions I could run on my server (debian 12, amd cpu, intel a380 gpu) through a web interface. Has anyone found any good way to do this?

Zelyios , 5 months ago

OP should try H2OGPT, it is somewhat technical but the UI makes it easy to configure. You can select many models and prompt types, and you can even input your own documents so that the AI uses them to answer

Reply

Report

Activity

Open original URL

Copy original URL

Copy Mbin URL

Loading...

I wish humans could get firmware upgrades

-bug fix: anxiety has been reduced by 50% -bug fix: memory has been buffed by 50% -bug fix: removed reoccurring memories of past failures

Zelyios , 10 months ago

This is the meditation update that you’re looking for

Reply

Report

Activity

Open original URL

Copy original URL

Copy Mbin URL

Loading...

Visio alternative

Hello self-hosters! Just wondering if anyone has any suggestions for a self-hosted Microsoft Visio alternative, or something at least very similar. I’m basically looking to create infrastructure diagrams for my self hosted server and apps. I already have WikiJS as a wik/documentation solution, but don’t mind migrating to...