EDIT: It seems the app sherpa has what you need. Just use one of the models found here, preferably 7b-chat Q4_K_S
Some people are energised by that kind of thing. However if you don’t want to reveal things to humans, you can use (if you are more technical) llama.cpp