Does anyone else have experience with koboldcpp? How do I make it give me longer outputs?
I switched from llamacpp to koboldcpp. Koboldcpp is really really fast because it can use gpu. The problem is that I’m having a hard time to get it to generate long enough outputs....