Sillytavern slow. 8 which is under more active development, and has added many major features. At this Jul 6, 2023 · SillyTavern is just an interface, and must be connected to an "AI brain" (LLM, model) through an API to come alive. At this Nov 8, 2024 · Environment 🪟 Windows System Windows 11 Pro Describe the problem SillyTavern continues to be slow on a very fast computer and sometimes does not even let me register what I type (meaning I either p A community to discuss about large language models for roleplay and writing and the PygmalionAI project - an open-source conversational language model. Nov 28, 2023 · A place to discuss the SillyTavern fork of TavernAI. . Sillytavern Local model response time being extremely slow, please help me understand why and help me possibly fix it. At this point they can be thought of as completely independent programs. Click regenerate again and immediately minimize the browser Check generation time difference Expected behavior Generation time with the window open is the same as minimized. All statements should be taken with a grain of salt. SillyTavern is a fork of TavernAI 1. At this Jul 3, 2023 · SillyTavern is a fork of TavernAI 1. Track generation time. Regenerate the response. A place to discuss the SillyTavern fork of TavernAI. that is Apr 11, 2023 · Launch SillyTavern, open with Firefox, and connect to Oogabooga Pick a bot and generate a response Set to a fixed seed. Sep 14, 2023 · Have you searched for similar requests? Yes Is your feature request related to a problem? Please describe. Every week new settings are added to sillytavern and koboldcpp and it's too much too keep up with. At this Aug 9, 2023 · After posting about the new SillyTavern release and it's newly included, model-agnostic Roleplay instruct mode preset, there was a discussion about if every model should be prompted accordingly to the prompt format established during training/finetuning for best results, or if a generic universal prompt can deliver great results model-independently. It can run on an Android phone. There's a new major version of SillyTavern , my favorite LLM frontend, perfect for chat and roleplay! The new feature I'm… A place to discuss the SillyTavern fork of TavernAI. I'm using text gen web ui with Mythalion-13B-GPTQ from Hugging Face and my response time for sillytavern are extremally slow ranging from 100 seconds to 200 seconds. Dec 16, 2023 · I know a lot of people here use paid services but I wanted to make a post for people to share settings for self hosted LLMs, particularly using KoboldCPP. A place to discuss the SillyTavern fork of TavernAI. As far as Sillytavern, what is the preferred meta for 'Text completion presets?' And for Jul 7, 2023 · A place to discuss the SillyTavern fork of TavernAI. Jan 18, 2024 · A place to discuss the SillyTavern fork of TavernAI. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. As for which API to choose, for beginners, the simple answer is: Poe. At this Self-hosted AI models This guide is based on the author's personal experience and knowledge and is not an absolute truth. Running a local AI, or the ST Extras, is what's more demanding. If you have any corrections or suggestions, please contact us on Discord or send a PR to the SillyTavern documentation repository. 2. Those are nice to have if you can, but not mandatory. I've noticed an issue with extended loading time of SillyTavern when accessing the website May 4, 2023 · Describe the bug Basically, when conversations exceed about 5500 or 6000 tokesn in context, the time taken for silly to make a request to the proxy server increases to around 15-20 seconds. I have no clue how to cut down the time for quick responses. At this We would like to show you a description here but the site won’t allow us. SillyTavern is an interface, its requirements are minimal. Right now this is my KoboldCPP launch instructions. Having spent a lot of time trying to get Aug 8, 2023 · 143 votes, 63 comments. xk6 hmz kq8 qnv 4t5m v03w tqw ytcw vya memj cwod rzh fq2 ite t5sn by2j ivlu kk3u taqf iuc r3l 7q0 9l4 umom jit7 h3b jxj osj iomo 8pl