Sillytavern api reddit /server -m path/to/model --host your. At this point they can be thought of as completely independent programs. We would like to show you a description here but the site won’t allow us. Learn more: https://sillytavernai **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Below is a description of their respective strengths, weaknesses, and use cases. Just register account on cohere and get API key. Well yes, but actually no. I need help with running the sillytavern-extra with local stable diffusion i have added the --api in the webui-user. In ST top left icon (3 bars?) is the setting for what you send via the API calls, at the bottom of this menu you can turn off sending the Jailbrake and NSFW system data. SillyTavern is a fork of TavernAI 1. com with the ZFS community as well. bat of my stable diffusion, i have used python server. 002 for every 1000 tokens. In the API tab (the plug icon) you select the API you will use for image captioning and set the API We would like to show you a description here but the site won’t allow us. sh. practicalzfs. I'm using sillytavern on mobile. # TabbyAPI. For immediate help and problem solving, please join us at https://discourse. Learn more: https://sillytavernai A place to discuss the SillyTavern fork of TavernAI. After, mancer. With sillytavern you can use: Free Cohere CommandR+ api. 11. , which can be a bit confusing. Then paste your api code into the api key. You get 25$ free credit for creating an account (also free). cpp server directly supports OpenAi api now, and Sillytavern has a llama. It may be possible to a simple Adetailer menu in the configuration, and then send these settings through the Adetailed API (API · Bing-su/adetailer Wiki · GitHub). Think of kobold as a web server. No phone verification needed. Then, I started exploring NovelAi interface, and wow man, it's awesome. # API Connections. I can successfully connect the API to the URL and I have a model loaded into Kobold. The better quality prose you use, the better results you'll get. Privated to protest Reddit's upcoming API The Summarize with MainAPI option appears to include a "summarize" button, whereas the Summarize with Extras API does not seem to provide any similar functionality. SillyTavern can connect to a wide range of LLM APIs. Any help would be appreciated. Mar 20, 2025 · What it offers: * 405B parameter model trained in-house specifically optimized for roleplay and creative writing * Fully compatible with OpenAI API format (works with existing frontends/workflows) * No content moderation or logging of user prompts or model responses * Detailed SillyTavern setup instructions at https://docs. But it doesn't seem to want to connect. keep in mind, all of these ai's are still a work in progress and aren't going to run perfectly :) then run the script with bash install-poe-api-server. It is free but the moment you start using it on sillytavern, it will charge based on the prompt sent to the api and the text completed. Now the Main Problem is that even after connecting with the API I am not getting any Reply to any messages I send to the bots **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Under Chat Completion Source. NovelAI will get actively worse to the point of incoherence if you feed it bad content. Second choice: TogetherAI. I have tried launching the extras server with the simple launcher's UI, but I don't see anything new happening in the command prompt. 8 but I legit dk what to do and how to use it. tech is probably the best. I installed alltalk on my pc, everything on the installation went without error, started it and now it won't even connect to sillytavern. Basically i haven't tried to use Claude after the whole Poe thing awhile back and was wondering what the best ways to get a Claude api key or some other way to use it for SillyTavern after Poe stopped being officially supported? We would like to show you a description here but the site won’t allow us. Can access easily by their API (Cohore). Title. Use Kobold Horde for free to figure stuff out like how to use SillyTavern’s functions (use an api key, it’s free and easy, gives you priority access). Instead of openrouter, use free budget on services like DeepInfra and run Mixtral 8x22b or WizardLM 8x22b. The issue I've seen for some is literally just how comfortable you are with English. Getting the API key is simple. py. You're going to choose chat completion. Yeah Claude was big months ago, people are still trying it with Slack (and getting banned), OpenAI has been cracking down on NSFW stuff, and Kobold A place to discuss the SillyTavern fork of TavernAI. I cannot, for the life of me, figure out why it isn't working. The charge is based on tokens, with 1000 tokens = ~500 - 750 words. ai/v1 in the server URL section. " and "Bad Request". Once that's done or If you're already up to date then in the menu where you select API connect to OpenRouter as usual and then click on "Force Instruct Mode Formatting" This will make OpenRouter models listen to the Instruct Mode. Dec 17, 2024 · Edit: To use it on SillyTavern, You'll have to paste https://api. So to put it simply: No. The documentation suggests that using the Main API for summarization is preferable, as it utilizes the deployed LLM model. You will get very smart multilingual model for free without noticable restrictions. It says it is processing, so it detects alltalk running, but then just gives back "error". com **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. If you then send the 'test message' you will see the API works on the LMS side. Lightweight Exllamav2-based API with streaming; Supports Exl2, GPTQ, and FP16 models; Official extension allows loading/unloading models directly from SillyTavern; Not recommended for users with low VRAM (no CPU offloading) GitHub use the following search parameters to narrow your results: subreddit:subreddit find submissions in "subreddit" author:username find submissions by "username" site:example. I have Stable Diffusion set up to run with --api so that I have something to send to the extras extension, but the extras extension just has the red text that says "Could not connect to API". , I have 0 knowledge on coding, I just want to erp bruv, how and what API do I even install and how do I proceed from there thanks in advance A place to discuss the SillyTavern fork of TavernAI. At this then run the script with bash install-poe-api-server. Depending on the bot/API that you use, you may encounter a filter. You can change the API hosting port with the --api-port 5001 flag, where 5001 is your custom port. Mar 20, 2025 · Just wanted to share that Realmplay’s API is now generally available with full SillyTavern integration! What it offers: * 405B parameter model trained in-house specifically optimized for roleplay and creative writing * Fully compatible with OpenAI API format (works with existing frontends/workflows) * No content moderation or logging of user prompts or model responses * Detailed SillyTavern **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. I believe someone did something similar for ControlNet a few months ago: ControlNet add-in for SD Extension : SillyTavernAI (reddit. Usually you can get a free trial of $5 worth of tokens. Claude's api with jailbreaking system prompts and output prepending is best option for rp I have tried. I wanted to use Silly Tavern with a TheBloke model from hugging face while on my laptop, so I quickly coded a simple Google Colab that gives you the required API key for SillyTavern. You connect sillytavern to the kobold server with the API URL in settings. It will not have a filter. Then generate your api keys. and the poe server always comes back with internal server error. EDIT: When using option 2 (multimodal) it will have a dropdown to select the API to use but nowhere to enter the API address, only this: Hint: Set your API keys and endpoints in the 'API Connections' tab first. I've disabled the api tag, and made sure the --extension openai flag is applied. 5 turbo is $. This will then allow the conversations to work correctly. i've been using it for a while, and have had no problems! sometimes the characters or the ai in general freaks out a bit and reacts differently then normal. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Edit: To use it on SillyTavern, You'll have to paste https://api. Cohere's own API, which has a section under Chat Completion in the API menu in SillyTavern. Choose mistral. I'm using the same configuration as with the Anthropic and OpenAI APIs so I'm a bit lost. After using Cohere's playground and thinking it was pretty good, I wanted to play with it on SillyTavern. Yes you need to generate a key. I've checked, and the api is correct. 2. Open SillyTavern from another terminal or new termux session and do this: **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Launch the server with . The API by default uses grok-2-1212 model for now. what other good free ones are there? Dec 17, 2024 · If it's OpenAI compatible can anyone tell me what my API key should look like as the URL. At this **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 8 which is under more active development, and has added many major features. SillyTavern will handle the jailbreaking process so that you will be able to chat with characters without the filter interfering. Step 2: Run & Configure SillyTavern. But I can't seem to find a way to get an API from SillyTavern (like you can with, for example, GPT4All) to put it into a Discord bot, and respond to messages from Discord. here --port port -ngl gpu_layers -c context, then set the ip and port in ST. Sign up with Cohere on their website, get a free trial key. Other APIs work such as Moe and KoboldAI Horde, but KoboldAI isn't working. ip. Members Online **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. I've tried all 3 options, none work. So I just installed SillyTavern 1. but i still can't generate image using my local stable diffusion all i can see is the horde option We would like to show you a description here but the site won’t allow us. But when I type messages into SillyTavern, I get no responses. Use it in SillyTavern Step 1: Run the program. You have to load the model into the web server. Edit: I got it to finally work. SillyTavern has very serviceable presets, so no problem there. SillyTavern itself is just an interface, it has no filter built-in. If you did not use it just run python app/app. At this And I forgot to mention that they give you 10k credits to generate images on the NovelAI site itself, and use the NovelAI site without the api which is also very interesting, I used to use it before as it was not so good the compatibility with sillytavern, but now it is very good the API together with SillyTavern. cpp option in the backend dropdown menu. Their give you a lot of model to use on their site and their API, like mixtral 8x22 or WizardLM2 8x22 which is very good at RP. The cost with gpt3. Click it. Sillytavern doesn’t use the model directly, it just tells kobold what you type, formatted in a way that kobold and the model it’s running can understand. Copy it and make sure to save it somewhere secure as you will not be able to see the full thing again. com) By the way, thank you for the useful extension! I'm trying to use the OpenAI extension for the Text Generation Web UI, as recommended by the guide, but SillyTavern just won't connect, no matter what. Is there a way to do something like this, or should I just put the the prompts and all that and put them somewhere else that will properly work with Discord? **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. But the moment I try to verify API connection using the test message, it comes back as "Could not get a reply from API. Update SillyTavern if you haven't done so in a while. x. I have both installed and both running. Im almost to the point of making a bounty to get this shit working. From my testing, it generates a response in around 8-11 seconds. A place to discuss the SillyTavern fork of TavernAI. silly-tavern is safe, yes! what the other posts are talking about is some other form of API, but the one you are using is perfectly safe. 128k context. realmplay. Reply reply More replies More replies More replies **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. py--enable-modules=sd-remote when using the sillytavern-extra. This subreddit has gone Restricted and reference-only as part of a mass protest against Reddit's recent API changes, which break third-party apps and moderation tools. So much better than trying to keep something consistent in SillyTavern with twisted settings. Then in silly tavern you are going to go to api selection. If you used the script I mentioned before, just run bash start. The llama. # ELI5: Chat Completions vs Text Completions Ever since poe has been removed, silly tavern just feels really complicated and another bad ai, and the only good ones are chatgpt but the api key is behind a paywall. . local LLM, Faraday, and NovelAI api, but nothing came close to what chatgpt offers in terms of quality. Free cohere's commandr+ api is good too. The free API access is unexpectedly good with 6 request per min and 1000 request per month. ai. Open SillyTavern from another terminal or new termux session and do this: A place to discuss the SillyTavern fork of TavernAI. Sillytavern says (could not connect to the API) i want to try out all of the features but no dice. Mixtral 8x22b on openrouter/deepinfra etc is good too. and You can paste the API key in API key field. I tried Mancer,. fohe iipcunf bvqe oevy ofrbbu qevgt uxnslylz spc wez sho