SillyTavern Setup Guide (2026): Cheapest AI Roleplay, GPU Needed, Best Local Models

Stories you can play right now

‹

Isekai AdventuresStart at level one in a living fantasy RPG world. Choose your beginning. Walk your own legend.The day I reincarnated. With a daughter???A father and daughter isekai to a gentle world and live a cozy life.Romcom Reset: No Male LeadEvery heroine is doomed to die. Can a nobody like you save them?Balanced by the SystemChoose any cheat skill. Master the price that comes with it.ToxicYou woke up as the villain side-character of someone else's love story — but the hero is a psychopath.“So I’m a spider, So what?” Join in!A classmate from the destroyed Japanese classroom reincarnates on the wrong side of the Hero’s war. The System still thinks this is a game. {{user}} does not.Ascension of a SerfYou are the child of a family bound by territory-locked serfdom in which your family must pay tribute to the local lord and manage to survive the winter.The Tale of the Poker Faced SummonerFallen from grace, enjoying life with an enchanted pack of playing cards.

›

This is a complete, honest guide to the cheapest ways to run AI roleplay in 2026: SillyTavern, the GPU you actually need, which local models to download, the free and paid API options, and what each path really costs per month. It is written by the team behind ISEKAI ZERO, an AI roleplay game. We publish our margin on every credit you spend, so we have no reason to hide the alternatives. If you want the absolute cheapest setup and you enjoy tinkering, open source is the answer, and this page tells you how. We only sell the experience and the convenience.

The short version

Everything below explains where those numbers come from. Prices are as of September 2026 and move often, so check the linked source before you buy anything.

What SillyTavern actually is

SillyTavern is a free, open-source chat frontend for roleplay. That word "frontend" is the thing most newcomers miss: SillyTavern does not contain an AI. It is the interface, the character cards, the lorebooks, the memory management and the prompt formatting. The actual language model runs somewhere else, either on your own GPU through a local backend, or at a cloud API you connect with a key.

So a SillyTavern setup is always two decisions: the frontend (SillyTavern itself, which is always free) and the "brain" (which is where all the cost and all the quality lives). The current stable release is 1.18.0 (May 2026). It needs Node.js (latest LTS) and runs on Windows, macOS, Linux, Android via Termux, and Docker. There is no iOS app; on iPhone you run it on a PC or a cheap server and open it in Safari.

Step 1: install SillyTavern

Use the release branch. The staging branch is for testers and breaks.

Windows. Install Node.js LTS and Git for Windows. Make a folder outside Program Files (for example C:\ST), open a command prompt in it and run:

git clone https://github.com/SillyTavern/SillyTavern -b release
cd SillyTavern
Start.bat

Do not run it as administrator. If you prefer a guided installer, the SillyTavern Launcher installs Node, SillyTavern and popular backends for you.

macOS and Linux. Install git and Node.js from your package manager (on macOS, install Homebrew first, then brew install git node), then:

git clone https://github.com/SillyTavern/SillyTavern -b release
cd SillyTavern
bash start.sh

Android. Install Termux from F-Droid or GitHub, not the Play Store version, which is unmaintained. Then:

pkg update && pkg upgrade
pkg install git nodejs-lts nano
git clone https://github.com/SillyTavern/SillyTavern -b release
cd SillyTavern
bash start.sh

Your phone is only running the interface here. The model still lives on a PC or an API. Running a 12B model on a phone is possible with KoboldCpp in Termux but slow enough that nobody does it for fun.

Docker. The official Docker guide is the cleanest way to run SillyTavern on a home server or a $5 VPS so you can use it from every device.

When it starts, open http://localhost:8000. First thing to do is set a username and password in the User Settings, especially if you expose it to your network.

Step 2: pick a brain

Option A: free API tiers ($0, with strings attached)

OpenRouter free models. OpenRouter lists models whose ID ends in :free. As of today there are 18 of them, and the list changes without notice. Notable ones for roleplay right now are Google's Gemma 4 31B and Gemma 4 26B-A4B, and NVIDIA's Nemotron 3 Super 120B and Nemotron 3 Ultra 550B. The rate limits are 20 requests per minute, and 50 requests per day if you have never bought credits, or 1,000 requests per day once you have bought at least $10 of credits one time. Fifty messages a day is a real session; a thousand is more than most people send. Two catches: free endpoints usually allow the provider to train on your chats, and models get retired or moved to paid regularly.

Google AI Studio. The Gemini API free tier still gives Flash models away with a daily request cap (in the hundreds to low thousands per day depending on the model). Pro models became paid-only in April 2026. Gemini Flash is a competent roleplayer and the free tier is the most generous frontier-lab freebie left, but it has a safety filter you cannot fully turn off.

AI Horde. A volunteer network of people donating their GPUs. Truly free, no key needed, but you queue for a slot and the model you get is whatever is online. Good for a first taste, frustrating as a daily driver.

In SillyTavern: API menu, choose Chat Completion, pick OpenRouter or Google AI Studio, paste your key, choose the model. That is the whole setup.

Option B: paid APIs through SillyTavern (best quality per dollar)

You bring your own key, SillyTavern sends the prompt, you pay per token. Per-message cost depends mostly on how much chat history you send each turn (the context), not on the reply. A normal roleplay turn sends about 6,000 tokens of history and gets 300 back. On that basis, at September 2026 list prices:

Two things move these numbers a lot. First, context growth: if you let the chat run to 30,000 tokens without summarising, every message costs five times more. SillyTavern's summarise extension and a sensible context limit are where the real savings are. Second, prompt caching: DeepSeek and Anthropic charge a fraction for cached history, which can cut a long chat's cost by half or more if your requests are shaped to hit the cache.

The community consensus on the BenchLM roleplay ranking and the SillyTavern subreddit is consistent: the frontier Claude and GPT models write the best prose, Gemini Flash is the best value frontier model, and DeepSeek V4 Flash is the best cheap model by a wide margin, which is also why it is the default model on ISEKAI ZERO.

Option C: run it locally (privacy, no limits, one-time cost)

This is the "massive savings" path if you already own a gaming PC, and a real expense if you do not.

The rule of thumb. A model in Q4_K_M quantisation needs roughly 0.6 GB of VRAM per billion parameters, plus 1 to 3 GB for the context cache at 8k to 16k tokens, plus about 1 GB for the OS. So a 12B model wants a 12 GB card, a 24B wants 16 to 24 GB, a 27B to 31B wants 24 GB, and 70B wants 48 GB. You can spill layers into system RAM with KoboldCpp, and it works, but every layer on the CPU slows generation noticeably.

What to download, by VRAM. These are the fine-tunes the roleplay community actually runs in September 2026, with real file sizes from Hugging Face:

Newer models appear monthly. The weekly "Best Models" megathread on r/SillyTavernAI is the live source of truth, and TheDrummer's page is where most of the popular fine-tunes come from.

The GPU you need, and what it costs today.

AMD cards work through Vulkan or ROCm in KoboldCpp, but expect more fiddling and fewer guides. If you have no GPU at all, a modern CPU with 32 GB of RAM will run an 8B model at readable speed and a 12B slowly; it is free to try before you buy a card.

Electricity. A 24 GB card draws about 300 to 350 W while generating. Three hours a day, thirty days, at the US average of 18.3 cents per kWh works out to about $5 to $6 a month. A Mac mini does the same job on a fraction of that.

Renting instead of buying. If you only play a few hours a week, a cloud GPU is cheaper than a card. RunPod community cloud rents an RTX 3090 for about $0.22 an hour, an RTX 4090 for about $0.34, and a 48 GB A40 for about $0.35 (secure cloud is roughly double). Two hours a day is $13 to $20 a month, plus about $0.07 per GB per month for the storage volume that holds your models. The tradeoff is spinning up a pod and waiting for the model to load every session.

The backend. SillyTavern talks to whatever program is actually running the model:

• KoboldCpp (v1.120, August 2026) is the roleplay community's default. One executable, no install, loads GGUF files, offloads as many layers as fit onto the GPU with the rest on CPU, supports CUDA, Vulkan, ROCm and Apple Silicon. In SillyTavern choose Text Completion, KoboldCpp, address http://localhost:5001.
• Ollama (v0.34) is the easiest to install and has a model library, but it hides sampler settings and defaults to a small context window, so set num_ctx yourself. Address http://localhost:11434.
• LM Studio is the friendliest GUI for browsing and downloading models, with an OpenAI-compatible server SillyTavern can use.
• TabbyAPI with EXL2/EXL3 models is the fastest when the whole model fits in VRAM, and the most technical.

Step 3: the settings that matter

• Character cards. SillyTavern reads the standard V2/V3 PNG card format. Chub is the largest library; many Janitor AI and Character AI cards have been ported there. Import from the Characters panel.
• Instruct and context templates. Every model has a chat format it was trained on. Pick the matching template (Llama 3, Mistral, Gemma, ChatML for Qwen) in the Advanced Formatting panel or the model will ramble and break character. This one setting fixes half of all "my local model is dumb" complaints.
• Samplers. A safe starting point for the fine-tunes above: temperature 0.85, top_p 0.92, min_p 0.05, repetition penalty 1.05 to 1.1. Neutralise everything else, change one thing at a time.
• Context size. Set it to what your VRAM allows (8k to 16k locally) and turn on the Summarize extension so long chats do not fall off a cliff. On paid APIs this is also your cost control.
• Lorebooks (World Info). Keyword-triggered notes injected only when relevant. This is how you give a small model a big world without paying for it on every message.
• Extensions. Image generation (Stable Diffusion or an API), text-to-speech, vector storage for long-term memory, and group chats are built in or one click away. Each one is another thing to configure.

What it really costs per month

Assuming about 100 messages a day, which is a heavy roleplayer:

The honest reading: if you already own a 12 GB or 24 GB card, local is the cheapest roleplay there is, and the most private. If you do not, a $1,000 used 3090 takes two to three years to pay back against a DeepSeek key, so buy the card because you want a local, uncensored, unlimited setup, not to save money. If you want the best writing, a frontier API through SillyTavern is the way, and the bill scales with how disciplined you are about context.

Where ISEKAI ZERO fits

We are a service company, not an AI lab. We run the same class of models you can rent yourself, and we publish exactly where every credit goes on our transparent pricing page: 100 Arcane is $1, the AI provider gets about 77% of it, and our 30% markup is split between storyline creators (25% of it), referrers, and running the service. One dollar buys 1,000 or more full-memory messages on the default model, and up to about double that with chat summarisation on. There is a free option with a daily Mana allowance and ad top-ups if you never want to pay.

What you get for the markup is everything on this page done for you: no install, no templates, no samplers, memory and summarisation handled, a visual novel mode with generated scenes, voices, and thousands of storylines written by creators who earn from them, in 17 languages, on your phone. What you give up is model choice beyond our list and the local-only privacy of a GPU under your desk.

So: if you enjoyed reading this guide, you will probably enjoy building the local setup, and we mean that. If you got to this paragraph thinking "I just want to play", start free and skip the afternoon.

Try ISEKAI ZERO free

Stories you can play right now

‹

Aurevyn: Signatures of SilenceIn Aurevyn, names vanish from memories. Five signatures guide you through a city that must not forget you.Only Fox Girl At An Anti Fox Girl Academy A fox-girl is isekai’d into an academy where everyone hates her guts.The Creator’s First SinAfter centuries of creating for others, you - an ancient deity called The Creator, finally creates a universe that belongs only to you.Tenchi Muyo! War on GeminarSummoned to Geminar, {{user}} pilots a Sacred Mechanoid. Your unmatched skills are the only hope against a global coup.Maverick Hunter ending up in magical madoka​In industrial Mitakihara, Lucas "Cranky" McCain fights the Maverick Virus, purging corrupted machinery to secure the sector.Yuuji and the Fivefold FateYuuji becomes the Riftline’s Anchor, protected by five heroines from different realms. Together, they form the Fivefold Guard to stop the Riftline from consuming reality.Escape The Ridiculous DungeonA university class and their professor teleport to a randomized, shifting dungeon. They must level up, select classes, and escape alive.The Warlock and the nice Paladins!A magical journey begins! {{user}} is a warlock farmer and his weapon is a shovel! And he joins some expert and beautiful paladins!

›