Will this GGUF model run on your PC? See on Hugging Face how many layers fit in VRAM and what context you can afford.
Users
2
store count
Rating
0.0 / 5
unchanged in 30 days
Ratings
0
total ratings
Store rank
#346K
#288K among extensions
Version
0.1.2
updated 21 Nov 2026
Publisher and listing changes
From our daily record of this listing since 11 Nov 2026
No change of publisher name, contact email, website, privacy policy or listing name since 11 Nov 2026.
About LlamaToaster
• Every GGUF quant gets a fit mark: all on the GPU, partial offload, or not enough memory
• See how many layers fit in your VRAM and how much goes to RAM, MoE experts included
• Move the context slider and every mark updates at once
• Reads only a few megabytes per quant. No account, no tracking
Stop downloading 20 GB to find out it crashes with out-of-memory, or quietly slows down because part of the model spilled from VRAM into RAM.
▶ THE MARKS, FROM BEST TO WORST
• All layers on the GPU, at the model's maximum context
• All layers on the GPU, at your context
• All layers on the GPU, with the MoE experts in RAM
• Partial offload: half or more of the layers on the GPU
• Partial offload: under half of the layers on the GPU
• Not enough memory
Open a model page, click the toaster, and hover a mark for the figures: VRAM and RAM needed, layers on the GPU, KV cache, file size.
▶ HOW IT WORKS
LlamaToaster reads only the model's own header (a few megabytes per quant, with small HTTP range requests; never the model itself) and places it on your GPU and RAM the way llama.cpp's own fit logic does, including the KV cache for your chosen context and MoE layouts. It covers the architectures llama.cpp supports and works with Windows, macOS and Linux machines.
▶ HOW ACCURATE IS IT
Memory estimates are typically within about 10% of what llama.cpp actually uses; a few models are further off. For a precise answer and real speed measurements on your own hardware, use LlamaToaster itself (llamatoaster.com).
▶ THIS MACHINE
The popup shows your CPU, RAM (with type and speed when known) and GPU. Choose how much memory to keep free, or use what your apps hold right now. Override the VRAM size or the memory type (dedicated, unified, CPU only) if the detection is wrong.
▶ MEASURED VRAM (OPTIONAL)
Browsers cannot report free VRAM. If you install a LlamaToaster worker on the same computer, the extension reads the real figure through a local helper (AMD, Intel, NVIDIA and Apple silicon). Without it, VRAM comes from a table of known cards and the whole card counts as free, and the popup says so.
▶ MANUAL OR AUTO
Manual: nothing is read until you click the toaster. Auto: every model page is checked as it opens. You can dock the popup as a side panel.
▶ PRIVATE BY DESIGN
No account, no analytics, no tracking, no servers of ours. Everything runs in your browser and your settings stay on your device. The extension only runs on huggingface.co.
Open source (MIT): github.com/LlamaToaster/extension
Growth
Window
Users
Change
Ratings
Rating
7 days
+1
+100.0%
0
0.00
Version history
3 versions recorded
No update since 11 Nov 2026 changed the permissions or site access.