◆  The model space

A large space.
A small subset fits.

348 models from 15 developers, in 993 quantizations. Most of them won't run well on any given machine — the point of the engine is to find the ones that do. Run the hardware analysis for a ranking tuned to yours.

348 models · 3B – 72BParameter scale · log
← a 12 GB card reaches ~14B
3B7B14B32B70B

The catalogue

Use case

348 / 348 models

Falcon 180B

TII · Transformer

Params180BContext2KMin VRAM≥ 102.2 GBGeneralMax intelligence

Zephyr 141B

Ollama library · Transformer

Params141BContext64KMin VRAM≥ 81.2 GBGeneralMax intelligence

Dbrx 132B

Ollama library · Transformer

Params132BContext32KMin VRAM≥ 75.2 GBGeneralMax intelligence

Mistral Medium 3.5 128B

Mistral AI · Mistral

Params128BContext256KMin VRAM≥ 81.2 GBGeneralMax intelligence

Devstral 2 123B

Ollama library · Transformer

Params123BContext256KMin VRAM≥ 76.2 GBGeneralMax intelligence

Mistral Large 123B

Mistral AI · Mistral

Params123BContext128KMin VRAM≥ 74.2 GBGeneralMax intelligence

Qwen 3.5 122B

Alibaba · Qwen

Params122BContext256KMin VRAM≥ 82.2 GBGeneralMax intelligence

Gpt Oss 120B

OpenAI · Transformer

Params120BContext128KMin VRAM≥ 66.2 GBGeneralMax intelligence

Gpt Oss Safeguard 120B

OpenAI · Transformer

Params120BContext128KMin VRAM≥ 66.2 GBGeneralMax intelligence

Megadolphin 120B

Ollama library · Phi

Params120BContext4KMin VRAM≥ 69.2 GBGeneralMax intelligence

Nemotron 3 Super 120B

NVIDIA · Mistral

Params120BContext256KMin VRAM≥ 88.2 GBGeneralMax intelligence

Command A 111B

Cohere · Transformer

Params111BContext16KMin VRAM≥ 68.2 GBGeneralMax intelligence

Qwen 110B

Alibaba · Qwen

Params110BContext32KMin VRAM≥ 64.2 GBGeneralMax intelligence

Command R Plus 104B

Cohere · Transformer

Params104BContext128KMin VRAM≥ 60.2 GBGeneralMax intelligence

Llama 3.2 Vision 90B

Meta · LLaMA

Params90BContext128KMin VRAM≥ 56.2 GBGeneralMax intelligence

Qwen 3 Next 80B

Alibaba · Qwen

Params80BContext256KMin VRAM≥ 51.2 GBGeneralMax intelligence

Athene V 2 72B

Ollama library · Transformer

Params72BContext32KMin VRAM≥ 48.2 GBGeneralMax intelligence

Qwen 2 72B

Alibaba · Qwen

Params72BContext32KMin VRAM≥ 42.2 GBGeneralMax intelligence

Qwen 2 Math 72B

Alibaba · Qwen

Params72BContext4KMin VRAM≥ 42.2 GBGeneralMax intelligence

Qwen 2.5 72B

Alibaba · Qwen

Params72BContext32KMin VRAM≥ 48.2 GBGeneralReasoningCodingMax intelligence

Qwen 2.5vl 72B

Alibaba · Qwen

Params72BContext125KMin VRAM≥ 50.2 GBGeneralMax intelligence

Qwen 72B

Alibaba · Qwen

Params72BContext32KMin VRAM≥ 42.2 GBGeneralMax intelligence

Codellama 70B

Meta · LLaMA

Params70BContext2KMin VRAM≥ 40.2 GBGeneralCodingMax intelligence

Cogito 70B

Ollama library · Transformer

Params70BContext128KMin VRAM≥ 44.2 GBGeneralMax intelligence

Deepseek R 1 70B

DeepSeek · DeepSeek

Params70BContext128KMin VRAM≥ 44.2 GBGeneralReasoningMax intelligence

Dolphin Llama 3 70B

Ollama library · LLaMA

Params70BContext8KMin VRAM≥ 41.2 GBGeneralMax intelligence

Firefunction V 2 70B

Ollama library · Transformer

Params70BContext8KMin VRAM≥ 41.2 GBGeneralMax intelligence

Hermes 3 70B

Ollama library · Transformer

Params70BContext128KMin VRAM≥ 41.2 GBGeneralMax intelligence

Llama 2 70B

Meta · LLaMA

Params70BContext4KMin VRAM≥ 40.2 GBGeneralMax intelligence

Llama 2 Uncensored 70B

Meta · LLaMA

Params70BContext2KMin VRAM≥ 40.2 GBGeneralMax intelligence

Llama 3 70B

Meta · LLaMA

Params70BContext8KMin VRAM≥ 41.2 GBGeneralMax intelligence

Llama 3 Chatqa 70B

Meta · LLaMA

Params70BContext8KMin VRAM≥ 41.2 GBGeneralMax intelligence

Llama 3 Groq Tool Use 70B

Meta · LLaMA

Params70BContext8KMin VRAM≥ 41.2 GBGeneralMax intelligence

Llama 3.3 70B

Meta · LLaMA

Params70BContext128KMin VRAM≥ 44.2 GBGeneralMax intelligence

Meditron 70B

Ollama library · Transformer

Params70BContext4KMin VRAM≥ 40.2 GBGeneralMax intelligence

Nemotron 70B

NVIDIA · Mistral

Params70BContext128KMin VRAM≥ 44.2 GBGeneralMax intelligence

Orca Mini 70B

Ollama library · Transformer

Params70BContext4KMin VRAM≥ 40.2 GBGeneralMax intelligencePrivacy

R 1 1776 70B

Ollama library · Transformer

Params70BContext128KMin VRAM≥ 44.2 GBGeneralReasoningMax intelligence

Reflection 70B

Ollama library · Transformer

Params70BContext128KMin VRAM≥ 41.2 GBGeneralMax intelligence

Stable Beluga 70B

Ollama library · Transformer

Params70BContext4KMin VRAM≥ 40.2 GBGeneralMax intelligence

Tulu 3 70B

Ollama library · Transformer

Params70BContext128KMin VRAM≥ 44.2 GBGeneralMax intelligence

Wizard Math 70B

Ollama library · Transformer

Params70BContext2KMin VRAM≥ 40.2 GBGeneralMax intelligence

Deepseek Llm 67B

DeepSeek · DeepSeek

Params67BContext4KMin VRAM≥ 39.2 GBGeneralMax intelligence

Alfred 40B

Ollama library · Transformer

Params40BContext2KMin VRAM≥ 25.2 GBGeneralMax intelligence

Falcon 40B

TII · Transformer

Params40BContext2KMin VRAM≥ 25.2 GBGeneralMax intelligence

Aya 35B

Ollama library · Transformer

Params35BContext8KMin VRAM≥ 21.2 GBGeneralMax intelligence

Command R 35B

Cohere · Transformer

Params35BContext128KMin VRAM≥ 20.2 GBGeneralMax intelligence

Ornith 1.5 35B

Ollama library · Transformer

Params35BContext256KMin VRAM≥ 24.2 GBGeneralMax intelligence

Ornith 35B

Ollama library · Transformer

Params35BContext256KMin VRAM≥ 22.2 GBGeneralMax intelligence

Qwen 3.5 35B

Alibaba · Qwen

Params35BContext256KMin VRAM≥ 25.2 GBGeneralMax intelligence

Qwen 3.6 35B

Alibaba · Qwen

Params35BContext256KMin VRAM≥ 24.2 GBGeneralMax intelligence

Codebooga 34B

Ollama library · Transformer

Params34BContext16KMin VRAM≥ 20.2 GBGeneralCodingMax intelligence

Codellama 34B

Meta · LLaMA

Params34BContext16KMin VRAM≥ 20.2 GBGeneralCodingMax intelligence

Granite Code 34B

IBM · Granite

Params34BContext8KMin VRAM≥ 20.2 GBGeneralCodingMax intelligence

Llava 34B

Ollama library · Transformer

Params34BContext4KMin VRAM≥ 21.2 GBGeneralMax intelligence

Nous Hermes 2 34B

Ollama library · Transformer

Params34BContext4KMin VRAM≥ 20.2 GBGeneralMax intelligence

Phind Codellama 34B

Microsoft · LLaMA

Params34BContext16KMin VRAM≥ 20.2 GBGeneralCodingMax intelligence

Yi 34B

01.AI · Transformer

Params34BContext4KMin VRAM≥ 20.2 GBGeneralMax intelligence

Deepseek Coder 33B

DeepSeek · DeepSeek

Params33BContext16KMin VRAM≥ 20.2 GBGeneralCodingMax intelligence

Nemotron 3 33B

NVIDIA · Mistral

Params33BContext128KMin VRAM≥ 29.2 GBGeneralMax intelligence

Vicuna 33B

Ollama library · Transformer

Params33BContext2KMin VRAM≥ 19.2 GBGeneralMax intelligence

Wizardcoder 33B

Ollama library · Transformer

Params33BContext16KMin VRAM≥ 20.2 GBGeneralCodingMax intelligence

Aya Expanse 32B

Ollama library · Transformer

Params32BContext8KMin VRAM≥ 21.2 GBGeneralMax intelligence

Cogito 32B

Ollama library · Transformer

Params32BContext128KMin VRAM≥ 21.2 GBGeneralMax intelligence

DeepSeek R1 Distill 32B

DeepSeek · DeepSeek

Params32BContext128KMin VRAM≥ 21.2 GBReasoningMax intelligence

Exaone 3.5 32B

Ollama library · Transformer

Params32BContext32KMin VRAM≥ 20.2 GBGeneralMax intelligence

Exaone Deep 32B

Ollama library · Transformer

Params32BContext32KMin VRAM≥ 20.2 GBGeneralMax intelligence

Olmo 3 32B

Ai2 · Transformer

Params32BContext64KMin VRAM≥ 20.2 GBGeneralMax intelligence

Olmo 3.1 32B

Ai2 · Transformer

Params32BContext64KMin VRAM≥ 20.2 GBGeneralMax intelligence

Openthinker 32B

Ollama library · Transformer

Params32BContext32KMin VRAM≥ 21.2 GBGeneralMax intelligence

Qwen 2.5 32B

Alibaba · Qwen

Params32BContext32KMin VRAM≥ 21.2 GBGeneralMax intelligence

Qwen 2.5 Coder 32B

Alibaba · Qwen

Params32BContext32KMin VRAM≥ 21.2 GBGeneralCodingMax intelligence

Qwen 2.5vl 32B

Alibaba · Qwen

Params32BContext125KMin VRAM≥ 22.2 GBGeneralMax intelligence

Qwen 3 32B

Alibaba · Qwen

Params32BContext40KMin VRAM≥ 21.2 GBGeneralMax intelligence

Qwen 3 Vl 32B

Alibaba · Qwen

Params32BContext256KMin VRAM≥ 22.2 GBGeneralMax intelligence

Qwen 32B

Alibaba · Qwen

Params32BContext32KMin VRAM≥ 19.2 GBGeneralMax intelligence

Qwq 32B

Ollama library · Transformer

Params32BContext40KMin VRAM≥ 21.2 GBGeneralReasoningMax intelligence

Gemma 4 31B

Google · Gemma

Params31BContext256KMin VRAM≥ 21.2 GBGeneral

Granite 4.1 30B

IBM · Granite

Params30BContext128KMin VRAM≥ 18.2 GBGeneral

Granite 4.2 30B

IBM · Granite

Params30BContext128KMin VRAM≥ 19.2 GBGeneral

Muse Glimmer 30B

Ollama library · Transformer

Params30BContext128KMin VRAM≥ 19.2 GBGeneral

Nemotron Cascade 2 30B

NVIDIA · Mistral

Params30BContext256KMin VRAM≥ 25.2 GBGeneral

Qwen 3 30B

Alibaba · Qwen

Params30BContext256KMin VRAM≥ 20.2 GBGeneral

Qwen 3 Coder 30B

Alibaba · Qwen

Params30BContext256KMin VRAM≥ 20.2 GBGeneralCoding

Qwen 3 Vl 30B

Alibaba · Qwen

Params30BContext256KMin VRAM≥ 21.2 GBGeneral

Wizard Vicuna Uncensored 30B

Ollama library · Transformer

Params30BContext2KMin VRAM≥ 19.2 GBGeneral

Gemma 2 27B

Google · Gemma

Params27BContext8KMin VRAM≥ 17.2 GBGeneral

Gemma 3 27B

Google · Gemma

Params27BContext128KMin VRAM≥ 18.2 GBGeneralReasoningWritingMax intelligence

Medgemma 27B

Ollama library · Gemma

Params27BContext128KMin VRAM≥ 18.2 GBGeneral

Qwen 3.5 27B

Alibaba · Qwen

Params27BContext256KMin VRAM≥ 18.2 GBGeneral

Qwen 3.6 27B

Alibaba · Qwen

Params27BContext256KMin VRAM≥ 19.2 GBGeneral

Qwen 3.8 27B

Alibaba · Qwen

Params27BContext256KMin VRAM≥ 19.2 GBGeneral

Shieldgemma 27B

Ollama library · Gemma

Params27BContext8KMin VRAM≥ 18.2 GBGeneral

Translategemma 27B

Ollama library · Gemma

Params27BContext128KMin VRAM≥ 18.2 GBGeneral

Gemma 4 26B

Google · Gemma

Params26BContext256KMin VRAM≥ 20.2 GBGeneral

Devstral 24B

Ollama library · Transformer

Params24BContext128KMin VRAM≥ 15.2 GBGeneral

Devstral Small 2 24B

Ollama library · Transformer

Params24BContext384KMin VRAM≥ 16.2 GBGeneral

Lfm 2 24B

Ollama library · Transformer

Params24BContext32KMin VRAM≥ 15.2 GBGeneral

Magistral 24B

Ollama library · Transformer

Params24BContext39KMin VRAM≥ 15.2 GBGeneral

Mistral Small 24B

Mistral AI · Mistral

Params24BContext32KMin VRAM≥ 15.2 GBGeneral

Mistral Small 3.1 24B

Mistral AI · Mistral

Params24BContext128KMin VRAM≥ 16.2 GBGeneral

Mistral Small 3.2 24B

Mistral AI · Mistral

Params24BContext128KMin VRAM≥ 16.2 GBGeneral

Codestral 22B

Mistral AI · Mistral

Params22BContext32KMin VRAM≥ 14.2 GBCoding

Mistral Small 22B

Mistral AI · Mistral

Params22BContext128KMin VRAM≥ 14.2 GBGeneral

Solar Pro 22B

Ollama library · Transformer

Params22BContext4KMin VRAM≥ 14.2 GBGeneral

Gpt Oss 20B

OpenAI · Transformer

Params20BContext128KMin VRAM≥ 15.2 GBGeneral

Gpt Oss Safeguard 20B

OpenAI · Transformer

Params20BContext128KMin VRAM≥ 15.2 GBGeneral

Granite Code 20B

IBM · Granite

Params20BContext8KMin VRAM≥ 13.2 GBGeneralCoding

Internlm 2 20B

Ollama library · Transformer

Params20BContext32KMin VRAM≥ 12.2 GBGeneral

Sailor 2 20B

Ollama library · Transformer

Params20BContext32KMin VRAM≥ 13.2 GBGeneral

Deepseek Coder V 2 16B

DeepSeek · DeepSeek

Params16BContext160KMin VRAM≥ 10.1 GBGeneralCoding

Deepseek V 2 16B

DeepSeek · DeepSeek

Params16BContext160KMin VRAM≥ 10.1 GBGeneral

Dolphincoder 15B

Ollama library · Phi

Params15BContext16KMin VRAM≥ 10.3 GBGeneralCoding

Sqlcoder 15B

Ollama library · Transformer

Params15BContext8KMin VRAM≥ 10.2 GBGeneralCoding

Starcoder 15B

Ollama library · Transformer

Params15BContext8KMin VRAM≥ 10.2 GBGeneralCoding

Starcoder 2 15B

Ollama library · Transformer

Params15BContext16KMin VRAM≥ 10.3 GBGeneralCoding

Cogito 14B

Ollama library · Transformer

Params14BContext128KMin VRAM≥ 10.2 GBGeneral

Deepcoder 14B

Ollama library · Transformer

Params14BContext128KMin VRAM≥ 10.2 GBGeneralCoding

DeepSeek R1 Distill 14B

DeepSeek · DeepSeek

Params14BContext128KMin VRAM≥ 10.2 GBReasoningCodingMax intelligence

Ministral 3 14B

Mistral AI · Transformer

Params14BContext256KMin VRAM≥ 10.3 GBGeneralPrivacy

Phi 3 14B

Microsoft · Phi

Params14BContext128KMin VRAM≥ 9.1 GBGeneralPrivacy

Phi 4 14B

Microsoft · Phi

Params14BContext16KMin VRAM≥ 10.3 GBReasoningCodingMax intelligence

Phi 4 Reasoning 14B

Microsoft · Phi

Params14BContext32KMin VRAM≥ 12.2 GBGeneralReasoning

Qwen 14B

Alibaba · Qwen

Params14BContext32KMin VRAM≥ 9.4 GBGeneral

Qwen 2.5 14B

Alibaba · Qwen

Params14BContext32KMin VRAM≥ 10.2 GBGeneral

Qwen 2.5 Coder 14B

Alibaba · Qwen

Params14BContext32KMin VRAM≥ 10.2 GBGeneralCoding

Qwen 3 14B

Alibaba · Qwen

Params14BContext40KMin VRAM≥ 10.5 GBGeneral

Codellama 13B

Meta · LLaMA

Params13BContext16KMin VRAM≥ 8.6 GBGeneralCoding

Codeup 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneralCoding

Everythinglm 13B

Ollama library · Transformer

Params13BContext16KMin VRAM≥ 8.6 GBGeneral

Llama 2 13B

Meta · LLaMA

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Llama 2 Chinese 13B

Meta · LLaMA

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Llava 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 9.2 GBGeneral

Nexusraven 13B

Ollama library · Transformer

Params13BContext16KMin VRAM≥ 8.6 GBGeneral

Nous Hermes 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Olmo 2 13B

Ai2 · Transformer

Params13BContext4KMin VRAM≥ 9.6 GBGeneral

Open Orca Platypus 2 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Orca 2 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Orca Mini 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneralPrivacy

Stable Beluga 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Vicuna 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Wizard Math 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Wizard Vicuna 13B

Ollama library · Transformer

Params13BContext2KMin VRAM≥ 8.6 GBGeneral

Wizard Vicuna Uncensored 13B

Ollama library · Transformer

Params13BContext2KMin VRAM≥ 8.6 GBGeneral

Wizardlm Uncensored 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Xwinlm 13B

Ollama library · Transformer

Params13BContext4KMin VRAM≥ 8.6 GBGeneral

Yarn Llama 2 13B

Ollama library · LLaMA

Params13BContext64KMin VRAM≥ 8.6 GBGeneral

Gemma 3 12B

Google · Gemma

Params12BContext128KMin VRAM≥ 9.3 GBGeneralWritingReasoning

Gemma 4 12B

Google · Gemma

Params12BContext256KMin VRAM≥ 8.8 GBGeneral

Mistral Nemo 12B

Mistral AI · Mistral

Params12BContext1000KMin VRAM≥ 8.3 GBGeneralWritingPrivacy

Stablelm 2 12B

Ollama library · Transformer

Params12BContext4KMin VRAM≥ 8.2 GBGeneral

Translategemma 12B

Ollama library · Gemma

Params12BContext128KMin VRAM≥ 9.3 GBGeneral

Falcon 2 11B

TII · Transformer

Params11BContext2KMin VRAM≥ 7.6 GBGeneral

Llama 3.2 Vision 11B

Meta · LLaMA

Params11BContext128KMin VRAM≥ 9 GBGeneral

Nous Hermes 2 10.7B

Ollama library · Transformer

Params10.7BContext4KMin VRAM≥ 7.3 GBGeneral

Solar 10.7B

Ollama library · Transformer

Params10.7BContext4KMin VRAM≥ 7.3 GBGeneral

Falcon 3 10B

TII · Transformer

Params10BContext32KMin VRAM≥ 7.5 GBGeneral

Codegeex 4 9B

Ollama library · Transformer

Params9BContext128KMin VRAM≥ 6.7 GBGeneralCoding

Gemma 2 9B

Google · Gemma

Params9BContext8KMin VRAM≥ 6.6 GBGeneral

Glm 4 9B

Ollama library · Transformer

Params9BContext128KMin VRAM≥ 6.7 GBGeneral

Ornith 1.5 9B

Ollama library · Transformer

Params9BContext256KMin VRAM≥ 7.8 GBGeneral

Ornith 9B

Ollama library · Transformer

Params9BContext256KMin VRAM≥ 6.8 GBGeneral

Qwen 3.5 9B

Alibaba · Qwen

Params9BContext256KMin VRAM≥ 7.8 GBGeneral

Shieldgemma 9B

Ollama library · Gemma

Params9BContext8KMin VRAM≥ 7 GBGeneral

Yi 9B

01.AI · Transformer

Params9BContext4KMin VRAM≥ 6.2 GBGeneral

Yi Coder 9B

01.AI · Transformer

Params9BContext128KMin VRAM≥ 6.2 GBGeneralCoding

Aya 8B

Ollama library · Transformer

Params8BContext8KMin VRAM≥ 6 GBGeneralFast

Aya Expanse 8B

Ollama library · Transformer

Params8BContext8KMin VRAM≥ 6.3 GBGeneralFast

Cogito 8B

Ollama library · Transformer

Params8BContext128KMin VRAM≥ 6.1 GBGeneralFast

Deepseek R 1 8B

DeepSeek · DeepSeek

Params8BContext128KMin VRAM≥ 6.4 GBGeneralReasoningFast

Dolphin 3 8B

Ollama library · Phi

Params8BContext128KMin VRAM≥ 6.1 GBGeneralFast

Dolphin Llama 3 8B

Ollama library · LLaMA

Params8BContext8KMin VRAM≥ 5.9 GBGeneralFast

Granite 3 Dense 8B

IBM · Granite

Params8BContext4KMin VRAM≥ 6.1 GBGeneralFast

Granite 3 Guardian 8B

IBM · Granite

Params8BContext8KMin VRAM≥ 7 GBGeneralFast

Granite 3.1 Dense 8B

IBM · Granite

Params8BContext128KMin VRAM≥ 6.2 GBGeneralFast

Granite 3.2 8B

IBM · Granite

Params8BContext128KMin VRAM≥ 6.1 GBGeneralFast

Granite 3.3 8B

IBM · Granite

Params8BContext128KMin VRAM≥ 6.1 GBGeneralFast

Granite 4.1 8B

IBM · Granite

Params8BContext128KMin VRAM≥ 6.5 GBGeneralFast

Granite 4.1 Guardian 8B

IBM · Granite

Params8BContext128KMin VRAM≥ 8.1 GBGeneralFast

Granite 4.2 8B

IBM · Granite

Params8BContext128KMin VRAM≥ 6.5 GBGeneralFast

Granite Code 8B

IBM · Granite

Params8BContext125KMin VRAM≥ 5.8 GBGeneralCodingFast

Hermes 3 8B

Ollama library · Transformer

Params8BContext128KMin VRAM≥ 5.9 GBGeneralFast

Lfm 2.5 8B

Ollama library · Transformer

Params8BContext125KMin VRAM≥ 6.4 GBGeneralFast

Llama 3 8B

Meta · LLaMA

Params8BContext8KMin VRAM≥ 5.9 GBGeneralFast

Llama 3 Chatqa 8B

Meta · LLaMA

Params8BContext8KMin VRAM≥ 5.9 GBGeneralFast

Llama 3 Groq Tool Use 8B

Meta · LLaMA

Params8BContext8KMin VRAM≥ 5.9 GBGeneralFast

Llama Guard 3 8B

Meta · LLaMA

Params8BContext128KMin VRAM≥ 6.1 GBGeneralFast

Llava Llama 3 8B

Ollama library · LLaMA

Params8BContext8KMin VRAM≥ 6.7 GBGeneralFast

Minicpm V 4.5 8B

Ollama library · Transformer

Params8BContext40KMin VRAM≥ 7.3 GBGeneralFastPrivacy

Minicpm V 8B

Ollama library · Transformer

Params8BContext32KMin VRAM≥ 6.7 GBGeneralFastPrivacy

Ministral 3 8B

Mistral AI · Transformer

Params8BContext256KMin VRAM≥ 7.2 GBGeneralFastPrivacy

Opencoder 8B

Ollama library · Transformer

Params8BContext8KMin VRAM≥ 5.9 GBGeneralCodingFast

Qwen 3 8B

Alibaba · Qwen

Params8BContext40KMin VRAM≥ 6.4 GBGeneralFast

Qwen 3 Vl 8B

Alibaba · Qwen

Params8BContext256KMin VRAM≥ 7.3 GBGeneralFast

Rnj 1 8B

Ollama library · Transformer

Params8BContext32KMin VRAM≥ 6.3 GBGeneralFast

Sailor 2 8B

Ollama library · Transformer

Params8BContext32KMin VRAM≥ 6.4 GBGeneralFast

Tulu 3 8B

Ollama library · Transformer

Params8BContext128KMin VRAM≥ 6.1 GBGeneralFast

Exaone 3.5 7.8B

Ollama library · Transformer

Params7.8BContext32KMin VRAM≥ 6 GBGeneralFast

Exaone Deep 7.8B

Ollama library · Transformer

Params7.8BContext32KMin VRAM≥ 6 GBGeneralFast

Bakllava 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.9 GBGeneralFast

Bespoke Minicheck 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.9 GBGeneralFastPrivacy

Codegemma 7B

Ollama library · Gemma

Params7BContext8KMin VRAM≥ 6.2 GBGeneralCodingFast

Codellama 7B

Meta · LLaMA

Params7BContext16KMin VRAM≥ 5 GBGeneralCodingFast

Codeqwen 7B

Ollama library · Qwen

Params7BContext64KMin VRAM≥ 5.4 GBGeneralCodingFast

Command R 7b 7B

Cohere · Transformer

Params7BContext8KMin VRAM≥ 6.3 GBGeneralFast

Command R 7b Arabic 7B

Cohere · Transformer

Params7BContext16KMin VRAM≥ 6.3 GBGeneralFast

Deepseek Llm 7B

DeepSeek · DeepSeek

Params7BContext4KMin VRAM≥ 5.2 GBGeneralFast

DeepSeek R1 Distill 7B

DeepSeek · DeepSeek

Params7BContext128KMin VRAM≥ 5.9 GBReasoningCodingMax intelligence

Dolphin Mistral 7B

Ollama library · Mistral

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Dolphincoder 7B

Ollama library · Phi

Params7BContext16KMin VRAM≥ 5.4 GBGeneralCodingFast

Duckdb Nsql 7B

Ollama library · Transformer

Params7BContext16KMin VRAM≥ 5 GBGeneralFast

Falcon 3 7B

TII · Transformer

Params7BContext32KMin VRAM≥ 5.8 GBGeneralFast

Falcon 7B

TII · Transformer

Params7BContext2KMin VRAM≥ 5.4 GBGeneralFast

Gemma 7B

Google · Gemma

Params7BContext8KMin VRAM≥ 6.2 GBGeneralFast

Internlm 2 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.7 GBGeneralFast

Llama 2 7B

Meta · LLaMA

Params7BContext4KMin VRAM≥ 5 GBGeneralFast

Llama 2 Chinese 7B

Meta · LLaMA

Params7BContext4KMin VRAM≥ 5 GBGeneralFast

Llama 2 Uncensored 7B

Meta · LLaMA

Params7BContext2KMin VRAM≥ 5 GBGeneralFast

Llava 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.9 GBGeneralFast

Magicoder 7B

Ollama library · Transformer

Params7BContext16KMin VRAM≥ 5 GBGeneralCodingFast

Marco O 1 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.9 GBGeneralFast

Mathstral 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Meditron 7B

Ollama library · Transformer

Params7BContext2KMin VRAM≥ 5 GBGeneralFast

Medllama 2 7B

Ollama library · LLaMA

Params7BContext4KMin VRAM≥ 5 GBGeneralFast

Mistral 7B

Mistral AI · Mistral

Params7BContext32KMin VRAM≥ 5.6 GBGeneralWritingFastPrivacy

Mistral Openorca 7B

Mistral AI · Mistral

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Mistrallite 7B

Mistral AI · Mistral

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Neural Chat 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Notus 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Nous Hermes 7B

Ollama library · Transformer

Params7BContext4KMin VRAM≥ 5 GBGeneralFast

Olmo 2 7B

Ai2 · Transformer

Params7BContext4KMin VRAM≥ 5.7 GBGeneralFast

Olmo 3 7B

Ai2 · Transformer

Params7BContext64KMin VRAM≥ 5.7 GBGeneralFast

Openchat 7B

Ollama library · Transformer

Params7BContext8KMin VRAM≥ 5.3 GBGeneralFast

Openthinker 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.9 GBGeneralFast

Orca 2 7B

Ollama library · Transformer

Params7BContext4KMin VRAM≥ 5 GBGeneralFast

Orca Mini 7B

Ollama library · Transformer

Params7BContext4KMin VRAM≥ 5 GBGeneralFastPrivacy

Qwen 2 7B

Alibaba · Qwen

Params7BContext32KMin VRAM≥ 5.6 GBGeneralFast

Qwen 2 Math 7B

Alibaba · Qwen

Params7BContext4KMin VRAM≥ 5.6 GBGeneralFast

Qwen 2.5 7B

Alibaba · Qwen

Params7BContext32KMin VRAM≥ 5.9 GBGeneralCodingWritingFast

Qwen 2.5 Coder 7B

Alibaba · Qwen

Params7BContext32KMin VRAM≥ 5.9 GBCodingFast

Qwen 2.5vl 7B

Alibaba · Qwen

Params7BContext125KMin VRAM≥ 7.2 GBGeneralFast

Qwen 7B

Alibaba · Qwen

Params7BContext32KMin VRAM≥ 5.7 GBGeneralFast

Samantha Mistral 7B

Ollama library · Mistral

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Sqlcoder 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.3 GBGeneralCodingFast

Stable Beluga 7B

Ollama library · Transformer

Params7BContext4KMin VRAM≥ 5 GBGeneralFast

Starcoder 2 7B

Ollama library · Transformer

Params7BContext16KMin VRAM≥ 5.2 GBGeneralCodingFast

Starcoder 7B

Ollama library · Transformer

Params7BContext8KMin VRAM≥ 5.5 GBGeneralCodingFast

Starling Lm 7B

Ollama library · Transformer

Params7BContext8KMin VRAM≥ 5.3 GBGeneralFast

Vicuna 7B

Ollama library · Transformer

Params7BContext4KMin VRAM≥ 5 GBGeneralFast

Wizard Math 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Wizard Vicuna Uncensored 7B

Ollama library · Transformer

Params7BContext2KMin VRAM≥ 5 GBGeneralFast

Wizardlm 2 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Xwinlm 7B

Ollama library · Transformer

Params7BContext4KMin VRAM≥ 5 GBGeneralFast

Yarn Llama 2 7B

Ollama library · LLaMA

Params7BContext64KMin VRAM≥ 5 GBGeneralFast

Yarn Mistral 7B

Ollama library · Mistral

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Zephyr 7B

Ollama library · Transformer

Params7BContext32KMin VRAM≥ 5.3 GBGeneralFast

Deepseek Coder 6.7B

DeepSeek · DeepSeek

Params6.7BContext16KMin VRAM≥ 5 GBGeneralCodingFast

Yi 6B

01.AI · Transformer

Params6BContext4KMin VRAM≥ 4.7 GBGeneralFast

Gemma 3 4B

Google · Gemma

Params4BContext128KMin VRAM≥ 4.5 GBGeneralFast

Medgemma 1.5 4B

Ollama library · Gemma

Params4BContext128KMin VRAM≥ 4.5 GBGeneralFast

Medgemma 4B

Ollama library · Gemma

Params4BContext128KMin VRAM≥ 4.5 GBGeneralFast

Nemotron 3 Nano 4B

NVIDIA · Mistral

Params4BContext256KMin VRAM≥ 4 GBGeneralFast

Nemotron Mini 4B

NVIDIA · Mistral

Params4BContext4KMin VRAM≥ 3.9 GBGeneralFastPrivacy

Qwen 3 4B

Alibaba · Qwen

Params4BContext256KMin VRAM≥ 3.7 GBGeneralFast

Qwen 3 Vl 4B

Alibaba · Qwen

Params4BContext256KMin VRAM≥ 4.5 GBGeneralFast

Qwen 3.5 4B

Alibaba · Qwen

Params4BContext256KMin VRAM≥ 4.6 GBGeneralFast

Qwen 4B

Alibaba · Qwen

Params4BContext32KMin VRAM≥ 3.5 GBGeneralFast

Translategemma 4B

Ollama library · Gemma

Params4BContext128KMin VRAM≥ 4.5 GBGeneralFast

Llava Phi 3 3.8B

Ollama library · Phi

Params3.8BContext4KMin VRAM≥ 4.1 GBGeneralFastPrivacy

Nuextract 3.8B

Ollama library · Transformer

Params3.8BContext4KMin VRAM≥ 3.4 GBGeneralFast

Phi-3.5 Mini 3.8B

Microsoft · Phi

Params3.8BContext128KMin VRAM≥ 3.4 GBGeneralFastPrivacyCoding

Phi 3.5 3.8B

Microsoft · Phi

Params3.8BContext128KMin VRAM≥ 3.4 GBGeneralFastPrivacy

Phi 4 Mini 3.8B

Microsoft · Phi

Params3.8BContext128KMin VRAM≥ 3.7 GBGeneralReasoningFastPrivacy

Phi 4 Mini Reasoning 3.8B

Microsoft · Phi

Params3.8BContext128KMin VRAM≥ 4.4 GBGeneralReasoningFastPrivacy

Cogito 3B

Ollama library · Transformer

Params3BContext128KMin VRAM≥ 3.4 GBGeneralFast

Falcon 3 3B

TII · Transformer

Params3BContext32KMin VRAM≥ 3.2 GBGeneralFast

Granite 3 Moe 3B

IBM · Granite

Params3BContext4KMin VRAM≥ 3.3 GBGeneralFast

Granite 3.1 Moe 3B

IBM · Granite

Params3BContext128KMin VRAM≥ 3.2 GBGeneralFast

Granite 4 3B

IBM · Granite

Params3BContext128KMin VRAM≥ 3.3 GBGeneralFast

Granite 4.1 3B

IBM · Granite

Params3BContext128KMin VRAM≥ 3.3 GBGeneralFast

Granite 4.2 3B

IBM · Granite

Params3BContext128KMin VRAM≥ 3.4 GBGeneralFast

Granite Code 3B

IBM · Granite

Params3BContext125KMin VRAM≥ 3.2 GBGeneralCodingFast

Hermes 3 3B

Ollama library · Transformer

Params3BContext128KMin VRAM≥ 3.2 GBGeneralFast

Llama 3.2 3B

Meta · LLaMA

Params3BContext128KMin VRAM≥ 3.2 GBGeneralFastPrivacy

Ministral 3 3B

Mistral AI · Transformer

Params3BContext256KMin VRAM≥ 4.2 GBGeneralFastPrivacy

Orca Mini 3B

Ollama library · Transformer

Params3BContext2KMin VRAM≥ 3.2 GBGeneralFastPrivacy

Qwen 2.5 3B

Alibaba · Qwen

Params3BContext32KMin VRAM≥ 3.1 GBGeneralFast

Qwen 2.5 Coder 3B

Alibaba · Qwen

Params3BContext32KMin VRAM≥ 3.1 GBGeneralCodingFast

Qwen 2.5vl 3B

Alibaba · Qwen

Params3BContext125KMin VRAM≥ 4.4 GBGeneralFast

Smallthinker 3B

Ollama library · Transformer

Params3BContext32KMin VRAM≥ 4.8 GBGeneralFast

Stable Code 3B

Ollama library · Transformer

Params3BContext16KMin VRAM≥ 2.8 GBGeneralCodingFast

Stablelm Zephyr 3B

Ollama library · Transformer

Params3BContext4KMin VRAM≥ 2.8 GBGeneralFast

Starcoder 2 3B

Ollama library · Transformer

Params3BContext16KMin VRAM≥ 2.9 GBGeneralCodingFast

Starcoder 3B

Ollama library · Transformer

Params3BContext8KMin VRAM≥ 3 GBGeneralCodingFast

Dolphin Phi 2.7B

Ollama library · Phi

Params2.7BContext2KMin VRAM≥ 2.8 GBGeneralFast

Phi 2.7B

Microsoft · Phi

Params2.7BContext2KMin VRAM≥ 2.8 GBGeneralFast

Exaone 3.5 2.4B

Ollama library · Transformer

Params2.4BContext32KMin VRAM≥ 2.8 GBGeneralFast

Exaone Deep 2.4B

Ollama library · Transformer

Params2.4BContext32KMin VRAM≥ 2.8 GBGeneralFast

Codegemma 2B

Ollama library · Gemma

Params2BContext8KMin VRAM≥ 2.8 GBGeneralCodingFast

Gemma 2 2B

Google · Gemma

Params2BContext8KMin VRAM≥ 2.8 GBGeneralFast

Gemma 2B

Google · Gemma

Params2BContext8KMin VRAM≥ 2.9 GBGeneralFast

Granite 3 Dense 2B

IBM · Granite

Params2BContext4KMin VRAM≥ 2.8 GBGeneralFast

Granite 3 Guardian 2B

IBM · Granite

Params2BContext8KMin VRAM≥ 3.9 GBGeneralFast

Granite 3.1 Dense 2B

IBM · Granite

Params2BContext128KMin VRAM≥ 2.8 GBGeneralFast

Granite 3.2 2B

IBM · Granite

Params2BContext128KMin VRAM≥ 2.7 GBGeneralFast

Granite 3.2 Vision 2B

IBM · Granite

Params2BContext16KMin VRAM≥ 3.6 GBGeneralFast

Granite 3.3 2B

IBM · Granite

Params2BContext128KMin VRAM≥ 2.7 GBGeneralFast

Qwen 3 Vl 2B

Alibaba · Qwen

Params2BContext256KMin VRAM≥ 3.1 GBGeneralFast

Qwen 3.5 2B

Alibaba · Qwen

Params2BContext256KMin VRAM≥ 3.9 GBGeneralFast

Shieldgemma 2B

Ollama library · Gemma

Params2BContext8KMin VRAM≥ 2.9 GBGeneralFast

Internlm 2 1.8B

Ollama library · Transformer

Params1.8BContext32KMin VRAM≥ 2.3 GBGeneralFast

Moondream 1.8B

Ollama library · Transformer

Params1.8BContext2KMin VRAM≥ 2.9 GBGeneralFast

Qwen 1.8B

Alibaba · Qwen

Params1.8BContext32KMin VRAM≥ 2.3 GBGeneralFast

Qwen 3 1.7B

Alibaba · Qwen

Params1.7BContext40KMin VRAM≥ 2.6 GBGeneralFast

Smollm 1.7B

Hugging Face · Transformer

Params1.7BContext2KMin VRAM≥ 2.2 GBGeneralFastPrivacy

Smollm 2 1.7B

Hugging Face · Transformer

Params1.7BContext8KMin VRAM≥ 3 GBGeneralFastPrivacy

Stablelm 2 1.6B

Ollama library · Transformer

Params1.6BContext4KMin VRAM≥ 2.2 GBGeneralFast

Deepcoder 1.5B

Ollama library · Transformer

Params1.5BContext128KMin VRAM≥ 2.3 GBGeneralCodingFast

Deepscaler 1.5B

Ollama library · Transformer

Params1.5BContext128KMin VRAM≥ 4.8 GBGeneralFast

Deepseek R 1 1.5B

DeepSeek · DeepSeek

Params1.5BContext128KMin VRAM≥ 2.3 GBGeneralReasoningFast

Opencoder 1.5B

Ollama library · Transformer

Params1.5BContext4KMin VRAM≥ 2.6 GBGeneralCodingFast

Qwen 2 1.5B

Alibaba · Qwen

Params1.5BContext32KMin VRAM≥ 2.1 GBGeneralFast

Qwen 2 Math 1.5B

Alibaba · Qwen

Params1.5BContext4KMin VRAM≥ 2.1 GBGeneralFast

Qwen 2.5 1.5B

Alibaba · Qwen

Params1.5BContext32KMin VRAM≥ 2.2 GBGeneralFast

Qwen 2.5 Coder 1.5B

Alibaba · Qwen

Params1.5BContext32KMin VRAM≥ 2.2 GBGeneralCodingFast

Reader Lm 1.5B

Ollama library · Transformer

Params1.5BContext250KMin VRAM≥ 2.1 GBGeneralFast

Yi Coder 1.5B

01.AI · Transformer

Params1.5BContext128KMin VRAM≥ 2 GBGeneralCodingFast

Deepseek Coder 1.3B

DeepSeek · DeepSeek

Params1.3BContext16KMin VRAM≥ 2 GBGeneralCodingFast

Lfm 2.5 Thinking 1.2B

Ollama library · Transformer

Params1.2BContext125KMin VRAM≥ 1.9 GBGeneralFast

Tinydolphin 1.1B

Ollama library · Phi

Params1.1BContext4KMin VRAM≥ 1.8 GBGeneralFastPrivacy

Tinyllama 1.1B

Ollama library · LLaMA

Params1.1BContext2KMin VRAM≥ 1.8 GBGeneralFastPrivacy

Falcon 3 1B

TII · Transformer

Params1BContext8KMin VRAM≥ 3 GBGeneralFast

Gemma 3 1B

Google · Gemma

Params1BContext32KMin VRAM≥ 2 GBGeneralFast

Granite 3 Moe 1B

IBM · Granite

Params1BContext4KMin VRAM≥ 2 GBGeneralFast

Granite 3.1 Moe 1B

IBM · Granite

Params1BContext128KMin VRAM≥ 2.6 GBGeneralFast

Granite 4 1B

IBM · Granite

Params1BContext128KMin VRAM≥ 4.5 GBGeneralFast

Llama 3.2 1B

Meta · LLaMA

Params1BContext128KMin VRAM≥ 2.5 GBGeneralFast

Llama Guard 3 1B

Meta · LLaMA

Params1BContext128KMin VRAM≥ 2.8 GBGeneralFast

Minicpm V 4.6 1B

Ollama library · Transformer

Params1BContext256KMin VRAM≥ 2.8 GBGeneralFastPrivacy

Sailor 2 1B

Ollama library · Transformer

Params1BContext32KMin VRAM≥ 2.3 GBGeneralFast

Starcoder 1B

Ollama library · Transformer

Params1BContext8KMin VRAM≥ 1.9 GBGeneralCodingFast

Qwen 3.5 0.8B

Alibaba · Qwen

Params0.8BContext256KMin VRAM≥ 2.2 GBGeneralFast

Qwen 3 0.6B

Alibaba · Qwen

Params0.6BContext40KMin VRAM≥ 1.7 GBGeneralFast

Qwen 0.5B

Alibaba · Qwen

Params0.5BContext32KMin VRAM≥ 1.6 GBGeneralFast

Qwen 2 0.5B

Alibaba · Qwen

Params0.5BContext32KMin VRAM≥ 1.5 GBGeneralFast

Qwen 2.5 0.5B

Alibaba · Qwen

Params0.5BContext32KMin VRAM≥ 1.6 GBGeneralFast

Qwen 2.5 Coder 0.5B

Alibaba · Qwen

Params0.5BContext32KMin VRAM≥ 1.6 GBGeneralCodingFast

Reader Lm 0.5B

Ollama library · Transformer

Params0.5BContext250KMin VRAM≥ 1.5 GBGeneralFast