ITG NowHome › AI glossary › Small language model
What is a small language model?
A small language model is a compact AI language model that is light enough to run on a laptop or phone.
- Category Models
- Also called SLM
- Updated 20 Oct 2026
Small language model, explained simply
Big models need huge data centers. A small language model is trimmed down so it needs much less computer power.
It may know less than a giant model. But it can be fast, cheap and private, since it can run on your own device.
A phone feature that rewrites your text without using the internet may use a small language model.
On ITG Now, our free tool guides often show small models you can run on your own computer.
Related terms
LLMLocal AIEdge AIQuantizationDistillationOllama
Questions people ask about Small language model
Small language model vs LLM: what is the difference?
Both write and read text. A small one is lighter and cheaper, while a large one usually knows more.
Can a small language model run offline?
Yes, many can. Once downloaded, they can work without an internet connection.