An Apache 2.0 classic: undemanding, very fast and fully free for commercial use. It trails newer 7B models on quality but is predictable and needs almost no resources — handy as a cheap filter in front of a bigger model.
| MMLU | 62.5 | |
|---|---|---|
| GSM8K | 52.2 | |
| HumanEval | 39.4 |
Which GPU does Mistral 7B need?
The entry configuration is 1x V100, which delivers around 28 tokens per second. For more parallel requests and headroom on speed, go with 1x H100.
How much does Mistral 7B cost?
An hour of Mistral 7B runs from $0.22 to $3.33 depending on the GPU configuration. Billing is hourly: you pay for server time, not for tokens.
How do I call Mistral 7B from my code?
Once deployed you get an OpenAI-compatible endpoint: point any OpenAI client at the base_url you receive and pass mistral:7b as the model name. Code written against the OpenAI API needs no changes.
Does the data stay private?
Yes. Mistral 7B runs on a dedicated GPU server inside a private loop: requests and responses never reach the model vendor and are not used for training.
What context window and license does Mistral 7B have?
Mistral 7B holds 32K tokens of context per request and ships under the Apache 2.0 license, so you can use it commercially on your own hosting terms.