Deploy Voxtral-Mini-4B-Realtime-2602
Voxtral-Mini-4B-Realtime-2602 by Mistral AI on GPU capacity reserved for you: a private OpenAI-compatible endpoint, every request processed on European GPUs and logged in your audit trail, billed per GPU-hour on a monthly commitment.
- Maker
- Mistral AI
- Params
- 4.4B
- Context
- 128K
- Architecture
- Dense
- License
- Apache 2.0
- Released
- 2026-01-21
Footprint
Minimum to load the published checkpoint with a small KV cache. Long contexts and high concurrency need more; quantizing a 16-bit checkpoint needs less. You don't pick hardware on sference: you choose a performance tier and we size and run the deployment.
License
Apache 2.0Commercial use allowed
Permissive: commercial use, modification, and private deployment allowed; keep the license and notices. Read the license. Not legal advice.
FAQ
Can I run Voxtral-Mini-4B-Realtime-2602 on a dedicated deployment in Europe?
Yes. sference deploys Voxtral-Mini-4B-Realtime-2602 on GPU capacity reserved for you, behind a private endpoint, with every request processed on European GPUs and logged in your audit trail. Tell us your expected volume and latency targets with the form on this page and we come back with a sizing and a quote.
How many GPUs does Voxtral-Mini-4B-Realtime-2602 need?
The published checkpoint is about 8.9 GB (BF16), so loading it takes at least 1 GPU with 80 GB of memory each, or 1 GPU with 141 GB each. Long contexts and high concurrency need more for the KV cache; quantization needs less. You don't pick hardware on sference: you choose a performance tier and we size the deployment.
Is Voxtral-Mini-4B-Realtime-2602 licensed for commercial use?
Voxtral-Mini-4B-Realtime-2602 is published under the Apache 2.0 license. Permissive: commercial use, modification, and private deployment allowed; keep the license and notices.
How is a dedicated deployment priced?
Per GPU-hour on a monthly commitment, sized to your throughput and latency targets.
Related models
Request Voxtral-Mini-4B-Realtime-2602
Tell us roughly how much traffic you expect. A fine-tune of Voxtral-Mini-4B-Realtime-2602? Mention it in the notes.
- 01We size it
A performance tier, the capacity behind it, and a quote for your volume.
- 02We benchmark it
Bring one workload with a sample of real traffic; we come back with latency and throughput numbers.
- 03It goes live
We provision the deployment. You call it with the same API and model id as before.
Specs from Hugging Face, synced 2026-10-27. Machine-readable version: https://sference.com/models/mistralai/Voxtral-Mini-4B-Realtime-2602.md