Deploy moondream3.1-9B-A2B
moondream3.1-9B-A2B by Moondream on GPU capacity reserved for you: a private OpenAI-compatible endpoint, every request processed on European GPUs and logged in your audit trail, billed per GPU-hour on a monthly commitment.
- Maker
- Moondream
- Params
- 9.3B · 2B active
- Context
- 31K
- Architecture
- Dense
- License
- Custom license
- Released
- 2026-06-30
Footprint
Minimum to load the published checkpoint with a small KV cache. Long contexts and high concurrency need more; quantizing a 16-bit checkpoint needs less. You don't pick hardware on sference: you choose a performance tier and we size and run the deployment.
License
Custom licenseReview terms
Custom license from the model maker (moondream-model-license-1.0). Review the terms on the model page before production use. Read the license. Not legal advice.
FAQ
Can I run moondream3.1-9B-A2B on a dedicated deployment in Europe?
Yes. sference deploys moondream3.1-9B-A2B on GPU capacity reserved for you, behind a private endpoint, with every request processed on European GPUs and logged in your audit trail. Tell us your expected volume and latency targets with the form on this page and we come back with a sizing and a quote.
How many GPUs does moondream3.1-9B-A2B need?
The published checkpoint is about 11 GB (FP8 + BF16), so loading it takes at least 1 GPU with 80 GB of memory each, or 1 GPU with 141 GB each. Long contexts and high concurrency need more for the KV cache; quantization needs less. You don't pick hardware on sference: you choose a performance tier and we size the deployment.
Is moondream3.1-9B-A2B licensed for commercial use?
moondream3.1-9B-A2B is published under the Custom license license. Custom license from the model maker (moondream-model-license-1.0). Review the terms on the model page before production use.
How is a dedicated deployment priced?
Per GPU-hour on a monthly commitment, sized to your throughput and latency targets.
Related models
Request moondream3.1-9B-A2B
Tell us roughly how much traffic you expect. A fine-tune of moondream3.1-9B-A2B? Mention it in the notes.
- 01We size it
A performance tier, the capacity behind it, and a quote for your volume.
- 02We benchmark it
Bring one workload with a sample of real traffic; we come back with latency and throughput numbers.
- 03It goes live
We provision the deployment. You call it with the same API and model id as before.
Specs from Hugging Face, synced 2026-10-27. Machine-readable version: https://sference.com/models/moondream/moondream3.1-9B-A2B.md