Deploy Llama-3.3-70B-Instruct
Llama-3.3-70B-Instruct by Meta Llama on GPU capacity reserved for you: a private OpenAI-compatible endpoint, every request processed on European GPUs and logged in your audit trail, billed per GPU-hour on a monthly commitment.
- Maker
- Meta Llama
- Params
- 71B
- Context
- 128K
- Architecture
- Dense
- License
- Llama 3.3 Community License
- Released
- 2024-11-26
Footprint
Minimum to load the published checkpoint with a small KV cache. Long contexts and high concurrency need more; quantizing a 16-bit checkpoint needs less. You don't pick hardware on sference: you choose a performance tier and we size and run the deployment.
License
Llama 3.3 Community LicenseReview terms
Commercial use allowed for most companies; products above 700M monthly active users need a separate license from Meta, and "Built with Llama" attribution is required. The weights are gated on Hugging Face: accept the maker's terms on the model page. Read the license. Not legal advice.
FAQ
Can I run Llama-3.3-70B-Instruct on a dedicated deployment in Europe?
Yes. sference deploys Llama-3.3-70B-Instruct on GPU capacity reserved for you, behind a private endpoint, with every request processed on European GPUs and logged in your audit trail. Tell us your expected volume and latency targets with the form on this page and we come back with a sizing and a quote.
How many GPUs does Llama-3.3-70B-Instruct need?
The published checkpoint is about 141 GB (BF16), so loading it takes at least 4 GPUs with 80 GB of memory each, or 2 GPUs with 141 GB each. Long contexts and high concurrency need more for the KV cache; quantization needs less. You don't pick hardware on sference: you choose a performance tier and we size the deployment.
Is Llama-3.3-70B-Instruct licensed for commercial use?
Llama-3.3-70B-Instruct is published under the Llama 3.3 Community License license. Commercial use allowed for most companies; products above 700M monthly active users need a separate license from Meta, and "Built with Llama" attribution is required.
How is a dedicated deployment priced?
Per GPU-hour on a monthly commitment, sized to your throughput and latency targets.
Related models
Request Llama-3.3-70B-Instruct
Tell us roughly how much traffic you expect. A fine-tune of Llama-3.3-70B-Instruct? Mention it in the notes.
- 01We size it
A performance tier, the capacity behind it, and a quote for your volume.
- 02We benchmark it
Bring one workload with a sample of real traffic; we come back with latency and throughput numbers.
- 03It goes live
We provision the deployment. You call it with the same API and model id as before.
Specs from Hugging Face, synced 2026-10-27. Machine-readable version: https://sference.com/models/meta-llama/Llama-3.3-70B-Instruct.md