Llama-3.1-405B-FP8
transformerssafetensorsllamatext-generationfacebookmetapytorchllama-3endefritpthiestharxiv:2204.05149license:llama3.1text-generation-inferenceendpoints_compatiblefbgemm_fp8deploy:sagemakerregion:us
Context
131,072 tokens
Max Output
8,192 tokens
Released
7/20/2024
Providers
1
Overview
Llama-3.1-405B-FP8 is a large language model developed by Meta. It supports 131,072 tokens context and is available through 1 API provider(s).
Key Highlights
- Unknown / Not disclosed
Brand
Meta
Organization
Country: USA
View all models, pricing and details from Meta.
Specifications
Basic Information
| Model | Llama-3.1-405B-FP8 |
| Brand | Meta |
| Version | 3.1 |
| Model Type | transformers |
| Status | stable |
| Released | 7/20/2024 |
| Popularity | 470888 |
Architecture
| Parameter Size | 405.9B |
| Architecture Type | llama |
| Attention Mechanism | causal-mha |
| Tokenizer | Unknown / Not disclosed |
| Vocabulary Size | Unknown / Not disclosed |
Context & I/O
| Context | 131,072 tokens |
| Max Output | 8,192 tokens |
| Modalities | Unknown / Not disclosed |
| Languages | en,de,fr,it,pt,hi,es,th |
Capabilities
| Vision | No |
| Audio | No |
| Reasoning | No |
| Function Call | No |
| MCP | No |
| JSON Mode | No |
| Embedding | No |
Training Data
| Training Dataset | Unknown / Not disclosed |
| Estimated Data Size | Unknown / Not disclosed |
| Knowledge Cutoff | Unknown / Not disclosed |
Inference & Deployment
| API Access | Yes |
| VRAM Estimate | Unknown / Not disclosed |
| Quantization Support | Unknown / Not disclosed |
| Hardware Requirements | Unknown / Not disclosed |
Safety & Compliance
| Safety Evaluations | Unknown / Not disclosed |
| Content Policy | Unknown / Not disclosed |
| Region Restrictions | Unknown / Not disclosed |
License & Pricing
| License | llama3.1 |
| Commercial Use | Unknown / Not disclosed |
| Open Source | No |
Provider & Pricing
No pricing records available.
Price Changes
No recorded price changes.
Benchmarks
No benchmark data available.
Changelog
- Page created / data imported9/23/2026
- Last updated9/23/2026
Frequently Asked Questions
What is Llama-3.1-405B-FP8?
Llama-3.1-405B-FP8 is a large language model developed by Meta.
Who developed Llama-3.1-405B-FP8?
Llama-3.1-405B-FP8 was developed by Meta. You can learn more on the brand page or official website.
What is the context length of Llama-3.1-405B-FP8?
Llama-3.1-405B-FP8 supports up to 131,072 tokens of context.
How much does Llama-3.1-405B-FP8 API cost?
Pricing information for Llama-3.1-405B-FP8 is not currently available.