Gemini 1.5 Pro
Google · Gemini · closed weights
- MoE
Facts and where they come from
| Released | 2024-02 | paperarXiv 2403.05530report, February 2024 (arXiv March 2024) |
|---|---|---|
| Licence | proprietary | labarXiv 2403.05530weights not published |
| Total parameters | not disclosed | not disclosed |
| Active parameters | not disclosed | not disclosed |
| Context length | not disclosed | not disclosed |
| Mixture of experts | yes | paperarXiv 2403.05530§2: a sparse mixture-of-experts (MoE) Transformer-based model |
Architecture
not disclosed No diagram or modelled costs: the report states the model is a sparse MoE but gives no dimensions.