llm-architectures-explained

/models

Gemini 2.5 Pro

Google · Gemini · closed weights

Facts and where they come from

Released2025-03labannouncementGoogle blog, March 2025
Licenceproprietarylabannouncementweights not published
Total parametersnot disclosednot disclosed
Active parametersnot disclosednot disclosed
Context lengthnot disclosednot disclosed
Mixture of expertsyespaperarXiv 2507.06261§2.1: sparse mixture-of-experts (MoE) transformers

Architecture

not disclosed No diagram or modelled costs: the report states the model is a sparse MoE but gives no dimensions.

Sources