llm-architectures-explained

/models

Gemini 1.0 Ultra

Google · Gemini · closed weights

Facts and where they come from

Released2023-12paperarXiv 2312.11805arXiv v1, December 2023
LicenceproprietarylabarXiv 2312.11805weights not published
Total parametersnot disclosednot disclosed
Active parametersnot disclosednot disclosed
Context lengthnot disclosednot disclosed

Architecture

not disclosed No diagram or modelled costs: the Gemini report does not give the size or layer dimensions.

Sources