llm-architectures-explained

/models

Grok 4

xAI · Grok · closed weights

Facts and where they come from

Released2025-07labofficial docsannouncement dated July 9, 2025
Licenceproprietarylabofficial docsweights not published
Total parametersnot disclosednot disclosed
Active parametersnot disclosednot disclosed
Context length250K tokenslabofficial docsannouncement: 256,000 context window

Architecture

not disclosed No diagram or modelled costs: xAI has not disclosed the architecture or size.

Sources