llm-architectures-explained

/models

Claude 3.5 Sonnet

Anthropic · Claude 3.5 · closed weights

Facts and where they come from

Released2024-06labofficial docsannouncement dated Jun 21, 2024
Licenceproprietarylabofficial docsweights not published
Total parametersnot disclosednot disclosed
Active parametersnot disclosednot disclosed
Context length200,000 tokenslabofficial docsannouncement: a 200K token context window

Reported estimates

Anthropic has not disclosed these. They are third-party estimates, shown only with their label, source, date and confidence, and never used by the calculator unless you switch estimates on.

  • Total parameters:reported estimate ≈175B (“Claude 3.5 Sonnet (2024-10-22) ... (≈175B parameters)”)Source: Ben Abacha, Yim, Fu, Sun, Yetisgen, Xia and Lin, MEDEC (arXiv 2412.19260v1), 2024-12-26. §4 (p. 6): model sizes listed in the experiments sectionConfidence: Low. The authors write that the sizes are estimates mined from public articles, that they cannot vouch for their accuracy, and that they are given only to help place the results.

Architecture

not disclosed No diagram or modelled costs: Anthropic has not disclosed the architecture or size.

Sources