llm-architectures-explained

/models

Step 5 Preview

StepFun · Step · closed weights

Facts and where they come from

Released2026-09labannouncementStep 5 Preview announcement
Licenceproprietarylabannouncementweights not published
Total parameters600Blabannouncementannouncement: 600B total parameters, with 27B active per token
Active parameters27Blabannouncementannouncement: 27B active per token
Context length1,000,000 tokenslabannouncementannouncement: supports a 1M-token context window
Mixture of expertsyeslabannouncementannouncement: a sparse Mixture-of-Experts architecture

Architecture

not disclosed No diagram or modelled costs: weights not yet released (announced for 15 October 2026); no configuration published.

Sources

Listed in the LLM Architecture Gallery checklist as “Step-5 Preview (600B)” (name only; see about).