Meta releases weights for a model with 816 billion parameters
Meta released the weights for Muse Spark Open on October 15. The model has 816 billion parameters but uses 42 billion for each token. Its context window holds about one million tokens.
Verified 1:15 AM PDT · 2 original sources
Meta offers the weights for download. Several providers also offer hosted access.
The Muse Model License adds conditions for companies that offer models as a service. A company must notify Meta if it and its affiliates earn more than US$20 million in gross revenue. The threshold applies to any consecutive 12-month period. The company then needs a separate written agreement before it can offer this model or its derivatives through that service.
The condition does not apply to internal use, research or other commercial activity that does not offer the model as a service. Product features that do not offer the model as a service are also exempt. Meta's performance and safety comparisons are company claims, not independent test results.
Independent tests still need to measure how much the model costs to run and how well its agents perform. Companies that plan to host it for customers also need to check the license terms.
Audit the story
Original sources
Company claims remain company claims. Follow the reporting and judge the evidence directly.
- Meta AI ResearchIntroducing Muse Spark Open, The Most Capable US Open-Weight Model to Date ↗
- Meta model repositoryMuse Model License, Muse Spark Open ↗
Continue the edition