Meta releases weights for a model with 816 billion parameters
Meta released the weights for Muse Spark Open on October 15. The model has 816 billion parameters but uses 42 billion for each token. Its context window holds about one million tokens.
The Muse Model License adds conditions for companies that offer models as a service. A company must notify Meta if it and its affiliates earn more than US$20 million in gross revenue. The threshold applies to any consecutive 12-month period. The company then needs a separate written agreement before it can offer this model or its derivatives through that service.
Read article →