Motif 3
unknownMotif 3 is a large-scale, decoder-only Mixture-of-Experts (MoE) language model with 314 billion total parameters and 13.2 billion parameters activated per token.
- Context
- 262,144
- Output
- 262,144
- Offers
- 0
Lab
Lab summary is pending review.
Motif 3 is a large-scale, decoder-only Mixture-of-Experts (MoE) language model with 314 billion total parameters and 13.2 billion parameters activated per token.