Motif 3: MIT License Unlocks Korean AI for Commercial Use

1h ago·0:00 listen·Source: Tech Times

Summary

Motif Technologies has released the final weights of its Motif 3 language model to Hugging Face. The key update is that Motif 3 is now available under the MIT License. This is a direct upgrade from the previous non-commercial research restriction. This change means that any fine-tuning provider, enterprise, or startup can now use Motif 3 for commercial purposes without needing prior approval. Motif 3 is a Mixture-of-Experts language model with 314 billion total parameters, but only 13.2 billion are activated per token. This design makes inference costs comparable to a 13-billion-parameter model, while still accessing a much larger knowledge base. It was pretrained on approximately 12.5 trillion tokens and supports a native 262,144-token context window. What's interesting are two proprietary components: Grouped Differential Latent Attention and Expert-Specific PolyNorm. These are described as entirely in-house designs. The Grouped Differential Latent Attention helps cancel noise and enables the large context window without proportional memory overhead. Expert-Specific PolyNorm reduces activation outliers, which improves numerical stability. The bottom line is that the open licensing of Motif 3 could significantly impact commercial AI development.

Read the full article on Tech Times

This is an AI-generated audio summary. Always check the original source for complete reporting.

Share
Keep Listening