Moonshot AI: Kimi K3 Free for Developers, Details Here

Moonshot AI has made its Kimi K3 model free to download for developers. This move includes the core technologies used to train and run it. Kimi K3 is described as the firm's most capable AI model to date. It is a 2.8 trillion-parameter Mixture of Experts model with visual understanding and a one-million-token context window. Moonshot AI says Kimi K3 is nearly three times larger than its predecessor, Kimi K2.5. The improvements come from a novel architecture, not just more parameters. Tech like Attention Residuals and Kimi Delta Attention enhance scaling efficiency. Kimi K3 is also better at handling long conversations, complex reasoning, and understanding images. Moonshot AI expects this free release to speed up the adoption of advanced AI and support research towards Artificial General Intelligence. This could make it easier for developers to build and deploy AI applications.