Skip to content

Moore Threads Completes Training Adaptation for Kimi K3.1 Pro

Nov 17, 19:25

On November 17, Moore Threads completed the training adaptation for Moonshot AI's open-source model Kimi K3.1 Pro. The model comprises 2.8 trillion parameters.

The adaptation leverages the MTT S5000 intelligent computing card and the MUSA software stack, building a native FSDP2 multimodal training pipeline that covers stages including model loading, shard scheduling, and gradient synchronization.

Source