Browsing Tag
Mixture of Experts
2 posts
Mixture-of-experts model architectures, sparse computation, and related AI infrastructure.
Mistral Large 4 Is Live, but the Real Test Starts With Its Open Weights
Mistral Large 4 brings a 1M-token context window, low API pricing and trillion-parameter scale. Here is what is available now and what remains unverified before its October 27 weight release.
MLPerf Training 6.0 Makes AI Infrastructure a Sparse-Model Race
MLCommons released MLPerf Training 6.0 with new DeepSeek V3 and GPT-OSS 20B benchmarks, while NVIDIA, AMD, and cloud providers used the round to show how AI training is moving toward sparse models, rack-scale systems, and verified cloud capacity.