TREE NEWS update: Baidu has open-sourced its latest base model, ERNIE 5.5 Flash Base. The mixture-of-experts model has 280 billion total parameters and activates 14 billion per token, and was pretrained on 33.5 trillion tokens with a pretraining context length of up to 128K. Fine-tuning and inference support contexts of up to 1 million tokens.
Baidu Open-Sources ERNIE 5.5 Flash Base With 280B Parameters
Baidu's decision to release a 280B-parameter mixture-of-experts base model openly puts a frontier-scale architecture into the hands of anyone who wants to fine-tune it, which matters most for developers and smaller labs that cannot pretrain at this scale themselves. The 14B active-parameter design keeps inference comparatively lean relative to total size, and the jump from a 128K pretraining context to 1M-token support in fine-tuning and inference signals that long-context work is where Baidu expects downstream differentiation. Whether open base weights at this scale become a recurring pattern among Chinese labs, rather than a one-off, is the open question worth watching.
Generated by AI for reference only.
Share on WeChat
Open WeChat → Scan → then tap "…" to send to a chat or Moments.
Tap "…" in the top-right corner to send to a chat or share to Moments.