Press Enter to search · ESC to close

AI × Crypto

China’s daily token calls top 500 trillion as compute demand surges

China’s average daily token calls have exceeded 500 trillion, driving a sharp rise in demand for computing power. With intelligent compute capacity unable to keep up in the short term, attention is turning to efficiency gains from existing hardware. The Mooncake inference system developed by Academician Zheng Weimin’s team, which won the 2025 Eric Riedel Best Paper Award, uses PD disaggregation to let one group of chips read user queries and another generate answers, handling 75% more user requests on the same hardware and lifting long-text throughput more than fivefold.

Original source

AI take

The scale of daily token traffic reframes China's AI constraint as an infrastructure problem rather than a model problem: when compute cannot keep pace, the marginal gains shift to systems engineering like PD disaggregation, which squeezes more requests from the same silicon. That matters most for inference providers and hardware operators facing capacity ceilings, and it gives academic work like the Mooncake team's a direct path into commercial deployment. Whether disaggregated serving becomes standard practice, and how far efficiency gains can offset the compute shortfall, is the open question.

Generated by AI for reference only.

Share

Related News

TREE NEWS share card
Long-press image above → Save to Photos / Share
Pitch us Feedback