warmup16 {"status": 200, "elapsed_s": 1.560081958770752, "ttft_s": null, "chunks": 18, "content_chunks": 16, "post_first_tok_s_estimate": 10.255871436784648, "text": "彩虹之所以有多种颜色，是因为阳光（白光）被空气中的水滴折射、反射", "chars": 32}
decode64 {"status": 200, "elapsed_s": 5.5779173374176025, "ttft_s": null, "chunks": 66, "content_chunks": 64, "post_first_tok_s_estimate": 11.473816503281125, "text": "In mixture-of experts (MoE) inference, the model's efficiency hinges on routing each input token to only a subset of \"expert\" sub-networks. However, this sparse activation creates a critical bottleneck: **GPU communication overhead**. Unlike dense models where all data stays local within a single GPU's memory, Mo", "chars": 314}
math {"status": 200, "elapsed_s": 0.46993279457092285, "ttft_s": null, "chunks": 3, "content_chunks": 1, "post_first_tok_s_estimate": 34.04742164166042, "text": "410", "chars": 3}
