warmup16 {"status": 200, "headers_s": 0.0023321150802075863, "elapsed_s": 1.555066555738449, "ttft_s": 0.3743001348339021, "chunks": 18, "content_chunks": 16, "post_first_content_chunks_per_s": 12.703613292550262, "requested_tokens_per_s_e2e": 10.288948689017452, "text": "彩虹之所以有多种颜色，是因为阳光（白光）被空气中的水滴折射、反射", "chars": 32, "last_obj": {"id": "chatcmpl-9a3f6712-c194-4b7c-910d-2d72b1a9960c", "object": "chat.completion.chunk", "created": 1778801041, "model": "DeepSeek-V4-Flash", "choices": [{"index": 0, "delta": {}, "finish_reason": "length"}]}}
decode64 {"status": 200, "headers_s": 0.001232353039085865, "elapsed_s": 5.573919753078371, "ttft_s": 0.4634924167767167, "chunks": 66, "content_chunks": 64, "post_first_content_chunks_per_s": 12.327736186068586, "requested_tokens_per_s_e2e": 11.482045460854366, "text": "In mixture-of experts (MoE) inference, the model's efficiency hinges on routing each input token to only a subset of \"expert\" sub-networks. However, this sparse activation creates a critical bottleneck: **GPU communication overhead**. Unlike dense models where all data stays local within a single GPU's memory, Mo", "chars": 314, "last_obj": {"id": "chatcmpl-72860668-eee6-45ec-ae61-517514fe4800", "object": "chat.completion.chunk", "created": 1778801043, "model": "DeepSeek-V4-Flash", "choices": [{"index": 0, "delta": {}, "finish_reason": "length"}]}}
math {"status": 200, "headers_s": 0.0010903398506343365, "elapsed_s": 0.4738827929832041, "ttft_s": 0.39479922875761986, "chunks": 3, "content_chunks": 1, "post_first_content_chunks_per_s": 0.0, "requested_tokens_per_s_e2e": 33.76362306653132, "text": "410", "chars": 3, "last_obj": {"id": "chatcmpl-562b9e2f-7aaa-4fc6-8f1d-040b495ebc90", "object": "chat.completion.chunk", "created": 1778801048, "model": "DeepSeek-V4-Flash", "choices": [{"index": 0, "delta": {}, "finish_reason": "stop"}]}}
