warmup16 {"status": 200, "headers_s": 0.0022748936899006367, "elapsed_s": 1.556301072705537, "ttft_s": 0.3769997716881335, "chunks": 18, "content_chunks": 16, "post_first_content_chunks_per_s": 12.719395787199794, "requested_tokens_per_s_e2e": 10.280787105148587, "text": "彩虹之所以有多种颜色，是因为阳光（白光）被空气中的水滴折射、反射", "chars": 32, "last_obj": {"id": "chatcmpl-31a61dfc-1a42-4395-9adf-e99d3b39a810", "object": "chat.completion.chunk", "created": 1778801768, "model": "DeepSeek-V4-Flash", "choices": [{"index": 0, "delta": {}, "finish_reason": "length"}]}}
decode64 {"status": 200, "headers_s": 0.0011906377039849758, "elapsed_s": 5.581832541618496, "ttft_s": 0.45882940385490656, "chunks": 66, "content_chunks": 64, "post_first_content_chunks_per_s": 12.297474412147675, "requested_tokens_per_s_e2e": 11.465768548735914, "text": "In mixture-of experts (MoE) inference, the model's efficiency hinges on routing each input token to only a subset of \"expert\" sub-networks. However, this sparse activation creates a critical bottleneck: **GPU communication overhead**. Unlike dense models where all data stays local within a single GPU's memory, Mo", "chars": 314, "last_obj": {"id": "chatcmpl-531b30a8-8053-4bd1-b8a8-d9da5e5d1d61", "object": "chat.completion.chunk", "created": 1778801770, "model": "DeepSeek-V4-Flash", "choices": [{"index": 0, "delta": {}, "finish_reason": "length"}]}}
math {"status": 200, "headers_s": 0.0010741990990936756, "elapsed_s": 0.48248344706371427, "ttft_s": 0.40356331691145897, "chunks": 3, "content_chunks": 1, "post_first_content_chunks_per_s": 0.0, "requested_tokens_per_s_e2e": 33.16175942899679, "text": "410", "chars": 3, "last_obj": {"id": "chatcmpl-057525d1-6205-40fe-b2d3-dd14d92f3a2c", "object": "chat.completion.chunk", "created": 1778801775, "model": "DeepSeek-V4-Flash", "choices": [{"index": 0, "delta": {}, "finish_reason": "stop"}]}}
