Prefix Cache 命中率如何影响 TTFT？
分析 Prefix Cache 命中与未命中对首 token 延迟的影响，并记录后续 benchmark 计划。
#benchmark
Browse notes and projects by keyword.
A traceable learning record for LLM inference, KV cache, and evaluation methods.
Framing study questions, understanding inference mechanisms, and planning reproducible experiments.