Home » Authors » Jun Kong, Qi Lin, Zhichao Cao

Jun Kong, Qi Lin, Zhichao Cao

Public reference bibliography and cataloged PDF materials authored or published by Jun Kong, Qi Lin, Zhichao Cao.

Found 1 document(s) Page 1 of 1

SARP: An On-SSD Index for KVCache with Fast Prefix Matching and Recovery

Year: 2026 • Source: arxiv.org • Listed PDF

Distributed LLM serving relies on a global index to locate reusable key-value cache (KVCache) blocks through prefix matching. Losing the index after a crash or restart forces affected requests to recompute existing KVCac...