AMD GPUs

TurboQuant on AMD GPUs cuts KV-cache latency

TurboQuant on AMD GPUs improves long-context LLM serving with up to 3.6x speedup and far lower KV-cache pressure.