#moe models

Google Open-Sources TPU Sync: A KV Cache Transfer Library forNEW⭐9

Google open-sources TPU Sync, a C++ KV cache transfer library for Cloud TPUs, cutting transfer latency and TTFT by up to 90% on 235B–480B MoE models.