Google Releases TPU Sync: Open-Source KV Cache Transfer for TPUs
Google Cloud has released TPU Sync, an Apache-2.0 C++ library that moves KV caches and model weights across TPU HBM, pinned host DRAM, shared storage, and data-center networking. It integrates with PyTorch and JAX and se...