Posts by Kat Ko

1 results

Clear filters
  • APRIL 7, 2026 / AI

    TorchTPU: Running PyTorch Natively on TPUs at Google Scale

    TorchTPU is a new engineering stack designed to provide a native, high-performance experience for running PyTorch workloads on Google’s TPU infrastructure with minimal code changes. It features an "Eager First" approach with multiple execution modes and utilizes the XLA compiler to optimize distributed training across massive clusters. Moving into 2026, the project aims to further reduce compilation overhead and expand support for dynamic shapes and custom kernels to ensure seamless scalability for the next generation of AI.

    Blog-A