Posts by Ivan Nardini

4 results

Clear filters
  • JULY 6, 2026 / AI

    We terminated a TPU mid-training and it recovered in seconds: Introduction to elastic training with MaxText

    Distributed AI training is notoriously fragile because losing a single machine typically crashes the entire multi-node job, forcing a time-consuming, full-workload infrastructure restart. To address this, Google’s JAX ecosystem utilizes elastic training via Pathways, which converts a hardware failure into a catchable Python exception so the running process can survive. When an unplanned failure occurs, the system automatically replaces only the broken worker, restores the last viable checkpoint from Cloud Storage, and resumes training in place—minimizing total downtime to under two minutes without ever restarting the main controller process.

    Gemini_Generated_Image_b07hglb07hglb07h
  • APRIL 29, 2025 / Cloud

    Announcing the general availability of Llama 4 as MaaS on Vertex AI

    Llama 4, Meta's advanced large language model, is now generally available as a fully managed API on Vertex AI, simplifying deployment and management. The Llama 3.3 70B managed API is also generally available, offering users greater flexibility.

    Announcing the general availability of Llama 4 MaaS on Vertex AI
  • SEPT. 26, 2024 / AI

    Enhance your prompts with Vertex AI Prompt Optimizer

    Vertex AI Prompt Optimizer, a new managed automated prompt engineering service, can help save time and effort in prompt engineering while ensuring performing prompts ready for your generative AI applications.

    Vertex-AI-Social
  • JULY 9, 2024 / Gemma

    Get started with Gemma on Ray on Vertex AI

    Use Gemma Supervised tuning on Ray on Vertex AI to train and serve machine learning models efficiently and effectively.

    Gemma on Ray on Vertex AI - Featured