#456 Issue
June 23, 2025
Tag: GPU
AI GPU Networking June 30, 2025Part I - RoCEv2 for optimized GPU AI workloads on Google Cloud : (1) Why it matters? - The article discusses the importance of RDMA over Converged Ethernet v2 (RoCEv2) for optimizing GPU-based AI workloads on Google Cloud. RoCEv2 enables direct communication between GPUs, bypassing the CPU and reducing latency while increasing throughput, through specialized VPC configurations and VMs with ConnectX-7 NICs.
GPU Official Blog June 16, 2025New G4 VMs with NVIDIA RTX PRO 6000 Blackwell power AI, graphics, gaming and beyond - New G4 VMs based on NVIDIA RTX PRO 6000 Blackwell Server edition round out the Compute Engine GPU portfolio for developers and creators.
Cloud Run GPU Official Blog Serverless June 9, 2025Cloud Run GPUs, now GA, makes running AI workloads easier for everyone - Support for GPUs in Cloud Run makes running GPU-accelerated applications simpler, faster, and more cost-effective, as well as enabling new use cases.
GPU Kubernetes Machine Learning Paywall March 31, 2025Multi Instance GPUs (MIG) in GKE - Multi-Instance GPUs (MIG) in GKE allows users to partition a physical GPU into multiple smaller, isolated instances, optimizing GPU utilization for AI/ML workloads. With MIG, you can run multiple workloads in parallel on the same GPU, improve GPU utilization for small-to-medium ML tasks, and achieve workload isolation and better scheduling granularity.
GKE Autopilot GPU March 31, 2025Production-ready ComfyUI on Google Cloud - This article describes how Slalom built a production-ready AI image generation application using ComfyUI and the CyberRealistic XL model on Google Cloud. They utilized GKE Autopilot, NVIDIA H100 GPUs, a custom queuing system, and GPU partitioning to create a highly scalable and efficient platform.
GPU Official Blog Partners March 24, 2025Google Cloud at GTC: A4 VMs now generally available, A4X VMs in preview - Google Cloud is showcasing its latest advancements in AI and accelerated computing at NVIDIA's GTC AI Conference in San Jose, California. The company announced the general availability of A4 VMs and the preview of A4X VMs, powered by NVIDIA's HGX B200 and GB200 NVL72 GPUs, respectively.
Compute Engine GPU Official Blog Feb. 24, 2025Introducing A4X VMs powered by NVIDIA GB200 — now in preview - Google Cloud introduces A4X VMs powered by NVIDIA GB200 GPUs, offering exceptional performance for reasoning models and large language models with long context windows. These VMs feature 72 NVIDIA Blackwell GPUs and 36 Arm-based NVIDIA Grace CPUs, delivering 4X the training performance of A3 VMs.
Compute Engine GPU Official Blog Feb. 3, 2025Blackwell is here — new A4 VMs powered by NVIDIA B200 now in preview - Google Cloud introduces A4 VMs powered by NVIDIA B200 GPUs, offering significant performance improvements over previous generations.
Compute Engine GPU Official Blog Jan. 27, 2025Announcing smaller machine types for A3 High VMs - Google Cloud now offers smaller machine types for A3 High VMs powered by NVIDIA H100 80GB GPUs. These new machine types provide more granularity in the number of GPUs available, allowing organizations to scale with user demand while keeping costs low.
Batch GPU Machine Learning Jan. 27, 2025Model fine-tuning made easy with Axolotl on Google Cloud Batch - Axolotl, an open-source fine-tuning tool, simplifies managing configurations and different setups, while Google Cloud Batch provides a fully managed service to handle the resource-intensive work.
Google Kubernetes Engine GPU Official Blog Vertex AI Dec. 16, 2024Orchestrating GPU-based distributed training workloads on AI Hypercomputer - Google Cloud offers various GPU orchestration options for AI Hypercomputer, including GKE, Cluster Toolkit, and Vertex AI.
Google Kubernetes Engine GPU Official Blog Oct. 28, 2024Save on GPUs: Smarter autoscaling for your GKE inferencing workloads - Autoscaling with GPU utilization can cause you to overprovision LLM workloads, adding unnecessary cost to meeting your performance goals. Autoscaling with LLM server metrics will enable you to achieve your latency or throughput goals while spending the minimal amount on accelerators.
GPU Machine Learning Aug. 26, 2024Cloud Run GPU: Make your LLMs serverless - Cloud Run is a great serverless scale-to-0 service, but with limited use cases because of limited hardware. What about if GPUs are….
AI Cloud Run GPU Official Blog Serverless Aug. 26, 2024Run your AI inference applications on Cloud Run with NVIDIA GPUs - Cloud Run now supports NVIDIA L4 GPUs, enabling developers to run real-time AI inference applications with lightweight open models like Google's Gemma or Meta's Llama. This allows for building custom chatbots, on-the-fly document summarization, and serving fine-tuned AI models.
Google Kubernetes Engine GPU LLM Official Blog Aug. 26, 2024Maximize your LLM serving throughput for GPUs on GKE — a practical guide - This blog post contains recommendations that can help you maximize your serving throughput on NVIDIA GPUs on GKE. Combining these recommendations with the performance benchmarking tool will enable you to make data-driven decisions when setting up your inference stack on GKE.
GPU Official Blog PyTorch April 29, 2024Announcing PyTorch/XLA 2.3: Distributed training, dev improvements, and GPUs
AI Compute Engine GPU Official Blog April 15, 2024What’s new with Google Cloud’s AI Hypercomputer architecture
AI GPU Official Blog TPU April 15, 2024Accelerate AI Inference with Google Cloud TPUs and GPUs
Google Kubernetes Engine GPU Official Blog March 25, 2024Automatic driver installation simplifies using NVIDIA GPUs in GKE - GKE can now automatically install NVIDIA GPU drivers, making it easier for customers to take advantage of GPUs.
AI Google Kubernetes Engine GPU Official Blog Partners March 25, 2024Accelerate your generative AI journey with NVIDIA NeMo framework on GKE - This blog post shows how generative AI models can be adapted to your use cases by demonstrating how to train models on Google Kubernetes Engine (GKE) using NVIDIA accelerated computing and NVIDIA NeMo framework.
Google Kubernetes Engine GPU Kubernetes Feb. 19, 2024Looking for GPU Capacity? DWS got you covered ! - Using Dynamic Workload Scheduler on GKE to run ML jobs.
GPU Official Blog Feb. 19, 2024Immersive Stream for XR: Performance and savings with NVIDIA L4 GPU and autoscaling - Improvements in both performance and cost savings to Immersive Stream for XR, Google Cloud’s solution for hosting, rendering, and streaming 3D and eXtended reality (XR) experiences.
Cloud Monitoring Compute Engine GPU Official Blog Sept. 25, 2023Monitor your NVIDIA GPUs on Compute Engine with Ops Agent - Ops Agent now collects metrics from NVIDIA GPUs on Compute Engine VMs.
GPU Official Blog TPU Sept. 18, 2023Helping you deliver high-performance, cost-efficient AI inference at scale with GPUs and TPUs - Based on the results of MLPerf™ v3.1 Inference Closed, Google Cloud GPU and TPU offerings deliver exceptional performance per dollar for AI inference.
GKE Autopilot GPU Official Blog TensorFlow July 31, 2023TensorFlow on GKE Autopilot with GPU acceleration - Provision GPUs and execute AI workloads using GKE with automated creation and teardown.
AI Google Kubernetes Engine GPU Machine Learning Official Blog July 17, 2023Improve training time of distributed machine learning with NCCL Fast Socket - NCCL Fast Socket uses a number of techniques to achieve better and more consistent NCCL performance.
GPU Official Blog May 15, 2023Announcing A3 supercomputers with NVIDIA H100 GPUs, purpose-built for AI - The next-generation A3 GPU supercomputer powered by NVIDIA H100 GPUs are purpose-built for training and inference of ML models.
AI GPU Official Blog April 3, 2023Google Cloud and NVIDIA bring next-generation AI infrastructure and software for large scale models and generative AI applications to enterprises - NVIDIA and Google Cloud help companies accelerate generative AI and other modern AI workloads.
Compute Engine GPU Official Blog March 27, 2023Introducing G2 VMs with NVIDIA L4 GPUs — a cloud-industry first - The G2 VM powered by the NVIDIA L4 GPU delivers technological advancements for AI workloads such as generative AI.
Google Kubernetes Engine GPU Machine Learning Official Blog March 27, 2023Getting started with JAX multi-node applications with NVIDIA GPUs on Google Kubernetes Engine - You can attach multiple GPUs to GKE clusters to help with Python apps doing high performance computing and ML.
BigQuery GPU Machine Learning Vertex AI Jan. 23, 2023Step-by-Step Guide to Accelerate ML Jobs with Rapids, Dask, Vertex and GPUs - An example of training 4 million of rows of data with the xgboost on Vertex AI.
Apache Beam Cloud Dataflow GPU Machine Learning TensorFlow Dec. 19, 2022Simplifying and Accelerating Machine Learning Predictions in Apache Beam with NVIDIA TensorRT - A walk through the integration of NVIDIA TensorRT with Apache Beam SDK and showing how complex inference scenarios can be fully encapsulated within a data processing pipeline.
Google Kubernetes Engine GPU Monitoring Official Blog Dec. 5, 2022Monitoring GPU workloads on GKE with NVIDIA Data Center GPU Manager (DCGM) - How to setup NVIDIA DCGM in your GKE cluster and how to observe GPU utilization using Cloud Monitoring and Grafana.
GKE Autopilot GPU Official Blog Oct. 3, 2022Introducing support for GPU workloads and even larger Pods in GKE Autopilot - GPU support launches on GKE Autopilot. Run workloads like AI/ML training and inference, and video transcoding on a fully managed Kubernetes platform.
Google Kubernetes Engine GPU Official Blog Sept. 19, 2022How Let’s Enhance uses NVIDIA AI and GKE to power AI-based photo editing - Let’s Enhance uses AI to beautify images. GKE provides auto-provisioning, autoscaling and simplicity, while GPUs provide superior processing power.
Google Kubernetes Engine GPU Official Blog Aug. 8, 2022Sharing is caring: How NVIDIA GPU sharing on GKE saves you money - GPU time-sharing and A100 Multi-Instance GPU partitioning enabled higher GPU utilization and saved cost.
BigQuery Data Analytics GPU Official Blog Python July 25, 2022Scalable Python on BigQuery using Dask and NVIDIA GPUs - To accelerate data analytics and machine learning workflows, we introduce the Dask BigQuery connector to read data through BigQuery storage API and deploy at scale on NVIDIA GPUs using Dask and RAPIDS on Google Dataproc.
Event GPU HPC Machine Learning March 28, 2022Join Google Cloud at NVIDIA GTC - Join Google Cloud at NVIDIA GTC to understand how Google Cloud and NVIDIA are able to help you conquer challenges.
GCP Experience GPU Machine Learning Official Blog Oct. 4, 2021QuillBot cuts writing time for over 10 million users using Google Cloud - QuillBot gains scalability and cost savings for natural language processing platform with Google Cloud Compute Engine and NVIDIA GPUs.
Cloud Dataproc Data Analytics GPU HPC Official Blog Aug. 30, 2021Single-cell genomic analysis accelerated by NVIDIA on Google Cloud - Learn about single-cell genomic analysis on Google Cloud using NVIDIA and Dataproc.
GPU Official Blog Aug. 16, 2021Streaming VR and AR content from Google Cloud with NVIDIA CloudXR - How NVIDIA CloudXR in Google Cloud data centers enables high-fidelity VR and AR applications.
Cloud Dataflow Data Analytics GPU Official Blog July 26, 2021Give your data processing a boost with Dataflow GPU - With Dataflow GPU, customers can leverage the power of NVIDIA GPUs in their data pipelines.
Google Kubernetes Engine GPU Official Blog May 3, 2021Turbocharge workloads with new multi-instance NVIDIA GPUs on GKE - You can now partition a single NVIDIA A100 GPU into up to seven instances and allocate each instance to a single Google Kubernetes Engine container.
GPU HPC Official Blog March 22, 2021A2 VMs now GA—the largest GPU cloud instances with NVIDIA A100 GPUs - A2 VMs with NVIDIA A100 GPUs are now generally available for your most demanding workloads including machine learning and HPC.
AI Platform Data Analytics GPU Official Blog March 1, 2021Scale model training in minutes with RAPIDS + Dask and NVIDIA GPUs on AI Platform - Scale model training from 10 GB to 640 GB in minutes with RAPIDS + Dask and NVIDIA GPUs on AI Platform.
AI Platform Notebooks Big Data Data Science GPU Jan. 18, 2021An Accelerated Big Data Workflow for the Data Analyst - Explore and analyze 1B loan records with RAPIDS & Nvidia A100 GPUs on Cloud AI Platform.
AI Platform Notebooks Data Analytics GPU Jan. 18, 2021Powerful yet familiar workflow for the Data Analyst - Accelerating data processing using GPUs.
AI Platform GPU TensorFlow Dec. 14, 2020Getting Started with Distributed TensorFlow on GCP - In this tutorial-style article, you’ll get hands-on experience with GCP data science tools and train a TensorFlow model across multiple GPUs. You’ll also learn key terminology in the field of distributed training, such as data parallelism, synchronous training, and AllReduce.
AI AI Platform GPU Machine Learning Nov. 2, 2020Serving Machine Learning models in Google Cloud - This multi-part blog discusses common options for high-performance ML model inference in Google Cloud, when to use which, and introduces the new member of the AI Platform family: Custom Container Prediction.
AI Platform AI Platform Prediction GPU HPC Sept. 28, 2020How to create a numeric calculation web service that autoscales on GPUs - Numeric-calculations-as-a-service by leveraging ML Infrastructure.
Anthos GPU Official Blog Aug. 24, 2020Deploy GPU workloads across all your clouds with Anthos and NVIDIA - You can now burst workloads running on NVIDIA GPUs from on-prem to the cloud using Anthos.
GPU HPC Official Blog May 18, 2020Google Cloud and NVIDIA’s enhanced partnership accelerates computing workloads - We’re announcing our support for the new NVIDIA Ampere architecture and the NVIDIA A100 Tensor Core GPU.
GPU May 18, 2020GPU shortage in all regions - It seems like there's a mass shortage of all GPUs.
Cloud Dataproc Data Analytics GPU Official Blog April 13, 2020Machine learning with XGBoost gets faster with Dataproc on GPUs - Machine learning workloads can move a lot faster when run on GPUs vs. CPUs. See how to do it with NVIDIA, XGBoost and Dataproc for ML model building.
AI Platform GPU Machine Learning TensorFlow Dec. 16, 2019AI Platform Prediction with Accelerators - Using NVIDIA's GPUs to train ML models on AI Platform.
Compute Engine GPU Official Blog Dec. 2, 2019Optimizing GPU performance - Improving the performance of GPUs on virtual machine (VM) instances that use Tesla® K80 GPUs.
AI GPU Machine Learning Official Blog Nov. 4, 2019Reduce the costs of ML workflows with preemptible VMs and GPUs - If you have some flexibility in your timing and availability, preemptible VMs with GPUs can be a useful tactic for significantly lowering those costs.
Compute Engine GPU Monitoring Stackdriver Sept. 30, 2019Enabling custom GPU metrics in StackDriver for Google Cloud Platform. - Setting Stackdriver monitoring of GPU unit.
Compute Engine GPU April 29, 2019How to run AI2-THOR simulation fast with Google Cloud Platform - Using AI2-THOR (3D-Simulation tool) on Google Compute Engine.
Compute Engine GPU Tutorial April 1, 2019GCP and Fast Ai v1: A full setup that’ll work - The article goes through steps of setting Compute Engine VM with GPU.
GPU April 1, 2019GCP Podcast - #168 NVIDIA T4 with Ian Buck and Kari Briski
GPU Machine Learning Jan. 28, 2019Getting started with GPU Computing for machine learning - Setting up GPU Computing for machine learning.
CI Compute Engine DevOps GPU Terraform Jan. 28, 2019Seamlessly Integrated Deep Learning Environment with Terraform, Google cloud, Gitlab and Docker - Setting up a GCE Instance with GPUs in an automated way using Terraform and deploy code from Gitlab.
GPU Official Blog Jan. 21, 2019NVIDIA Tesla T4 GPUs now available in beta - T4 GPU instances are now available publicly in beta in Brazil, India, Netherlands, Singapore, Tokyo, and the United States.
GPU Official Blog TensorFlow Tutorial Jan. 21, 2019Running TensorFlow inference workloads at scale with TensorRT 5 and NVIDIA T4 GPUs - How to run deep learning inference on large-scale workloads with NVIDIA TensorRT 5 running on Compute Engine VMs configured with our Cloud Deep Learning VM image and NVIDIA T4 GPUs.
Google Kubernetes Engine GPU Official Blog Jan. 14, 2019Livin’ la vida local: Easier Kubernetes development from your laptop - Run GPU workloads on minikube.
Compute Engine GPU Dec. 17, 2018Leveraging Google Compute Engine for Low-cost GPU Rendering (and Other Fun Exercises in Patience) - Low-cost GPU Rendering with Google Compute Engine.
Google Cloud Platform Google Kubernetes Engine GPU Kubernetes Dec. 17, 2018Using Kubeflow for Financial Time Series: Part II — Leveraging GPUs on demand - Run a TF-job on a GPU to reduce training time.
GPU Official Blog Nov. 19, 2018Google Cloud first to offer NVIDIA Tesla T4 GPUs - Alpha availability for the NVIDIA Tesla T4 GPU which is optimized for machine learning (ML) inference, distributed training of models, and computer graphics.
GPU Oct. 29, 2018Inference On GPUs At Scale With Nvidia TensorRT5 On Google Compute Engine - How to do an in inference at a big scale on GPUs with TensorRT5.
GPU Stackdriver Oct. 22, 2018GPU Monitoring Agent For GCP StackDriver - Stack Driver Monitoring Agent that reports average GPU utilization and average memory GPU utilization.
GPU Machine Learning TPU Oct. 15, 2018Google Colab provides free access to GPUs and TPUs. - Using Develop deep learning applications on this free GPU/TPU.
Compute Engine GPU Tutorial Sept. 17, 2018Semi-Managed Jupyter Lab With Access To Google Cloud Resources - Setting Jupyter Lab on Google Compute Engine.
GPU Official Blog Sept. 3, 2018Tesla V100 GPUs are now generally available - NVIDIA V100 graphics processing units (GPUs) with NVLink are general available.
Cloud ML GPU Aug. 27, 2018Training Keras with GPUs & Serving Predictions with Cloud ML Engine
GPU Official Blog Aug. 13, 2018Introducing NVIDIA Tesla P4 GPUs for accelerating virtual workstations and ML inference on Compute Engine - New addition to the GCP Platform with NVIDIA Tesla P4 GPUs for virtual workstations and ML inference on Compute Engine.
GPU Machine Learning Tutorial June 25, 2018Complete Step by Step Guide of Keras Transfer Learning with GPU on Google Cloud Platform - Guide for Keras Transfer Learning with GPU on Google Cloud Platform.
GPU Official Blog June 18, 2018Introducing improved pricing for Preemptible GPUs - Preemptible GPUs are generally available (with lower prices).
GPU TensorFlow June 18, 2018Setting up Tensorflow and GPUs on Google Cloud Platform to run your neural network implementations - Step by step procedure on how to set up GPUs and Tensorflow on Google Cloud Platform.
Compute Engine GPU TensorFlow June 4, 2018Installing Tensorflow-GPU with NVIDIA CUDA on a Google Cloud Platform VM instance - Using Tensorflow-GPU and NVIDIA CUDA configured VM instance on Google Cloud Platform.
Compute Engine GPU TensorFlow June 4, 2018Setting up a Google Cloud instance for Deep Learning - How to set-up a Google Cloud instance for Deep Learning.
GPU April 30, 2018Setup Google Cloud Compute Instance with GPU - Setting up Google Compute Platform with a GPU.
GPU April 30, 2018Quickly Install CUDA and cuDNN on Google Cloud Compute - Install NVIDIA CUDA and cuDNN onto a Google Cloud Platform (GCP) instance.
GPU TensorFlow Tutorial March 26, 2018Automatic GPUs - Explore R / Python approach to getting up and running quickly on GCloud with GPUs in Tensorflow.
GPU March 26, 2018GPC Podcast - #119 NVIDIA and Deep Learning Research with Bryan Catanzaro.
GPU Machine Learning Jan. 8, 2018Introducing Preemptible GPUs: 50% Off - Beta release of Preemptible GPUs which are particularly good fit for large-scale machine learning and other computational batch workloads.
Beginner GPU Machine Learning Tutorial Jan. 8, 2018Ultimate guide to setting up a Google Cloud machine for fast.ai version 2 - Guide to setting up a Google Cloud machine for fast.ai courses (Google Compute Engine with GPU).
Compute Engine GPU Nov. 27, 2017New lower prices for GPUs and preemptible Local SSDs
Google Cloud Platform GPU Nov. 27, 2017Introducing VRay GPU rendering and CaraVR support on Zync Render - In Zync Render platform now supports Vray GPU and Foundry’s VR toolset CaraVR.
Compute Engine GPU Sept. 25, 2017Introducing faster GPUs for Google Compute Engine - New NVIDIA P100 GPUs are introduced as well as sustained discount for GPUs
Compute Engine GPU Python Sept. 18, 2017Jupyter+Keras+ Nvidia Docker with GPU on Google Cloud in an instant - Kit to create an environment with Jupyter notebook, Keras and Nvidia docker with GPU on google cloud
GPU TensorFlow Aug. 20, 2017Launch a GPU-backed Google Compute Engine instance and setup Tensorflow, Keras and Jupyter - Article goes through setting up GPUs on Compute Engine and use TensorFlow and Jupyter
Compute Engine GPU Aug. 7, 2017Google Cloud Platform at SIGGRAPH 2017 - Related mostly to ZYNC Render Service
GPU TensorFlow July 24, 2017Using a GPU & TensorFlow on Google Cloud Platform - Tutorial about how to setup GPU instances and run on them Tensorflow models
Compute Engine GPU TensorFlow July 10, 2017Jupyter + Tensorflow + Nvidia GPU + Docker + Google Compute Engine
Compute Engine Docker GPU TensorFlow June 12, 2017Jupyter + Tensorflow + Nvidia GPU + Docker + Google Compute Engine - Running Jupiter notebooks with GPUs and Docker
GPU Machine Learning May 15, 2017Announcing general availability of GPUs for Cloud Machine Learning Engine - For just 3 months GPUs are going from Beta to Generally Available
Compute Engine GPU May 8, 2017GCP + GPUs + Kubernetes (and Tensorflow) - How to setup up Kubernetes GPU cluster with juju program on Google Cloud Platform
Business GPU May 8, 2017Why cloud GPUs finally make sense - Shazam is company which creates application for music recognition and recently started using GPUs on Google Cloud Platform
Google Kubernetes Engine GPU Official BlogGPUs as a service with Kubernetes Engine are now generally available - General availability of GPUs in Google Kubernetes Engine.
Useful Links
Contact
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]