#456 Issue
June 23, 2025
Tag: HPC
HPC June 2, 2025Google Cloud Cluster Toolkit 2025: The Definitive Guide for Slurm-Based Workloads - Cluster Toolkit simplifies HPC, AI, and ML environment setup on Google Cloud by turning modular building blocks into ready-to-run environments. It uses a YAML blueprint, a module catalog, and the gcluster engine to quickly deploy and manage clusters with integrated tools like Slurm, Batch, and Cloud Monitoring, offering speed, flexibility, and cost clarity. Real-world examples demonstrate its effectiveness in scenarios like coastal storm simulations and AI model training, reducing setup time and costs.
GCP Experience HPC Official Blog May 5, 2025SandboxAQ: Accelerating drug discovery through cloud integration - SandboxAQ leverages Google Cloud infrastructure to accelerate drug discovery by enhancing computational methods and scalability. This integration has enabled them to significantly improve hit rates and reduce idle time, streamlining workflows from development to large-scale processing. Through Google Cloud, SandboxAQ facilitates faster experimentation and production, impacting drug discovery programs for various diseases.
HPC Official Blog April 14, 2025H4D VMs: Next-generation HPC-optimized VMs - Google Cloud has introduced H4D VMs, a new machine type optimized for high-performance computing (HPC). Powered by 5th Generation AMD EPYCTM Processors, H4D VMs offer improved whole-node VM performance and memory bandwidth. They also feature Cloud RDMA on Titanium, enabling low-latency and 200 Gbps network bandwidth. H4D VMs significantly outperform previous generations of AMD-based VMs, delivering faster simulations and analysis across various HPC applications and benchmarks.
HPC Official Blog April 14, 2025Colossus: the secret ingredient in Rapid Storage’s high performance - Rapid Storage, a new object storage service from Google Cloud, leverages the stateful protocol of Colossus, Google's internal zonal cluster-level file system, to provide sub-millisecond read/write latency and durable appends. With its gRPC-based streaming protocol, Rapid Storage supports 20 million requests per second in a single bucket, making it ideal for AI/ML data preparation, training, and checkpointing, distributed database architecture optimization, batch and streaming analytics processing, video live-streaming and transcoding, and logging and monitoring.
HPC Official Blog April 14, 2025Enabling global scientific discovery and innovation on Google Cloud - Google Cloud is introducing new capabilities to enable scientific discovery and innovation. Researchers can now deploy and use supercomputing clusters powered by the latest H4D VMs powered by AMD CPUs, and A4/A4X VMs powered by the latest NVIDIA GPUs.
Compute Engine HPC Official Blog April 14, 2025Driving enterprise transformation with new compute innovations and offerings - Google Cloud announces new compute innovations and offerings, including C4D VMs with improved performance, C4 VMs with new capabilities, H4D VMs for HPC workloads, M4 VMs for SAP workloads, Z3 for storage-intensive workloads, Nutanix Cloud Clusters on Google Cloud, and more options for VMware Engine. The company also introduces next-generation block storage with Hyperdisk, including Hyperdisk Storage Pools and Hyperdisk Exapools, and provides greater efficiency and control with managed instance groups.
Google Kubernetes Engine HPC Kubernetes March 31, 2025Mastering Complex Workloads with Kubernetes JobSet and GKE metrics - JobSet is a Kubernetes workload manager that simplifies the management of complex batch workloads. It allows users to define groups of related Jobs as "ReplicatedJobs" and manage them as a single unit. JobSet also provides automatic metrics on newer GKE clusters, making it easier to monitor and troubleshoot complex workloads. Some of the amazing features from JobSet are: Exclusive Job to topology placement, spec.coordinator, DNS for Pods, and Groups of Jobs of different templates.
HPC Official Blog Nov. 18, 2024What’s new with HPC and AI infrastructure at Google Cloud - Google Cloud is rapidly advancing its high-performance computing (HPC) capabilities, providing researchers and engineers with powerful tools and infrastructure to tackle the most demanding computational challenges. Key developments include the next generation of HPC VMs with improved scalability and performance, Parallelstore, a fully managed, scalable, high-performance storage solution based on next-generation DAOS technology, A3 Ultra VMs with NVIDIA H200 Tensor Core GPUs for GPU-based HPC workloads, and Trillium, Google's sixth-generation TPU.
AI HPC Official Blog Oct. 7, 2024Parallelstore is now GA, fueling the next generation of AI and HPC workloads - Parallelstore, a high-performance file service for HPC and AI workloads, is now generally available on Google Cloud. Built on the Distributed Asynchronous Object Storage (DAOS) architecture, Parallelstore combines a fully distributed metadata and key-value architecture to deliver high-performance throughput and IOPS.
HPC Official Blog Aug. 19, 2024Boosting Google Cloud HPC performance with optimized Intel MPI - Google Cloud and Intel have collaborated to optimize the Intel MPI Library for Google Cloud's H3 VMs with Titanium technology, delivering enhanced performance for HPC workloads.
HPC Official Blog Aug. 5, 2024Build large-scale AI/ML and HPC clusters with Cluster Toolkit (formerly HPC Toolkit) - The Cluster Toolkit (formerly HPC Toolkit) simplifies the creation and management of high-performance computing environments on Google Cloud. It offers easy deployment and management of clusters, quickstart options for HPC and AI/ML workloads, integration of Google Cloud best practices, regular updates and new features, and open-source accessibility.
HPC Official Blog TPU June 17, 2024Enhancing the HPC experience with Slurm-GCP v6 and TPU support - Google Cloud announces the general availability of Slurm-GCP v6, the latest and recommended version of its Slurm-based offering for HPC systems. This release brings faster deployments, robust reconfiguration, support for more deployments in a single project, fewer dependencies in the deployment environment, and full support for TPU v3 and v4. Users can start using v6 today by navigating to the Toolkit blueprint library.
GCP Experience HPC Official Blog May 20, 2024Performing large-scale computation-driven drug discovery on Google Cloud - Atommap, a computational drug discovery company built an elastic supercomputing cluster on the Google Cloud to empower large-scale, computation-driven drug discovery.
HPC Official Blog April 1, 2024Altair EDEM on Google Cloud: Breaking the billion-particle barrier
Compute Engine HPC Official Blog March 25, 2024Rocky Linux 8 and CentOS 7 versions of HPC VM image now generally available - With these HPC VM images, it's easy to build an HPC-ready VM instances.
HPC Official Blog March 18, 2024Announcing Cloud HPC Toolkit blueprint for AI/ML with the NeMo Framework on A3 VMs - The Cloud HPC Toolkit is a Google product that helps simplify the creation and management of HPC systems for AI/ML and traditional HPC workloads.
HPC Official Blog Feb. 11, 2024UM-Bridge: leveraging Kubernetes for scalable Uncertainty Quantification in the cloud
DevOps GCP Experience HPC Official Blog Feb. 11, 2024Salk Institute scientists scale brain research on Google Cloud with SkyPilot - SkyPilot is a framework for running LLMs, AI, and batch jobs on any cloud, offering maximum cost savings, highest GPU availability, and managed execution.
HPC Official Blog Feb. 5, 2024Cloud HPC made easy: A Blueprint Catalog for Google's Cloud HPC Toolkit - An overview of Cloud HPC Toolkit, that simplifies the deployment and management of HPC workloads and environments on Google Cloud.
HPC Official Blog Jan. 22, 2024Google Cloud HPC for computer aided engineering: Accelerate your design and simulation workflows - Google has developed a Computer Aided Engineering solution that brings together the right technologies to run major CAE applications efficiently. The solution harnesses Google Cloud’s HPC capabilities and is tailored to the simulation and analysis steps of CAE workflows.
AI HPC Machine Learning Official Blog Nov. 13, 2023Running AI and ML workloads with the Cloud HPC Toolkit - Google Cloud HPC Toolkit is a set of open-source tools and resources that help you create repeatable, turnkey HPC environments for your HPC, AI and machine learning workloads; you can quickly and easily use an existing blueprint, or create your own in a simple YAML file, to get a cluster up and running in minutes.
HPC Official Blog Nov. 13, 2023Google supports launch of DAOS Foundation, for next-generation HPC and AI storage - t Google Cloud is a founding member of the DAOS Foundation, launched today by the Linux Foundation.
Event HPC Official Blog Nov. 13, 2023Google Cloud at SC23: Learn how to accelerate your HPC and AI workloads - Supercomputing conference, SC23 is set to take place this year from November 12th to 17th, 2023, in Denver, Colorado.
Google Kubernetes Engine HPC Official Blog Nov. 6, 2023GKE: The new home for your batch platform - Today’s post is the first in a series that will provide the reasons for why administrators and architects should build batch processing platforms on Google Kubernetes Engine (GKE).
HPC Networking Official Blog Oct. 23, 2023Google opens Falcon, a reliable low-latency hardware transport, to the ecosystem - As a hardware-assisted transport layer, Falcon is designed to be reliable, high performance, and low latency and leverages production-proven technologies including Carousel, Snap, Swift, PLB, and CSIG.
HPC Official Blog Oct. 23, 2023C3D VMs with 4th Gen AMD EPYC Processors now GA, with 45 percent performance increase - A general availability of the C3D machine series powered by 4th Generation AMD EPYC™ Processors (code-named Genoa) to Google Compute Engine (GCE) and Google Kubernetes Engine (GKE) customers.
HPC Official Blog Sept. 4, 2023What’s new in Google Cloud’s workload-optimized infrastructure - Additions to Google Cloud’s workload-optimized infrastructure including the C3A, C3D, and new SAP workload support, let your workloads thrive.
HPC Official Blog Aug. 14, 2023Introducing H3 compute-optimized VMs for high performance computing (HPC) - New H3 VMs are optimized for high performance computing and offer improved price/performance compared to C2 instances.
HPC Official Blog Aug. 7, 2023Announcing public binaries for Spack on Google Cloud - Introducing a new Google-hosted build cache for Spack, backed by GCS, designed to significantly reduce software installation time in HPC environments.
HPC Official Blog July 3, 2023Improving the Slurm on Google Cloud Experience - The latest Slurm for Google Cloud adds new resource types and operating systems, simpler deployment, improved error reporting, and more.
HPC Official Blog April 3, 2023IBM Spectrum Scale is now available in Google Cloud - Google Cloud and Sycomp are introducing Sycomp Storage Fueled by IBM Spectrum Scale for HPC, AI/ML, and Big Data workloads.
BigLake Data Analytics HPC Official Blog Jan. 23, 2023Run data science workloads without creating more data silos - Build a data lake solution enabling data science teams to run workloads without creating new data silos, no matter how complex your organization is.
Event HPC Official Blog Nov. 7, 2022Meet Google Cloud at Supercomputing 2022 - Find out all the details on Google Cloud’s presence at the Supercomputing 2022 conference.
Compute Engine HPC Official Blog Oct. 17, 2022The next wave of Google Cloud infrastructure innovation: New C3 VM and Hyperdisk - C3 machines available in Private Preview, are the first VMs in the public cloud with the Intel Sapphire Rapids processor and with Google’s custom Intel IPU.
AI Compute Engine HPC Networking Official Blog TPU Oct. 17, 2022Google Cloud infrastructure enhancements tailored for your workloads
Google Kubernetes Engine HPC Official Blog July 25, 2022Using Google Kubernetes Engine’s GPU sharing to search for neutrinos - Native support for GPU time sharing and A100 Multi-Instance GPU partitioning allowed many more IceCube ray-tracing simulations from the same hardware.
Batch HPC Official Blog July 18, 2022Introducing Batch, a new managed service for scheduling batch jobs at any scale - The new Batch managed service manages job queues, provisions and autoscales resources, runs jobs, executes subtasks, and deals with common errors.
HPC Official Blog June 13, 2022Even more pi in the sky: Calculating 100 trillion digits of pi on Google Cloud - Compute Engine improvements like the N2 machine family and 100 Gbps egress bandwidth allowed us to calculate 100 trillion digits of pi—a world record.
HPC Official Blog May 30, 2022Accelerate your High Performance Computing journey with new Google Cloud HPC Toolkit - We introduce the Cloud HPC Toolkit, an open source tool enabling users to easily and quickly create HPC clusters based upon proven best practices.
HPC Infrastructure Official Blog May 23, 2022Introducing the latest Slurm on Google Cloud scripts - Announcing the latest Slurm on Google Cloud scripts, which help customers quickly and easily manage their hybrid and cloud-native HPC environments to run HPC, MPI, and AI/ML workloads on Google Cloud.
HPC Official Blog April 4, 2022Clouds in the cloud: Weather forecasting in Google Cloud - Learn to easily run the Weather Research and Forecast (WRF) model, how well it performs, and key optimizations on Google Cloud’s HPC platform.
Event GPU HPC Machine Learning March 28, 2022Join Google Cloud at NVIDIA GTC - Join Google Cloud at NVIDIA GTC to understand how Google Cloud and NVIDIA are able to help you conquer challenges.
HPC NetApp Official Blog March 7, 2022Accelerate Cloud EDA workflows with NetApp and Google Cloud - Google Cloud and NetApp’s ability to “burst to cloud”, seamlessly spinning up compute and storage on demand accelerates EDA design testing.
Compute Engine HPC Official Blog Feb. 14, 2022Introducing Compute Optimized VMs powered by AMD EPYC processors - We’ve increased your Compute Engine choices with new C2D Compute Optimized VMs with the 3rd Generation AMD EPYC Processor (code-named Milan).
HPC Networking Official Blog Oct. 25, 2021Accelerating MPI applications using Google Virtual NIC (gVNIC) - Using gVNIC improves MPI communication performance, which is a critical element of delivering high HPC application performance and scalability.
Cloud Dataproc Data Analytics GPU HPC Official Blog Aug. 30, 2021Single-cell genomic analysis accelerated by NVIDIA on Google Cloud - Learn about single-cell genomic analysis on Google Cloud using NVIDIA and Dataproc.
HPC Official Blog Aug. 23, 2021Scaling data access to 10Tbps (yes, terabits) with Lustre - Working with DDN and NAG, the Lustre file system running on Google Cloud ranked 8th on this year’s IO500 benchmark.
HPC Official Blog Aug. 9, 2021Deploy optimized HPC clusters in the cloud with Intel Select Solutions - Intel Select Solutions for Simulation and Modeling on Google Cloud make it easy to create optimized HPC environments quickly.
HPC Official Blog June 28, 2021IBM Spectrum LSF Now Supports HPC Workloads on Google Cloud - Google Cloud is excited to announce, in collaboration with IBM, enhanced capabilities to IBM Spectrum LSF job scheduling with Google Cloud resources.
HPC Official Blog June 22, 2021Expanding access to quantum today for a better tomorrow - You can gain access to IonQ’s trapped-ion quantum computer is available through the Google Cloud Marketplace.
AI HPC Machine Learning Official Blog TPU June 7, 2021New Cloud TPU VMs make training your ML models on TPUs easier than ever - New Cloud TPU VMs let you run TensorFlow, PyTorch, and JAX workloads on TPU host machines, improving performance and usability, and reducing costs.
HPC Official Blog May 31, 2021Never miss a tapeout: Faster chip design with Google Cloud - Augmenting on-premises chip design workflows with cloud-based capacity is a great way to speed up silicon workflows.
HPC Official Blog May 24, 2021Improving NCCL performance for cloud ML applications - How to optimize Google Cloud infrastructure to minimize deep learning training times with distributed/multi-node synchronous training using NCCL.
Compute Engine HPC Official Blog March 29, 2021Getting Compute Engine resources for batch processing just got easier - You can now obtain Compute Engine resources for batch processing workloads that account for availability of resources in zones of a region.
HPC Official Blog March 22, 2021Introducing the latest Slurm on GCP scripts - The latest version of Slurm for Google Cloud includes support for Terraform, the HPC VM Image, placement policies, Bulk API and instance templates.
GPU HPC Official Blog March 22, 2021A2 VMs now GA—the largest GPU cloud instances with NVIDIA A100 GPUs - A2 VMs with NVIDIA A100 GPUs are now generally available for your most demanding workloads including machine learning and HPC.
HPC Official Blog Feb. 8, 2021Introducing HPC VM images—pre-tuned for optimal performance - Google Cloud’s first pre-configured HPC VM image is a CentOS 7-based image optimized for tightly-coupled MPI workloads.
HPC Official Blog Dec. 28, 2020Scale your EDA flows: How Google Cloud enables faster verification - Google Cloud compute infrastructure can speed up HPC workloads such as EDA.
HPC Official Blog Dec. 7, 2020Getting higher MPI performance for HPC applications on Google Cloud - You can reduce MPI latency in HPC workloads running on Google Cloud by following these best practices.
Compute Engine HPC Official Blog Nov. 22, 2020The need for speed: Using C2 machines for your HPC workloads - Optimize your HPC workloads for the compute-optimized (C2) VMs based on second generation Intel Xeon Scalable Processors.
AI Platform AI Platform Prediction GPU HPC Sept. 28, 2020How to create a numeric calculation web service that autoscales on GPUs - Numeric-calculations-as-a-service by leveraging ML Infrastructure.
Compute Engine HPC Official Blog July 13, 2020New Compute Engine A2 VMs—first NVIDIA Ampere A100 GPUs in the cloud - Google Cloud’s new Accelerator-Optimized (A2) VM family is based on the NVIDIA Ampere A100 GPU, and designed for demanding HPC and ML workloads.
GPU HPC Official Blog May 18, 2020Google Cloud and NVIDIA’s enhanced partnership accelerates computing workloads - We’re announcing our support for the new NVIDIA Ampere architecture and the NVIDIA A100 Tensor Core GPU.
Google Kubernetes Engine HPC Official Blog Nov. 18, 2019Introducing Batch on GKE—modernizing HPC with Kubernetes in the cloud - Batch onGKE lets you run batch workloads on Google Kubernetes Engine
HPC Official Blog June 10, 2019Competing with supercomputers: HPC in the cloud becomes reality - Google Cloud Storage and DDN’s EXAScaler recently tackled the IO-500 high-performance computing (HPC) benchmark, with great results.
Useful Links
Contact
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]