Google Cloud Platform Newsletter

Check Archive for older issues

News

Showing the C++ developer love with new client libraries - Introducing new C++ client libraries for Google Cloud.

Google completes Looker acquisition - We’re pleased to announce that Google has completed its acquisition of Looker. Together, we’ll support more businesses globally to address their most challenging data analytics and business intelligence needs.

Google Cloud named a Leader in the Forrester Wave: Data Management for Analytics - Google is a Leader in the Forrester Wave: Data Management for Analytics, the first time this category has existed. See why cloud data analytics at Google won praise.

Running workloads on dedicated hardware just got better - Improving Compute Engine sole-tenant nodes for dedicated hardware

Now updated: Our Data Engineering Learning Path - To address the evolving skill set today’s data engineers need, we updated our Data Engineering on Google Cloud Platform learning path.

Bring 20/20 vision to your pipelines with enhanced monitoring - New observability features in cloud batch and stream data processing let Google Cloud users identify pipeline problems faster.

Easily upgrade Windows Server 2008 R2 while migrating to Google Cloud - Migrate for Compute Engine automatically upgrades Windows Server 2008 R2 to 2012.

Working with Hedera Hashgraph to support the next generation of distributed ledger technology - Hedera Hashgraph is expanding its work with Google Cloud to make DLT even more readily available for its community members.

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

Exploring Container Security: Run what you trust; isolate what you don’t - Help lock down your containers with these Kubernetes Engine features and guidance

Anatomy of a production Kubernetes cluster - At Brandwatch we’ve been running Kubernetes in production since October 2016. This is an overview of our basic cluster specification.

Google Config Connector: Deploying Spanner from Kubernetes - A dive into Google’s Config Connector for Kubernetes. Deploy GCP Services with Kubernetes YAML definitions.

Building a Rancher cluster on Google Cloud with Terraform - Setting up Rancher 2.x Kubernetes cluster on Google Compute Engine with Terraform.

With Google Anthos, My Other Cloud Is Whatever I Want - Perspective on Anthos.

App Development, Serverless, Databases, DevOps

Logging + Trace: love at first insight - Stackdriver’s Trace and Logging are a match made in heaven for troubleshooting logs and seeing how your code functions and its context.

Low code programming with Node-RED comes to GCP - Learn how to wire together Google Cloud services with Node-RED visual programming.

Running workflows at Freetrade, serverless! - Facing and resolving problems on Cloud Composer.

An app modernization story — Part 3 (Containerize & Redeploy) - Transforming Windows-only .NET Framework app to a containerized multi-platform .NET Core app.

One weird trick to predict retrieval costs in Google Cloud Storage - Explaining billing costs on Cloud Storage operations.

Rate limit your API usage with Cloud Endpoints quotas - Rate limit helps to protect your API usage and protect your billing. But how to set up these quotas in an easy and serverless way?

Google Cloud’s Best Hidden Feature - How to convert Web UI action to the equivalent REST call or CLI command.

A guide to running Serverless framework on Google Cloud Platform - Using Serverless framework on Google Cloud.

Migrating our cloud infrastructure to Google Cloud (Part 1/4) - Migrating from HBase to Cloud Bigtable.

Big Data, Analytics, ML&AI

Taking a practical approach to BigQuery slot usage analysis - See how to understand slots in BigQuery, Google Cloud’s enterprise data warehouse, to keep an eye on resource usage.

BigQuery under the hood: How zone assignments work - Get a look at the technical details of zone assignments in BigQuery, the cloud enterprise data warehouse.

Revisiting Google Search Console Data into Google BigQuery - Taking a fresh look at sending Google Search Console data into BigQuery, using Python, for free.

How to package a JavaScript library for use in BigQuery - The article explains how to package a JavaScript library for use in BigQuery UDF.

Jupyter Notebook basic testing - Creating a new infrastructure pipeline for Jupyter notebooks.

Streaming Analytics — Data Processing Options on Google Cloud Platform - Streaming possibilities and scenarios on Google Cloud.

All things GCP: Machine Learning Decision pyramid - Understand which Google Cloud tools matches best for you.

How to create DataFlow IoT Pipeline on Google Cloud Platform - Creating ingestion pipeline for IoT.

Simplify BigQuery ETL jobs using SQLAlchemy - Using SQLAlchemy (Python's ORM library) for BigQuery.

Change-data Capture (CDC) solution to capture data from an MySQL database, and sync it into BigQuery. - Syncing MySQL database to BigQuery via Cloud Dataflow.

How to carry out CI/CD in Machine Learning (“MLOps”) using Kubeflow ML pipelines (#3) - The article goes through process of setting up a cluster, notebook, and submitting pipelines.

Various

How Udacity students succeed with Google Cloud - Udacity uses a variety of Google Cloud tools to build its Workspaces.

Slides, Videos, Audio

Kubernetes Podcast - #90 CockroachDB, with Peter Mattis

Releases

AppEngine - App Engine is changing the URLs that you use to send requests to your apps. To ensure a smooth transition, we are slowly updating App Engine to use region IDs.

BigQuery - INFORMATION_SCHEMA views for live and historical jobs metadata are now in beta. Updated versions of Magnitude Simba ODBC drivers are now available.

CDN - Cloud CDN custom origins support is available in Beta.

Cloud Composer - New versions of Cloud Composer images: composer-1.9.0-airflow-1.10.1, composer-1.9.0-airflow-1.10.2, composer-1.9.0-airflow-1.10.3 and composer-1.9.0-airflow-1.10.6. Airflow 1.10.6 is now available for Composer. Python 3 is now the default version for new Composer environments. For Airflow versions 1.10.3 and 1.10.6, the experimental REST API now correctly respects the store_serialized_dags setting, enabling the use of experimental APIs with VPC-SC.

Dataprep - Many new features and issues fixed. Check the URL for more details.

Datastore - You can now configure indexes with the REST API.

Cloud Functions - HTTP functions now require authentication by default.

IAM - The Cloud IAM recommender is now generally available.

Identity-Aware Proxy - API for OAuth clients now generally available You can now programmatically create OAuth clients in IAP via REST or gcloud.

Google Kubernetes Engine - Private clusters created on and after January 15, 2020 that use VPC peering reuse might experience an issue where VPC peering is removed after attempting to reschedule a cluster for deletion after the first attempt fails. GKE cluster versions have been updated as detailed in the following sections. The default version for new clusters is now 1.14.10-gke.17. Masters and nodes with auto-upgrade enabled will be upgraded: Rollouts are phased across multiple weeks, to ensure cluster and fleet stability. No channelv.1.13.x 1.13.12-gke.25 v.1.14.x 1.14.10-gke.17 v.1.15.x 1.15.9-gke.8 Stable channel 1.14.10-gke.17 Regular channel 1.15.7-gke.23 Rapid channel 1.16.4-gke.30. The following versions are no longer available for new clusters or upgrades. 1.13.11-gke.14. 1.13.11-gke.15. 1.13.11-gke.23 (moved to LEGACY version). 1.13.12-gke.8. 1.13.12-gke.13. 1.13.12-gke.14. 1.13.12-gke.16. 1.13.12-gke.17. Surge upgrades are generally available.

Google Kubernetes Engine Rapid - 1.16.4-gke.30 is now available in the Rapid release channel.

Google Kubernetes Engine Stable - v1.14.10-gke.17 is the default for new Stable channel clusters.

Load Balancing - Network endpoint groups (NEGs) now support global, internet endpoints that let you create custom origins for Cloud CDN and deliver content over Google's high performance, distributed edge caching infrastructure when the content is hosted on-premises or in another cloud.

AI Platform - You can now set a maximum running time when you create a training job. The known issue with using custom prediction routines together with runtime version 1.15 and Python 3.7 has been fixed.

Security Command Center - Security Command Center roles inherit Web Security Scanner roles as follows: The securitycenter.adminViewer role inherits the permissions of the cloudsecurityscanner.viewer role. The notifications API is now in beta: Send new findings and updated findings notifications to a Pub/Sub topic. Security Command Center tools will become obsolete in future Security Command Center releases, when their functionalities are added as built-in features.

Stackdriver - You can now send notifications from your alerting policies to Cloud Pub/Sub topics. The Stackdriver Monitoring Dashboard API is now Generally Available. Stackdriver Monitoring agent version 6.0.0 is now available for the CentOS 8 distribution.