Welcome to issue #177 February 17th, 2020

News

C++ Official Blog

Showing the C++ developer love with new client libraries - Introducing new C++ client libraries for Google Cloud.

Business Data Analytics Official Blog

Google completes Looker acquisition - We’re pleased to announce that Google has completed its acquisition of Looker. Together, we’ll support more businesses globally to address their most challenging data analytics and business intelligence needs.

Data Analytics Official Blog

Google Cloud named a Leader in the Forrester Wave: Data Management for Analytics - Google is a Leader in the Forrester Wave: Data Management for Analytics, the first time this category has existed. See why cloud data analytics at Google won praise.

Official Blog Windows

Running workloads on dedicated hardware just got better - Improving Compute Engine sole-tenant nodes for dedicated hardware

Data Analytics GCP Certification Official Blog

Now updated: Our Data Engineering Learning Path - To address the evolving skill set today’s data engineers need, we updated our Data Engineering on Google Cloud Platform learning path.

Data Analytics Google Cloud Dataflow Official Blog

Bring 20/20 vision to your pipelines with enhanced monitoring - New observability features in cloud batch and stream data processing let Google Cloud users identify pipeline problems faster.

Official Blog Windows

Easily upgrade Windows Server 2008 R2 while migrating to Google Cloud - Migrate for Compute Engine automatically upgrades Windows Server 2008 R2 to 2012.

Google Cloud Platform Official Blog

Working with Hedera Hashgraph to support the next generation of distributed ledger technology - Hedera Hashgraph is expanding its work with Google Cloud to make DLT even more readily available for its community members.

 

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

Official Blog

Exploring Container Security: Run what you trust; isolate what you don’t - Help lock down your containers with these Kubernetes Engine features and guidance

AWS Kubernetes

Anatomy of a production Kubernetes cluster - At Brandwatch we’ve been running Kubernetes in production since October 2016. This is an overview of our basic cluster specification.

Config Connector Kubernetes

Google Config Connector: Deploying Spanner from Kubernetes - A dive into Google’s Config Connector for Kubernetes. Deploy GCP Services with Kubernetes YAML definitions.

Google Compute Engine Kubernetes Terraform

Building a Rancher cluster on Google Cloud with Terraform - Setting up Rancher 2.x Kubernetes cluster on Google Compute Engine with Terraform.

Anthos

With Google Anthos, My Other Cloud Is Whatever I Want - Perspective on Anthos.

App Development, Serverless, Databases, DevOps

Official Blog Stackdriver

Logging + Trace: love at first insight - Stackdriver’s Trace and Logging are a match made in heaven for troubleshooting logs and seeing how your code functions and its context.

Official Blog

Low code programming with Node-RED comes to GCP - Learn how to wire together Google Cloud services with Node-RED visual programming.

Cloud Composer Serverless

Running workflows at Freetrade, serverless! - Facing and resolving problems on Cloud Composer.

NET

An app modernization story — Part 3 (Containerize & Redeploy) - Transforming Windows-only .NET Framework app to a containerized multi-platform .NET Core app.

Google Cloud Storage

One weird trick to predict retrieval costs in Google Cloud Storage - Explaining billing costs on Cloud Storage operations.

API Cloud Endpoints Serverless

Rate limit your API usage with Cloud Endpoints quotas - Rate limit helps to protect your API usage and protect your billing. But how to set up these quotas in an easy and serverless way?

DevOps Google Compute Engine

Google Cloud’s Best Hidden Feature - How to convert Web UI action to the equivalent REST call or CLI command.

Google Cloud Functions Serverless

A guide to running Serverless framework on Google Cloud Platform - Using Serverless framework on Google Cloud.

GCP Experience Google Cloud Bigtable

Migrating our cloud infrastructure to Google Cloud (Part 1/4) - Migrating from HBase to Cloud Bigtable.

Big Data, Analytics, ML&AI

Data Analytics Official Blog

Taking a practical approach to BigQuery slot usage analysis - See how to understand slots in BigQuery, Google Cloud’s enterprise data warehouse, to keep an eye on resource usage.

BigQuery Data Analytics Official Blog

BigQuery under the hood: How zone assignments work - Get a look at the technical details of zone assignments in BigQuery, the cloud enterprise data warehouse.

BigQuery Python

Revisiting Google Search Console Data into Google BigQuery - Taking a fresh look at sending Google Search Console data into BigQuery, using Python, for free.

BigQuery Javascript

How to package a JavaScript library for use in BigQuery - The article explains how to package a JavaScript library for use in BigQuery UDF.

Machine Learning TensorFlow

Jupyter Notebook basic testing - Creating a new infrastructure pipeline for Jupyter notebooks.

Google Cloud Dataflow

Streaming Analytics — Data Processing Options on Google Cloud Platform - Streaming possibilities and scenarios on Google Cloud.

Data Science Machine Learning

All things GCP: Machine Learning Decision pyramid - Understand which Google Cloud tools matches best for you.

Google Cloud Dataflow IoT

How to create DataFlow IoT Pipeline on Google Cloud Platform - Creating ingestion pipeline for IoT.

BigQuery Python

Simplify BigQuery ETL jobs using SQLAlchemy - Using SQLAlchemy (Python's ORM library) for BigQuery.

BigQuery Google Cloud Dataflow Java

Change-data Capture (CDC) solution to capture data from an MySQL database, and sync it into BigQuery. - Syncing MySQL database to BigQuery via Cloud Dataflow.

Kubeflow Kubernetes Machine Learning Tutorial

How to carry out CI/CD in Machine Learning (“MLOps”) using Kubeflow ML pipelines (#3) - The article goes through process of setting up a cluster, notebook, and submitting pipelines.

Various

GCP Experience Official Blog

How Udacity students succeed with Google Cloud - Udacity uses a variety of Google Cloud tools to build its Workspaces.

Slides, Videos, Audio

Kubernetes Podcast - #90 CockroachDB, with Peter Mattis

 

Releases

AppEngine - App Engine is changing the URLs that you use to send requests to your apps. To ensure a smooth transition, we are slowly updating App Engine to use region IDs.

BigQuery - INFORMATION_SCHEMA views for live and historical jobs metadata are now in beta. Updated versions of Magnitude Simba ODBC drivers are now available.

CDN - Cloud CDN custom origins support is available in Beta.

Cloud Composer - New versions of Cloud Composer images: composer-1.9.0-airflow-1.10.1, composer-1.9.0-airflow-1.10.2, composer-1.9.0-airflow-1.10.3 and composer-1.9.0-airflow-1.10.6. Airflow 1.10.6 is now available for Composer. Python 3 is now the default version for new Composer environments. For Airflow versions 1.10.3 and 1.10.6, the experimental REST API now correctly respects the store_serialized_dags setting, enabling the use of experimental APIs with VPC-SC.

Dataprep - Many new features and issues fixed. Check the URL for more details.

Datastore - You can now configure indexes with the REST API.

Cloud Functions - HTTP functions now require authentication by default.

IAM - The Cloud IAM recommender is now generally available.

Identity-Aware Proxy - API for OAuth clients now generally available You can now programmatically create OAuth clients in IAP via REST or gcloud.

Google Kubernetes Engine - Private clusters created on and after January 15, 2020 that use VPC peering reuse might experience an issue where VPC peering is removed after attempting to reschedule a cluster for deletion after the first attempt fails. GKE cluster versions have been updated as detailed in the following sections. The default version for new clusters is now 1.14.10-gke.17. Masters and nodes with auto-upgrade enabled will be upgraded: Rollouts are phased across multiple weeks, to ensure cluster and fleet stability. No channelv.1.13.x 1.13.12-gke.25 v.1.14.x 1.14.10-gke.17 v.1.15.x 1.15.9-gke.8 Stable channel 1.14.10-gke.17 Regular channel 1.15.7-gke.23 Rapid channel 1.16.4-gke.30. The following versions are no longer available for new clusters or upgrades. 1.13.11-gke.14. 1.13.11-gke.15. 1.13.11-gke.23 (moved to LEGACY version). 1.13.12-gke.8. 1.13.12-gke.13. 1.13.12-gke.14. 1.13.12-gke.16. 1.13.12-gke.17. Surge upgrades are generally available.

Google Kubernetes Engine Rapid - 1.16.4-gke.30 is now available in the Rapid release channel.

Google Kubernetes Engine Stable - v1.14.10-gke.17 is the default for new Stable channel clusters.

Load Balancing - Network endpoint groups (NEGs) now support global, internet endpoints that let you create custom origins for Cloud CDN and deliver content over Google's high performance, distributed edge caching infrastructure when the content is hosted on-premises or in another cloud.

AI Platform - You can now set a maximum running time when you create a training job. The known issue with using custom prediction routines together with runtime version 1.15 and Python 3.7 has been fixed.

Security Command Center - Security Command Center roles inherit Web Security Scanner roles as follows: The securitycenter.adminViewer role inherits the permissions of the cloudsecurityscanner.viewer role. The notifications API is now in beta: Send new findings and updated findings notifications to a Pub/Sub topic. Security Command Center tools will become obsolete in future Security Command Center releases, when their functionalities are added as built-in features.

Stackdriver - You can now send notifications from your alerting policies to Cloud Pub/Sub topics. The Stackdriver Monitoring Dashboard API is now Generally Available. Stackdriver Monitoring agent version 6.0.0 is now available for the CentOS 8 distribution.

 

Latest Issues




Contact

Zdenko Hrček
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: zdenko@gcpweekly.com