Tag: Big Data

Big Data Docker Tutorial April 15, 2019

Deploy Spark on Google Cloud, (Docker+Swarm) - Deploying Spark cluster on Google Cloud using Docker containers and with Docker-compose.

Big Data BigQuery Google Cloud Dataflow April 15, 2019

From data ingestion to insight prediction: Google Cloud smart analytics accelerates your business transformation - Cloud Next '19 news in more detail related to analytics products.

Big Data BigQuery GCP Experience April 1, 2019

Reflections On Designing An Enterprise Data Warehouse - Description of process for Data warehouse development on Google Cloud using BigQuery.

Big Data BigQuery Official Blog March 25, 2019

Analyzing 3024 rice genomes characterized by DeepVariant - Exploring Rice genome dataset using BigQuery.

Big Data Python March 11, 2019

Enlightened DataLab Notebooks - Starting with Data Science on GCP.

Big Data BigQuery Cloud Launcher R March 4, 2019

RStudio and BigQuery in under 30 minutes - Article describes steps to provision an RStudio instance on Google Compute Engine and use it to do complex analytics on BigQuery.

Big Data March 4, 2019

What is Google Snappy? High-speed data compression and decompression - Pros and cons of using Snappy (data compression library from Google) for compression.

Big Data BigQuery Cloud Composer GCP Experience March 4, 2019

How did we build a Data Warehouse in six months? - Sharing experience of creating data warehouse on Google Cloud Platform.

Apache Beam Big Data Google Cloud Dataflow Official Blog Feb. 25, 2019

Real-time diagnostics from nanopore DNA sequencers on Google Cloud - A scalable, reliable, and cost effective end-to-end pipeline for fast DNA sequence analysis built on Google Cloud and this new class of nanopore DNA sequencers.

Big Data Cloud Security Command Center Security Feb. 25, 2019

Google Cloud Platform Security Operations Center Data Lake - Some thoughts regarding security when building data lake on Google Cloud Platform.

Big Data Google Cloud Platform Official Blog Jan. 28, 2019

Google is named a leader in the 2019 Gartner Magic Quadrant for Data Management Solutions for Analytics - Gartner named Google a Leader in the 2019 Gartner Magic Quadrant for Data Management Solutions for Analytics (DMSA).

Big Data Google Compute Engine Jan. 7, 2019

Deploying PySpark ML Model on Google Compute Engine as a REST API - Step-by-step tutorial on Deploying PySpark ML Model on Google Compute Engine.

Big Data Nov. 26, 2018

How to capture and store tweets in Real Time with Apache Spark and Apache Kafka. Using cloud Platforms such as Databricks and GCP (Part 1) - Capture and store tweets in Real Time with Apache Spark and Apache Kafka.

Big Data Cloud Datalab Google Cloud Dataflow Python Serverless June 18, 2018

Analyzing Reddit’s Top Posts & Images With Google Cloud (Part 1) - Analyzing everything from Reddit.

Big Data Business May 21, 2018

Cask is joining Google Cloud - Cask is behind CDAP - open source big data integration platform.

Big Data Cloud Datalab Google Cloud Pub/Sub Google Cloud Storage May 21, 2018

Data Science for Startups: Data Pipelines - Example of creating data pipeline on Google Cloud Platform.

Apache Beam Big Data May 14, 2018

GCP Podcast - #126 Beam and Spark with Holden Karau

Big Data March 26, 2018

Public datasets: how nonprofits can drive social impact with planetary-scale data - Public datasets are freely hosted and accessible via Google BigQuery and Cloud Storage.

Big Data Business March 26, 2018

Room to Grow on the Big Data Maturity Curve - Report on Big Data ecosystems.

Big Data Business Official Blog March 19, 2018

Solutions : Build a Marketing Data Warehouse on Google Cloud Platform - Using fictional online cosmetics retailer as example of how to leverage Google Cloud Products to get key insights.

Big Data Official Blog March 5, 2018

How to handle mutating JSON schemas in a streaming pipeline, with Square Enix - Explore how Square Enix supports handling of mutating JSON schemas in a streaming pipeline.

Big Data Machine Learning TensorFlow Nov. 20, 2017

Automating ML and IoT with cloud-based image rendering, training, and device delivery - Architectural solutions for 3D rendering and machine learning.

Big Data Teradata Nov. 20, 2017

Transitioning from Data Warehousing in Teradata to GCP Big Data - Article describes how you can transition from on-premises and cloud data warehousing to Google Cloud Platform.

Big Data Sept. 11, 2017

Plumbing Big Data Pipelines - Qubit (provides personalization for companies when communicating with customers) describe their experience different Google Cloud Platform products

Big Data Google Cloud Dataproc Aug. 20, 2017

Easier integration with Apache Spark and Hadoop via Google Cloud Dataproc Job IDs and Labels - Best practices to use Job IDs and labels

Big Data Machine Learning July 31, 2017

New hands-on labs for scientific data processing on Google Cloud Platform - 7 new labs to try out Google Cloud Platform Big Data and Machine Learning products to solve real-world scientific problems using a variety of public datasets.

Big Data July 24, 2017

Moving Thumbtack’s data infrastructure to Google Cloud Platform - Moving data from PostgreSQL and MongoDB to Google Cloud Dataproc and BigQuery

Big Data Google Cloud Bigtable July 3, 2017

How Qubit deduplicates streaming data at scale with Google Cloud Platform - How Qubit solved issue regarding duplicated streaming data using Google Cloud Platform products

Big Data July 3, 2017

GCP Podcast - #83 Public Datasets with Mike Hamberg and Will Curran

Big Data Google Cloud Dataflow July 3, 2017

Introducing Cloud Dataflow Shuffle: For up to 5x performance improvement in data analytic pipelines

Big Data BigQuery June 26, 2017

The Google Data WareCity - Interesting and unique aspects of BigQuery’s data sharing capability

Big Data BigQuery June 26, 2017

GCE BigQuery vs AWS Redshift vs AWS Athena - Basic comparison on data loading and simple queries between Google BigQuery and Amazon Redshift and its cousin Athena.

Big Data Google Cloud Dataflow June 19, 2017

Visualization and large-scale processing of historical weather radar (NEXRAD Level II) data - Processing historical weather data for visualization with Cloud Dataflow

Big Data Business May 8, 2017

That giant sucking sound? Hadoop moving into the cloud - Companies are starting to move their Hadoop environments to Google Cloud Platform because of simplicity, stability, maturity

Big Data BigQuery April 10, 2017

BI Performance Benchmarks with Google BigQuery

Big Data Google Cloud Dataflow March 27, 2017

Google Cloud Dataflow In the Smart Home Data Pipeline - Handling data from Nest devices via Google Cloud Dataflow

Big Data March 13, 2017

Visualizing Big Data with Google Cloud

Big Data BigQuery PubSub March 6, 2017

Combining Thomson Reuters data with Google BigQuery and Google Cloud Pub/Sub API - Proof of concept to analyze data with BigQuery ingested from Reuters API

Big Data March 6, 2017

Data Science on the Google Cloud Platform: the first book - Interview with Valliappa Lakshmanan author of upcoming book Data Science on Google Cloud Platform

Big Data

Building a Data Lake on GCP with CDAP - First look on Google-acquired Cask’s open source platform.


Latest Issues


Zdenko Hrček
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: zdenko@gcpweekly.com