Tag: BigQuery

Big Data BigQuery Sept. 28, 2020

Using BigQuery to Track and Estimate Home Heating Oil Deliveries - Google Sheets, Big Query, and Public Data Sets to calculate Degree Days and K-Factor.

BigQuery Billing Cloud Monitoring Sept. 28, 2020

How to move from on-demand pricing to reservations in BigQuery - Translating the slot usage graph into workload management.

BigQuery Sept. 28, 2020

Pushing the Last Frontier of Data Analysis Democratization With BigQuery Data QnA - Using Data QnA (at the moment in private alpha) to query data in BigQuery.

BigQuery Cloud Functions Sept. 28, 2020

Dynamic Partition Filtering on BigQuery Using Cloud Functions - Using table partition in BigQuery to limit data usage in queries.

Beginner BigQuery Sept. 28, 2020

BigQuery Explained: Querying your Data - This post dives into querying data with BigQuery, lifecycle of a SQL query, standard & materialized views, saving and sharing queries.

BigQuery Tutorial Sept. 28, 2020

How to select data from columns contain a substring from BigQuery - How to deal with the requests that ask for data from columns that contain a user-defined substring in the column name from BigQuery.

BigQuery Billing GCP Experience Sept. 28, 2020

Managing Costs Efficiently With BigQuery - Handling the growth of data and users in BigQuery.

BigQuery Billing Sept. 28, 2020

Monitoring your BigQuery costs and reports usage with Data Studio - Simple and effective dashboard. With actual report names, users and labels. Handy template included.

BigQuery Data Analytics Official Blog Sept. 21, 2020

Data warehouse migration tips: preparation and discovery - In this post, we’ll explore a few important questions that come up during the initial preparation and discovery phase for data warehouse migration.

BigQuery Data Science GIS Sept. 21, 2020

A beginner’s Guide to Google’s BigQuery GIS - Get started free with Google Big Query GIS with this step by step tutorial.

BigQuery Sept. 21, 2020

BigQuery Explained: Data Ingestion - Know your options to load data into BigQuery. This post dives into batch ingestion and introduce streaming, data transfer service and more.

BigQuery Jupyter Notebook Public Datasets Python Sept. 21, 2020

Python Bar Chart Race Animation: COVID-19 Cases - Analyzing and visualizing the COVID-19 public dataset.

BigQuery Sept. 21, 2020

Analyze BigQuery Query performance with Query Visualiser - Visualize Query execution flow to identify bottlenecks.

BigQuery Sept. 21, 2020

BigQuery UPSERT with EXECUTE IMMEDIATE - Using dynamic UPDATE or INSERT queries in BigQuery.

BigQuery Cloud Run Data Analytics gRPC Serverless Sept. 21, 2020

Serverless Log Data Ingestion Pipelines - Manage your data, not infrastructure & I like protobuf for real-time analytics!

BigQuery Sept. 14, 2020

BigQuery Explained: Storage Overview - This post dives into BigQuery storage organization and format, how to partition and cluster data to optimize performance and costs.

BigQuery Cloud Dataprep Sept. 14, 2020

Publish Cloud Dataprep Profile Results to BigQuery - This article describes how to use webhooks and Cloud Functions to automatically publish Dataprep-generated profile information into BigQuery.

BigQuery Sept. 14, 2020

Use Google Sheets as a ‘Data Creek’ for your Data Lake - How to use Google Sheets for your Data Integration to BigQuery.

BigQuery Public Datasets Sept. 14, 2020

Finding the Closest Weather Stations — BigQuery Public Datasets - Use BigQuery Public Datasets, Geography Functions, and ARRAY_AGG & UNNEST to locate and query local historical weather data near any address.

BigQuery Sept. 14, 2020

BigQuery: Populating a development environment with hashed data - Using BigQuery’s hashing functions to create test data for use in development/testing process.

BigQuery Data Analytics Sept. 14, 2020

Cool things you can do using window functions in BigQuery - Using windowing functions in BigQuery.

API Big Data BigQuery Machine Learning Sept. 7, 2020

How we enabled product and pricing-availability feeds as APIs for external partners - This post demonstrates how to package your training application when it needs to connect to an external (On-Prem / Multi-Cloud) database to fetch the required source dataset.

BigQuery Sept. 7, 2020

BigQuery Explained: An Overview - How BigQuery solves problems with traditional data warehouses? Dive into BigQuery architecture and quickly get started with BigQuery.

BigQuery Cloud Dataflow Data Analytics Networking Serverless VPC Service Controls Sept. 7, 2020

Designing Secure Data Pipelines with VPC Service Controls - This blog post describes an example of how to build a Data Platform using Cloud Functions, Dataflow, Google Cloud Storage, and Bigquery with VPC Service Controls.

BigQuery Cloud SQL Cloud Storage Sept. 7, 2020

How to integrate external data sources with BigQuery - A guided approach to connect federated data sources in BigQuery.

BigQuery GIS Public Datasets Aug. 31, 2020

Enable business data with BigQuery for geospatial analysis and map visualization - Demonstrating BigQuery GIS capabilities.

BigQuery Cloud Dataprep Javascript Aug. 31, 2020

How to extend Cloud Dataprep by using BigQuery Javascript UDFs - This article will explain how you can combine Cloud Dataprep with BigQuery Javascript UDFs to extend the scope of data preparation work that you can accomplish natively in Cloud Dataprep.

BigQuery Security VPC Aug. 31, 2020

Setting up network access control for BigQuery - Setting network access control for BigQuery.

BigQuery Python Aug. 31, 2020

Getting Started With Python Google BigQuery. - Introduction to BigQuery with Python.

BigQuery Cloud Dataproc Data Studio Jupyter Notebook Python Aug. 31, 2020

How to Set up a COVID-19 Workflow and Dashboard Using the Google Cloud Platform - Building a data pipeline to process and visualize data regarding COVID-19.

BigQuery Cloud Dataprep Java Aug. 31, 2020

Migrate Oracle Data to BigQuery using Dataproc and Sqoop - Migrating data from Oracle to BigQuery via Cloud Dataproc.

Big Data BigQuery Data Science Aug. 31, 2020

Google Cloud for Genomics - Building a scalable, reproducible, and secure data processing pipeline on the cloud.

BigQuery Data Studio Aug. 24, 2020

How to process and visualize financial data on Google Cloud with Big Query & Data Studio - A tutorial for GCP practitioners starting out with financial data.

BigQuery Firebase Aug. 24, 2020

FireAudit: How it allowed us using Firebase in mission-critical software - FireAudit is a cloud solution adding some missing functionalities of the Firebase.

BigQuery Aug. 24, 2020

Surrogate Keys in Google BigQuery - Different ways to create IDs in BigQuery.

BigQuery Cloud Functions Cloud Storage Aug. 24, 2020

Google Cloud Function Beyond the Limits - Uploading big files from Cloud Storage into BigQuery with Cloud Functions.

BigQuery Machine Learning Aug. 24, 2020

How to do text similarity search and document clustering in BigQuery - Use Document embeddings in BigQuery for document similarity and clustering tasks.

BigQuery Data Analytics Official Blog Aug. 17, 2020

BigQuery now offers industry-leading uptime SLA of 99.99% - Cloud data warehouse BigQuery now offers a service-level agreement (SLA) of 99.99% from its previous 99.9%. Four nines of availability helps ensure business continuity.

BigQuery Data Analytics Official Blog Aug. 17, 2020

Better BigQuery pricing flexibility with 100 slots - Cloud data warehouse BigQuery offers flat-rate pricing, which you can now use with a minimum of 100 slots.

AWS BigQuery Aug. 17, 2020

Slash Google BigQuery Costs with Actionable Recommendations - BigQuery FinOps Dashboard is your Swiss army knife for highlighting inefficiencies in your Google BigQuery usage.

Big Data BigQuery Data Studio Firebase Aug. 17, 2020

I stopped using Firebase Dashboards. I’ve built my own instead. - Displaying Firebase Crashlytics and Performance data in Data Studio.

BigQuery Python Aug. 17, 2020

Introducing BQconvert — BigQuery Schema Converter Tool - BQconvert is a Python opensource tool that helps you to convert any database’s schema into BigQuery compatible schema.

Apache Beam BigQuery Cloud Dataflow Aug. 17, 2020

ETL with Apache Beam — Load Data from API to BigQuery - Reducing time to get data from API to BigQuery using Cloud Dataflow.

BigQuery Data Analytics GCP Experience Official Blog Aug. 17, 2020

Accelerating Mayo Clinic’s data platform with BigQuery and Variant Transforms - See how Mayo Clinic uses Google Cloud to work with genomic variant data for research purposes. Cloud data warehouse BigQuery lets them save on costs and time.

BigQuery Data Analytics Official Blog Aug. 17, 2020

How fleet management gets easier with smart analytics on Google Cloud - Check out this data analytics demo on how to use sensor data to make real-time decisions for a fleet management environment using BigQuery and more.

BigQuery Data Analytics Official Blog Aug. 17, 2020

6 tips for database pros to adapt to cloud data warehouses - Cloud data warehouses bring flexibility and scale, but affect people as well as technology. Here’s how DBAs can adapt and use modern data warehouses.

BigQuery Cloud Dataflow Data Analytics Data Loss Prevention API Machine Learning Official Blog Aug. 17, 2020

Anomaly detection using streaming analytics & AI - How to build a secure, real-time anomaly detection solution using Dataflow, BigQuery ML and Cloud DLP.

BigQuery GCP Experience Aug. 17, 2020

A tale of two data warehouses — NewsUK’s data platform migration to Google Cloud (Part 1) - NewsUK’s data platform migration to BigQuery.

BigQuery Billing Cloud Monitoring Java Aug. 17, 2020

Big Data in Google Cloud — Cost Monitoring (part III) - Implementing cost monitoring system for BigQuery.

Big Data BigQuery Infrastructure Terraform Aug. 17, 2020

Data lake on GCP using Terraform - Using Terraform to set up infrastructure-as-code for a Data Lake on Google Cloud Platform.

BigQuery Billing Aug. 10, 2020

Demystifying BigQuery reservations - Learn ho to mix flat-rate and on-demand pricing.

BigQuery Aug. 10, 2020

5 reasons why BigQuery users should use dbt - Highlighting useful functions of dbt tool.

Big Data BigQuery Billing Aug. 10, 2020

Big Data in Google Cloud — Cost Monitoring (part II) - The article explains how to analyze Billing data in BigQuery in order to get insights about most expensive queries etc.

BigQuery Machine Learning Public Datasets Aug. 10, 2020

Part II: Analyze Antigen Epitope Data with BigQuery and Build ML Model - Analyzing Immune Epitope Database with BigQuery.

BigQuery Machine Learning TensorFlow Aug. 10, 2020

TensorFlow model on BigQuery ML - In this blog you learn how you can deploy a trained TensorFlow model on BigQuery so you can make predictions right from your data warehouse.

BigQuery Data Science Aug. 10, 2020

Yet another way to generate fake datasets in BigQuery - Wrapping faker.js with a Javascript UDF.

BigQuery Data Catalog Aug. 10, 2020

Managing Fine-Grained Data Access Control in BigQuery - Column-level security to restrict unauthorized access to sensitive data in BigQuery.

BigQuery Machine Learning Official Blog Public Datasets Aug. 10, 2020

Google Cloud AI and Harvard Global Health Institute Collaborate on new COVID-19 forecasting model - To help first responders be better prepared for what lies ahead, Google Cloud is releasing the COVID-19 Public Forecasts.

BigQuery July 27, 2020

Synchronize Google Sheets with BigQuery Tables - Keep your spreadsheets synchronized with BigQuery using Sheet and Apps Script templates.

Anthos AWS Azure BigQuery Business July 27, 2020

Why BigQuery Omni is a Big Deal - Google Cloud’s bet on an open platform is starting to materialize with Anthos and BigQuery Omni.

BigQuery Data Science Public Datasets July 27, 2020

Data Science 101 for Startups- Aggregation in SQL — Part 2 - Using aggregation SQL functions on BigQuery public dataset.

BigQuery July 27, 2020

BigQuery HMAC-SHA256 User-defined Function - Google Cloud BigQuery User-defined function to perform HMAC with SHA256.

BigQuery July 27, 2020

ETL Google Spreadsheet Using Pandas To BigQuery - Creating the ETL process on a google spreadsheet and store it into BigQuery.

BigQuery July 27, 2020

BigQuery: the unlikely birth of a cloud juggernaut - Story about how 10 engineers transformed cloud data analytics.

BigQuery July 27, 2020

Episode 14: Digital Native Podcast - Jordan Tigani, Director of Product Mgmt for Google BigQuery

BigQuery Data Science Python July 20, 2020

BigQuery + Python for Production Data Science - Accessing BigQuery using Pandas, PySpark, and OS/Python.

BigQuery Data Science Public Datasets July 20, 2020

Data Science 101 for Startups- Aggregation in SQL - Aggregations concepts on examples from BigQuery.

Airflow BigQuery July 20, 2020

Airflow DAG Performance and Reliability - Set up measures to ensure that data made available to the business users is always reliable when they want it.

AWS BigQuery Data Analytics Official Blog July 20, 2020

Bringing multi-cloud analytics to your data with BigQuery Omni - BigQuery Omni, powered by Anthos, lets you analyze data in Google Cloud, as well as AWS and Azure (coming soon). It’s multi-cloud data analytics for the modern age.

BigQuery Data Analytics Official Blog Teradata July 20, 2020

Use IAM custom roles to manage access to your BigQuery data warehouse - When you’re migrating your data warehouse from Teradata to BigQuery, pay attention to mapping user permissions using identity and access management tools.

BigQuery Machine Learning July 20, 2020

How to build a recommendation system on e-commerce data using BigQuery ML - Creating a recommendation system with BigQuery ML.

BigQuery July 13, 2020

Breaking up very large BigQuery jobs - Using integer range partitions with BigQuery scripting when joining large number of rows.

BigQuery Data Science Machine Learning Public Datasets July 13, 2020

Stack Overflow in 2023: Predicting with ARIMA and BigQuery - Predicting the top Stack Overflow tags with ARIMA model in BigQuery.

BigQuery July 13, 2020

Loops in BigQuery - Learn how to use BigQuery scripting to calculate Fibonacci numbers.

BigQuery July 13, 2020

Trying out Data QnA on BigQuery and Google Sheets - Examples of BigQuery natural language queries get translated into SQL.

BigQuery July 13, 2020

Connecting to the Google Public Covid-19 Datasets with BigQuery and DBeaver - How to use the Google BigQuery Public DataSet with BigQuery and Connecting it to DBeaver.

BigQuery Data Studio Public Datasets Tutorial July 13, 2020

Creating a Covid-19 Dashboard with Google Open Dataset, BigQuery and DataStudio - A tutorial on how to create a dashboard in Data Studio for COVID-19 stats based on BigQuery public datasets.

Apache Beam Beginner BigQuery Cloud Dataflow Python July 13, 2020

Apache Beam Pipeline for Cleaning Batch Data Using Cloud Dataflow and BigQuery - An overview of basic Beam concepts with an example of a simple pipeline.

BigQuery Official Blog July 13, 2020

Ask questions to BigQuery and get instant answers through Data QnA - Data QnA, now in alpha availability, lets anyone ask questions of BigQuery data to get answers faster.

BigQuery Data Analytics Official Blog July 13, 2020

Enhancing multi-cloud data governance on Google Cloud - Good data governance practices are essential for cloud computing. See how Google Cloud’s BigQuery and Collibra work for multi-cloud data governance.

BigQuery July 6, 2020

Computing Session for Event Data Using Google BigQuery - Explanation and examples on how to calculate sessions in BigQuery.

BigQuery Data Science July 6, 2020

Get started with BigQuery and dbt, the easy way - Find here the quickest way to get started with dbt and BigQuery using only free offerings from Google Cloud.

Big Data BigQuery Cloud Dataflow July 6, 2020

Kafka to BigQuery using Dataflow - In this article, two different methods to connect Kafka to BigQuery using Dataflow are evaluated.

BigQuery Machine Learning July 6, 2020

Predicting Air Pollution with Prophet on GCP - Using EPA’s public data for time series forecasting.

BigQuery Cloud Run Cloud Scheduler July 6, 2020

Scheduled serverless dbt + BigQuery service - Using Cloud Run to execute periodically dbt commands.

BigQuery GCP Experience July 6, 2020

How Servian helped REA Group repatriate 500TB of BigQuery data - Description of migrating BigQuery data from one region to another.

BigQuery Billing Public Datasets July 6, 2020

BigQuery Cost and Performance Optimization - Demonstrating on BigQuery public dataset on how to reduce query price.

AWS BigQuery July 6, 2020

BigQuery Omni: Distributed Query Engine Comes To Google Cloud - BigQuery’s distributed query engine extends support for multi-cloud data lakes.

BigQuery Cloud Functions Data Science Python July 6, 2020

Part 2: Building a Simple ETL Pipeline with Python and Google Cloud Functions — MySQL to BigQuery - Extracting data from a MySQL database and loading into Google BigQuery using Google Cloud Functions.

BigQuery Data Science Machine Learning July 6, 2020

Visualizing Pitcher Clusters: A Next OnAir Digital Experience - Analyzing baseball pitchers.

Apache Beam BigQuery Cloud Dataflow July 3, 2020

How to load XML data into BigQuery using Python Dataflow - Parse the XML into a Python dictionary and use Apache Beam’s BigQueryIO.

BigQuery Data Science July 3, 2020

How to handle Google Analytics data in BigQuery - The ways & tricks to tackle Shaded Tables and ARRAYs in BigQuery tables.

BigQuery Cloud Dataflow Cloud Datastore Python July 3, 2020

The Python implementation of Dataflow to transfer Datastore entities to BigQuery - Transferring entities of Google Cloud Datastore into BigQuery in bulk with Dataflow implemented in Python.

BigQuery Python July 3, 2020

Load files faster into BigQuery - Benchmarking CSV, GZIP, AVRO and PARQUET file types for ingestion.

BigQuery Official Blog July 3, 2020

Analyzing petabytes of data just got easier, with Google Sheets - Announcing the general availability of Connected Sheets, which provides the power and scale of BigQuery in the familiar context of Sheets.

BigQuery Data Science June 29, 2020

BigQuery: Creating Nested Data with SQL - Working with SQL on nested data in BigQuery can be very performant. But what if your data comes in flat tables like CSV’s?

BigQuery June 29, 2020

BigQuery Streaming API with Postman - How to create and execute BigQuery streaming requests from Postman.

BigQuery Firebase June 29, 2020

Firebase Event Analytics with Google BigQuery - An extensive guide to help you get started with app analytics.

BigQuery Firebase GCP Experience June 29, 2020

How we scaled our retail operations with cloud and app platforms during the lockdown - Using GCP products for retail and hospitality business.

BigQuery Data Science June 29, 2020

Easy pivot() in BigQuery, finally - Using dynamic SQL and stored procedures to pivot in BigQuery.

BigQuery Data Science June 29, 2020

Custom cohort size using Range Bucket in SQL. - Using RANGE_BUCKET command in BigQuery.

BigQuery Cloud AutoML Machine Learning Official Blog June 29, 2020

Predict workload failures before they happen with AutoML Tables - How to predict whether HPC workloads will succeed or fail with the help of AutoML.

BigQuery Dialogflow June 29, 2020

How many COVID-19 cases near me? A chatbot solution to scale the one of the most asked questions. - Dialogflow application which is using public BigQuery dataset to provide info about COVID-19 based on postal code.

Apache Beam BigQuery Java June 22, 2020

Reading NUMERIC fields with BigQueryIO in Apache Beam - Handling conversion of NUMERIC type from BigQuery in the Beam Java pipeline.

BigQuery June 22, 2020

How to Copy Data Inside BigQuery - An overview of different possibilities to copy data in BigQuery.

BigQuery GIS Public Datasets June 22, 2020

Creating an Enhanced NYT COVID-19 Data Set - Adding Demographic, Electoral, and Mobility Information in BigQuery.

BigQuery Cloud AutoML Machine Learning June 22, 2020

The best of both worlds: Calling Auto ML from BigQuery - Preprocess in SQL, then build a sophisticated model using Auto ML Tables.

BigQuery Cloud Dataproc June 22, 2020

Graph data analysis with Cypher and Spark SQL on Cloud Dataproc - How to read in BigQuery data and use Spark SQL and the Morpheus library to carry out graph data analysis.

BigQuery June 15, 2020

BigQuery Dataset Metadata Queries - Queries you can use to pull metadata on BigQuery datasets and tables.

AWS BigQuery June 15, 2020

How we migrated our data warehouse from Redshift to BigQuery - Process of migrating data from AWS Redshift to BigQuery.

BigQuery Data Science Public Datasets June 15, 2020

Intro to BigQuery and its Free Data Sets - A quick introduction on how to access and query Google’s BigQuery using their free public datasets.

Big Data BigQuery GCP Experience June 15, 2020

DNC Tech Choices: Why we chose BigQuery - Thoughts about migrating to BigQuery.

BigQuery June 15, 2020

BigQuery Fun Facts! - A list of BigQuery facts and properties.

BigQuery Data Analytics Official Blog June 15, 2020

Introducing table-level access controls in BigQuery - Check out table-level access controls (ACLs) in cloud data warehouse BigQuery to share data more easily and help meet compliance.

BigQuery Data Science June 8, 2020

Zero to Differential Privacy in 5 minutes on Google BigQuery - Differential Privacy presents a framework for asking statistical questions about a dataset while provably maintaining the privacy of the entities within that dataset.

BigQuery Javascript June 8, 2020

Fibonacci series with user-defined functions in BigQuery - BigQuery can do user-defined functions written in JavaScript so let’s do some Fibonacci series!

BigQuery June 8, 2020

Loading and transforming data into BigQuery using dbt - A data engineering tool to build Data Lakes, Data Warehouses, Data Marts, and Business Intelligence semantic layers in BigQuery.

BigQuery June 8, 2020

How Rittman Analytics Centralizes SaaS Data Sources using dbt and Google BigQuery - Using dbt to model, transform and load data into BigQuery.

BigQuery June 8, 2020

Select partitioning and clustering keys for BigQuery tables when migrating from Netezza - When migrating a data warehouse to BigQuery one of the key parts is to select partitioning and clustering strategy for your tables.

BigQuery Data Loss Prevention API June 8, 2020

BigQuery, PII, and Cloud Data Loss Prevention (DLP): Take it to the next level with Data Catalog - A fully automated solution to discover sensitive data across all your Big Query assets, by using Data Loss Prevention and Data Catalog.

Airflow BigQuery June 1, 2020

Automated Reporting System Using Airflow - Configure scheduled reports in under 15 minutes.

Airflow Big Data BigQuery June 1, 2020

Data Pipelines at PasarPolis using Airflow and BigQuery - Use Airflow for data orchestration on BigQuery to maintain a data warehouse.

BigQuery Data Science June 1, 2020

The Best Way to Generate Indices in BigQuery - Using GENERATE_ARRAY for Histograms and More.

BigQuery Billing Data Analytics Official Blog June 1, 2020

Effectively using BigQuery Reservations - Cloud data warehouse BigQuery Reservations is a platform for cost and workload management.

BigQuery Billing Data Analytics Official Blog June 1, 2020

Optimize BigQuery costs with Flex Slots - Try Flex Slots in cloud data warehouse BigQuery to save costs when running jobs or workloads such as querying large tables.

BigQuery Billing Data Analytics Official Blog June 1, 2020

Choosing between BigQuery on-demand and flat rate pricing - Tips on using your BigQuery cloud data warehouse efficiently and saving costs with both on-demand and flat-rate pricing models.

BigQuery Cloud Dataflow Cloud Pub/Sub June 1, 2020

How to deploy Dataflow pipelines using SQL - Combining the new Dataflow SQL with the power of Google BigQuery.

BigQuery May 25, 2020

ODBC Driver for Google BigQuery — A New Connectivity Solution from Devart - Devart has announced the release of a new connectivity solution, ODBC Driver for Google BigQuery, which allows access to Google BigQuery.

BigQuery May 25, 2020

How to use Dynamic SQL in BigQuery - Format a string, and use EXECUTE IMMEDIATE.

BigQuery Cloud SQL GIS May 25, 2020

Call PostgreSQL from BigQuery for extra GIS powers - Combining PostgreSQL and BigQuery queries to validate GIS data.

Big Data BigQuery Cloud Dataproc Jupyter Notebook May 25, 2020

Apache Spark BigQuery Connector — Optimization tips & example Jupyter Notebooks - Learn how to use the BigQuery Storage API with Apache Spark on Cloud Dataproc.

Airflow BigQuery Python May 25, 2020

Airflow with Twitter Scraper, Google Cloud Storage, Big Query — tweets relating to Covid19 - Part Two of a Four-part Data Engineering Pipeline.

BigQuery Official Blog May 25, 2020

Celebrating a decade of data: BigQuery turns 10 - BigQuery, Google Cloud’s data analytics platform, turns 10 in 2020. Here’s a look back on big data trends in the past decade.

BigQuery May 18, 2020

Sync Oracle to BigQuery With Golden Gate BigQuery Adapter - In this article, we are going to see how to sync oracle data to BigQuery with the golden gate bigquery adapter with the initial load.

BigQuery CI Cloud Build May 18, 2020

CI/CD your BigQuery infrastructure with Google Cloud Build - Using Cloud Build for BigQuery CI/CD.

Big Data BigQuery Cloud Dataproc May 18, 2020

Import SQL Server data in BigQuery - A list of four approaches for a one-off data dumps from a RDBMS like SQL Server to BigQuery.

BigQuery Machine Learning May 18, 2020

Using BigQuery Flex Slots to run machine learning workloads more efficiently - Create Flex Slots, run query, then delete the flex slots.

BigQuery Data Studio May 18, 2020

Guidelines for cost optimisation of chargeable Data Studio dashboards using BigQuery - Few approaches on how to optimize costs when using data from BigQuery in Data Studio.

Apache Beam BigQuery Cloud Dataflow Cloud KMS Cloud Pub/Sub May 18, 2020

Streaming analytics on Google Cloud for regulated industries. - This blog demonstrates how a streaming analytics pipeline on Google Cloud using PubSub, Apache Beam (on Dataflow runner), Cloud Storage, and BigQuery can be executed in a single region and protected end to end using Customer-Managed Encryption key (CMEK).

BigQuery Cloud Dataprep GIS May 11, 2020

Road risk analysis with Google Cloud serverless tools - Road risk analysis of recorded vehicles speed and overspeed levels correlation in Google Cloud.

BigQuery Data Catalog May 11, 2020

Where is my data? The answer is Google Data Catalog - All you want to know about GCP Data Catalog.

BigQuery Dataflow May 11, 2020

Architecting Industrial IOT asset management & tracking solution - Architecture for a real-time asset tracking.

BigQuery Data Analytics Official Blog May 11, 2020

Automating BigQuery exports to an email - Set up automated emails to export data from cloud data warehouse BigQuery, especially for regular queries or reports.

BigQuery Jupyter Notebook May 11, 2020

Apache Spark BigQuery Connector — Optimization tips & example Jupyter Notebooks - Reading data from BigQuery using Apache Spark BigQuery connector.

BigQuery Data Analytics Data Studio Firebase Visualization May 11, 2020

How to make fast and convenient visualization in Data Studio based on BigQuery - Visualizing data in BigQuery from a Firebase app in Data Studio.

Apache Beam BigQuery Cloud Dataflow Cloud Natural Language API May 4, 2020

Calling Google Cloud Machine Learning APIs from Batch and Stream ETL pipelines - Making requests from a Beam pipeline to Cloud Natural Language API.

Beginner BigQuery Public Datasets May 4, 2020

Google Analytics in BigQuery 1: Getting Started - Intro to Google Analytics analysis using BigQuery and BigQuery public dataset.

BigQuery May 4, 2020

Send Google Analytics Hit Level Data to BigQuery - How to send standard Google Analytics hit level data to BigQuery.

BigQuery Data Analytics Official Blog May 4, 2020

What’s happening in BigQuery: Efficient new views and Cloud AI integrations - Cloud data warehouse BigQuery now offers materialized views for improved query efficiency, plus new ML models and column-level security.

BigQuery Cloud Bigtable Cloud Memorystore GCP Experience May 4, 2020

Using Google Cloud to Serve 10,000s of Personalized Recs Per Second - Improving recommendation product system for lower latency.

BigQuery May 4, 2020

Yet More Google Compute Cluster Trace Data - Dump of 29 days Borg (Google's cluster management system) traces in BigQuery.

BigQuery Data Science April 27, 2020

How to UNPIVOT multiple columns into tidy pairs with SQL and BigQuery - This post is for anyone dealing with time series in CSVs with one new column for each day.

BigQuery Cloud Dataflow April 27, 2020

Ingest Data from Google Cloud Dataflow to BigQuery — Without the Headaches (Part II) - Handling BigQuery schema changes in a Dataflow job.

BigQuery Machine Learning April 27, 2020

Training a recommendation model for Google Analytics data using BigQuery ML - This article demonstrates how to implement a WALS (matrix factorization) model to do collaborative filtering to recommend newspaper articles using BigQuery ML.

BigQuery Kubeflow Machine Learning April 27, 2020

Using BigQuery (and BigQuery ML) from Kubeflow Pipelines - Creating a Kubeflow pipeline which creates BigQuery ML model.

BigQuery Data Science Data Studio Visualization April 27, 2020

Empowering Apple Mobility Trends Reports with BigQuery and Data Studio - Analyzing Apple's mobility data using BigQuery and Data Studio.

BigQuery Python April 27, 2020

Optimize BigQuery costs with Flex Slots - Explanation of BigQuery Flex Slots and how to provision via Python library.

Beginner Big Data BigQuery April 27, 2020

Introduction to Arrays in BigQuery - Tutorial on working with arrays in BigQuery.

BigQuery Cloud Functions Python April 27, 2020

Building a Simple ETL Pipeline with Python and Google Cloud Platform - Extracting data from an FTP server using Google Cloud Functions.

BigQuery Cloud Dataproc Python April 27, 2020

Apache Spark & Google Cloud DataProc - The article goes through a process of setting Dataproc cluster and executing batch Spark job which stores results in BigQuery.

BigQuery GCP Experience April 20, 2020

Why we chose Google Cloud as the infrastructure platform for AgileData.io - Pick a few things that really matter, not thousands of “requirements”.

BigQuery Cloud Firestore Firebase April 20, 2020

Exporting data from Firebase (Firestore) to BigQuery - Two ways how to get data from Cloud Firestore to BigQuery.

BigQuery Cloud Composer Cloud Dataprep Machine Learning April 20, 2020

Automation of data wrangling and Machine Learning on Google Cloud - Using Cloud Dataprep, Cloud Composer and BigQuery ML.

BigQuery GIS April 20, 2020

How to find the interior centroid of US counties using BigQuery GIS - How to handle the problem of centroids being in the Great Lakes.

BigQuery April 20, 2020

BigQuery Materialized Views and Streaming Data - TL;DR: BigQuery materialized views and streaming data can be used together for building cost-effective near real-time dashboards.

BigQuery Cloud AutoML Cloud Data Fusion Official Blog April 20, 2020

From raw data to machine learning model, no coding required - How to build an entire ML pipeline, including data transformation and model training, without code.

BigQuery Data Loss Prevention API April 20, 2020

Redacting sensitive information from doctors’ patient notes - Implementing pipeline on GCP to process medical notes about patients affected by COVID-19 (from the public dataset on GCP from cases in Italy).

BigQuery Cloud SQL April 20, 2020

My cheat sheet for choosing the right database on GCP - Cheatsheet table with Database options on GCP.

BigQuery NoSQL April 13, 2020

Migrating Hive ACID tables to BigQuery - This blog post explores the impact the Hive transactional tables have on the migration process to BigQuery and identifies the steps to take to avoid them.

Big Data BigQuery April 13, 2020

BigQuery Materialized Views and Why You Should be Using Them - TL;DR BigQuery materialized views are great. You should use them!

BigQuery Cloud Dataflow Data Analytics Official Blog April 13, 2020

How do I move data from MySQL to BigQuery? - See how to perform MySQL data migration to cloud with this change data capture (CDC) example. This helps move data into cloud data warehouse BigQuery.

Big Data BigQuery Data Analytics Python April 13, 2020

Ibis: A Python Data Analysis Framework for Development and Production - An example of using Ibis (Python Data Analysis Productivity Framework) with BigQuery.

BigQuery April 13, 2020

BigQuery dbt: modern problems require modern solutions - The article explains how dbt tool can be used to easy BigQuery workflows, deployments etc.

BigQuery Data Analytics Visualization April 6, 2020

Building a Custom Jira Reporting Solution with BigQuery, Stitch & Tableau - Using BigQuery as a data lake for Jira data and a source for visualization.

BigQuery Data Studio Visualization April 6, 2020

3 Ways to add Annotations to Data Studio time series chart - Learn to add annotations by using either a calculated field, or a CSV, or reusing a Google Sheet for annotating across multiple reports.

BigQuery Data Analytics Official Blog April 6, 2020

Introducing BigQuery column-level security: new fine-grained access controls - Cloud data warehouse column-level security controls let you put policies on data classes for compliance reasons -- new in BigQuery.

BigQuery Data Analytics Official Blog Public Datasets April 6, 2020

COVID-19 public dataset program: Making data freely accessible for better public outcomes - Explore valuable data related to COVID-19 with free public datasets, available in Google Cloud’s BigQuery.

BigQuery April 6, 2020

Playing with Sharded tables in BigQuery - Doing a backup of sharded BigQuery tables.

BigQuery Data Studio GIS Machine Learning Public Datasets Visualization April 6, 2020

Analyzing COVID-19 with BigQuery - Exploring, visualizing and predicting COVID-19 data using BigQuery.

BigQuery Billing Cloud Logging Stackdriver April 6, 2020

Exporting BigQuery usage logs to… BigQuery - A brief article that describes how to setup Logs export to BigQuery and how to query BigQuery related data.

BigQuery April 6, 2020

Tutorial: Migrating from MySQL to BigQuery for Real-Time Data Analytics - Using Striim (continues real-time data integration solution) to replicate data from MySQL database to BigQuery.

BigQuery April 6, 2020

Arrays in BigQuery — How to improve query performance and optimise storage - Demonstrating advantages of using BigQuery arrays to harness the power of BigQuery for analytical use cases over traditional data models.

BigQuery Public Datasets April 6, 2020

Google Cloud Launches freely accessible COVID-19 Public Datasets program - An overview of COVID-19 BigQuery Public datasets.

BigQuery Data Analytics Machine Learning Official Blog April 6, 2020

Filling the NCAA void: Using BigQuery to simulate March Madness - Check out how to simulate college basketball brackets with BigQuery and BigQuery ML, using ML predictions, in a year where March Madness isn’t happening.

BigQuery Data Analytics Official Blog March 28, 2020

Loading geospatial data into BigQuery just got easier with FME - Load geospatial data into BigQuery using FME to load, transform, and ingest GIS file types for data analytics.

BigQuery Cloud Functions Data Analytics March 28, 2020

BigQuery + Cloud Functions: how to run your queries as soon as a new Google Analytics table is available - A step-by-step guide on how to make sure your tables, dashboards and data transfers are always up-to-date.

BigQuery March 28, 2020

How to copy a BigQuery dataset from one region to another - CLI command to set up BigQuery Transfer Service to copy dataset from one region to another.

BigQuery Data Analytics March 28, 2020

10 tips for self-service analytics with Google BigQuery and Tableau - Tips and tricks when visualizing data from BigQuery in Tableau.

BigQuery Public Datasets March 28, 2020

BigQuery Public Datasets: NYTimes COVID-19 dataset for USA

BigQuery Public Datasets March 28, 2020

BigQuery Public Datasets: JHU Coronavirus COVID-19 Global Cases

BigQuery Python March 23, 2020

How to backup a BigQuery table (or dataset) to Google Cloud Storage and restore from it - Python scripts to backup data or restore from BigQuery table to Cloud Storage in AVRO format.

BigQuery Javascript March 23, 2020

Advanced BigQuery queries with JavaScript and JSON - Some examples of how to parse JSON data in BigQuery.

Big Data BigQuery March 23, 2020

Using BigQuery Execution Plans to Improve Query Performance - Explanation of BigQuery's execution plan.

BigQuery March 23, 2020

Processing 10TB of Wikipedia Page Views — Part 2 - Query samples for Wikipedia dataset.

BigQuery March 23, 2020

How to Accurately Calculate Age in BigQuery - Queries to calculate age in BigQuery.

Beginner BigQuery March 23, 2020

BigQuery from the command line - Basic commands for BigQuery CLI.

Advanced BigQuery March 23, 2020

A Fast Approach to Building Pivot Table / Transpose Functionality into BigQuery - Overview of approaches to do pivoting/transposing table in BigQuery.

BigQuery Data Studio March 23, 2020

Visualizing COVID-19 data with BigQuery and Data Studio - Exploring data about coronavirus and visualizing in Data Studio.

BigQuery Data Analytics March 16, 2020

How to query and calculate GA App + Web event data in BigQuery - In-depth of new Firebase Google Analytics way of measurement and how to use raw data in BigQuery.

BigQuery Cloud Dataproc Data Science Jupyter Notebook March 16, 2020

Apache Spark and Jupyter Notebooks made easy with Dataproc component gateway - Make use of the new Dataproc optional components and component gateway features to easily use Jupyter Notebooks.

Big Data BigQuery Public Datasets March 16, 2020

Processing 10TB of Wikipedia Page Views - Part 1 - Processing and uploading Wikipedia page views into BigQuery.

BigQuery Cloud Functions Stackdriver March 16, 2020

Sending data from BigQuery to Intercom using Google Cloud Functions - Using Stackdriver triggering to send notifications when BigQuery table is updated.

BigQuery GIS March 16, 2020

Yet another GeoJson to Ndjson converter - You might have already seen many ways to convert GeoJson files to something BigQuery can understand. Let’s invent one more wheel!

BigQuery Data Science Public Datasets March 16, 2020

Data analysis with SQL and BigQuery on New york city bikes data. - Starting with New York biking open data analysis.

BigQuery Machine Learning March 16, 2020

Building an end to end Machine Learning Pipeline in Bigquery - Building a simple end to end BigQuery Machine Learning pipeline using open-source framework Dataform.

AWS BigQuery Data Analytics Official Blog March 16, 2020

Modern analytics made easy with new Redshift, S3 migration tools - Data warehouse migrations to Google Cloud’s BigQuery are now easier with new tools to move your Redshift and S3 workloads.

BigQuery Data Analytics Official Blog March 9, 2020

DML without limits, now in BigQuery - Cloud data warehouse BigQuery removes all quota limits to support unlimited DML statements and make working with BigQuery tables easier.

BigQuery Microsoft March 9, 2020

Microsoft SQL Server to Google BigQuery Migration. Converting the code ! - Using Roboquery tool to extract the schema of tables, views and SQL Queries from SQL Server and convert it into Bigquery.

BigQuery March 9, 2020

How dbt was used to convert from Google BigQuery Scheduled Queries - Using dbt (data build tool) with BigQuery.

BigQuery Data Analytics GCP Experience Official Blog March 9, 2020

Discord's migration from Redshift to BigQuery: lessons learned - Gaming app creator Discord moved from Amazon Redshift to Google Cloud BigQuery to eliminate downtime and scale faster.

Big Data BigQuery Cloud Dataflow March 9, 2020

Data ingestion Google Big Query without the headaches - Schema conversions on the fly without the headaches with Dataflow and BigQuery.

Big Data BigQuery GCP Experience Go March 9, 2020

Loading and transforming data to BigQuery at large scale - Using serverless data loading to BigQuery to reduce daily costs $8K to $15 per day.

BigQuery GIS March 9, 2020

How to query geographic raster data in BigQuery efficiently - Working with raster images for GIS data in BigQuery.

BigQuery March 2, 2020

Approximatish Separation of Storage and Compute in Data Warehouses - In-depth analysis of differences for BigQuery and other similar solutions when it comes to separation of storage and compute.

BigQuery Data Science March 2, 2020

What do party schools and energy efficiency have in common? - Using BigQuery to analyze public data on building energy use.

App Engine BigQuery March 2, 2020

App Engine under heavy load - Example of App Engine scaling.

BigQuery Data Analytics Official Blog March 2, 2020

BigQuery leads the way toward modern data analytics - BigQuery’s customer, partner, and analyst momentum is strong. The cloud data warehouse makes migration easy and brings data analytics to enterprises.

BigQuery Data Analytics Official Blog March 2, 2020

Introducing BigQuery Flex Slots for unparalleled flexibility and control - Cloud data warehouse BigQuery now offers Flex Slots, so you can buy analytics resources for short amounts of time to scale up and down quickly.

BigQuery Cloud Dataflow Data Loss Prevention API Machine Learning March 2, 2020

ML based Network Anomaly Detection solution to identify Cyber Security Threat - A reference implementation of an ML-based Network Anomaly Detection solution by using Pub/Sub, Dataflow, BigQuery ML & Cloud DLP.

BigQuery March 2, 2020

Coronavirus in Wikipedia by language — visualized - Analyzing Wikipedia pageviews for different languages to get deeper look into how the news spread and trended around the world.

BigQuery March 2, 2020

BigQuery Best Practices - Practical tips for query performance optimization and workflow automation in BigQuery.

BigQuery Data Science Data Studio Feb. 24, 2020

Reddit AmItheAsshole is nicer to women than to men — a SQL proof? - Analyzing Reddit posts with BigQuery and visualizing in Data Studio.

BigQuery Stackdriver Feb. 24, 2020

Bring us to red alert! - Stackdriver Alerting on policy changes to BigQuery Datasets

BigQuery Firebase Feb. 24, 2020

Firebase Retention Cohort Query on BigQuery - How to analyze the retention cohort of Firebase users in BigQuery.

BigQuery Feb. 24, 2020

BigQuery - BigQuery in a nutshell

BigQuery Feb. 24, 2020

BigQuery Cost Separation Across Business Units - The article describes how to use BigQuery in one organization but in different GCP projects.

BigQuery Data Analytics Official Blog Feb. 17, 2020

BigQuery under the hood: How zone assignments work - Get a look at the technical details of zone assignments in BigQuery, the cloud enterprise data warehouse.

BigQuery Python Feb. 17, 2020

Revisiting Google Search Console Data into Google BigQuery - Taking a fresh look at sending Google Search Console data into BigQuery, using Python, for free.

BigQuery Javascript Feb. 17, 2020

How to package a JavaScript library for use in BigQuery - The article explains how to package a JavaScript library for use in BigQuery UDF.

BigQuery Python Feb. 17, 2020

Simplify BigQuery ETL jobs using SQLAlchemy - Using SQLAlchemy (Python's ORM library) for BigQuery.

BigQuery Cloud Dataflow Java Feb. 17, 2020

Change-data Capture (CDC) solution to capture data from an MySQL database, and sync it into BigQuery. - Syncing MySQL database to BigQuery via Cloud Dataflow.

BigQuery Data Analytics Firebase Feb. 10, 2020

Firebase Event Analytics with Google BigQuery - An extensive guide to help you get started with app analytics.

BigQuery Data Analytics Firebase Feb. 10, 2020

Free Product Analytics with Firebase + BigQuery + Rakam - Exporting Firebase Analytics to BigQuery and visualizing in Rakam

BigQuery Feb. 10, 2020

Multi-Channel Marketing Attribution using Segment, Google BigQuery, dbt and Looker - Example of using BigQuery as a data lake for multiple marketing channels.

BigQuery Data Analytics Official Blog Feb. 3, 2020

10 top tips: Unleash your BigQuery superpowers - The BigQuery data warehouse offers a lot of analytics superpowers. Check out how you can take advantage of teleportation, time travel, and super speed.

BigQuery Data Analytics Official Blog Feb. 3, 2020

What’s happening in BigQuery: New federated queries, easier ML, and more metadata - An enterprise cloud data warehouse should be flexible and forward-looking. See new federated queries, better ML options and more metadata in BigQuery.

Big Data BigQuery Data Loss Prevention API Data Studio Feb. 3, 2020

BigQuery, PII and DLP: The Perfect Match - Analyzing PII data in BigQuery with Data Loss Prevention and viewing results in Data Studio.

BigQuery Feb. 3, 2020

Snowflake or BigQuery — which one is better ? - Comparison of BigQuery and Snowflake features.

BigQuery GIS Feb. 3, 2020

BigQuery Geography Clustering - Example of using clustering with geo data in BigQuery.

BigQuery GIS Feb. 3, 2020

OpenStreetMap BigQuery Public Dataset - The OpenStreetMap planet-wide dataset loaded to BigQuery.

BigQuery Cloud Pub/Sub Jan. 27, 2020

How to replay time series data from Google BigQuery to Pub/Sub - This is a tutorial article explaining how to replay time-series data from a BigQuery table into a Pub/Sub topic.

BigQuery GIS Jan. 27, 2020

A Continent On Fire - Visualizing wildfires with BigQuery Geo Viz.

Apache Beam BigQuery Data Science Jan. 27, 2020

Fastai batch prediction on a BigQuery table - From this article, you will get to know how to perform a batch prediction on a BigQuery table using a fastai model.

BigQuery Data Science Data Studio Jan. 27, 2020

Interactive: The top 2019 Wikipedia pages - Going deeper into Wikipedia most popular pages for 2019 with BigQuery and Data Studio.

BigQuery Jan. 27, 2020

Where inventions happen: Geo-locating global intellectual property - Getting to know where on the glob the inventions happen based on patents public data set.

BigQuery Data Science Jan. 27, 2020

Inequality: How to draw a Lorenz curve with SQL, BigQuery, and Data Studio - Analyzing the popularity of Wikipedia pages based on public data set.

BigQuery Machine Learning Jan. 20, 2020

When are the bugs coming? ML modelling in BigQuery to predict the next bug outbreak - Data modeling to answer the question everyone is thinking this time of year in Australia — predicting cockroach and mosquitoes outbreaks!

BigQuery Data Analytics Jan. 20, 2020

Check-list: selecting the right data transformation service for Google BigQuery - List of products on Google Cloud Platform to use for moving data to BigQuery.

BigQuery Jan. 20, 2020

How to connect to Snowflake, BigQuery and Redshift via QueryPie - QueryPie (SQL Tool) offers now connector to BigQuery.

BigQuery Data Studio Jan. 20, 2020

The exponential adoption of Tesla in the Netherlands - Exploring the RDW license plate data set with BigQuery, Cloud Storage and Data Studio

API BigQuery Jan. 13, 2020

BigQuery: Set up limits and custom quotas through API - BigQuery allows to set custom quotas for limiting cost on too large query. But how to set this limit by API?

Big Data BigQuery Jan. 13, 2020

BigQuery Wildcards - The article describes how "*" wildcards can be used in BigQuery.

Big Data BigQuery Jan. 13, 2020

Why We Picked Google BigQuery over Snowflake as Our New Data Warehouse Solution - Comparing BigQuery and Snowflake for Data Warehouse selection.

BigQuery Cloud Storage Python Jan. 13, 2020

Building and using an inventory of your Google Cloud Storage objects in BigQuery - Uploading metadata about fIles from Cloud Storage files and analyzing them in BigQuery.

BigQuery Cloud Functions Cloud Memorystore NodeJS Serverless Jan. 13, 2020

Fast Exports from BigQuery to Cloud Memorystore - Loading data from BigQuery to Cloud Memorystore

BigQuery GIS Jan. 13, 2020

Mapping statistics between different spatial hierarchies - BigQuery recipe for a problem when you have some geospatial statistics collected for one set of spatial hierarchy, but you need to do some data analysis using another hierarchy.

BigQuery Data Studio IoT Jan. 13, 2020

IoT Tank Monitoring Solution Part 3 — Visualizing data using BigQuery Federated Queries, CloudSQL and Data Studio - End to end solution to track tank level using cloud computing without having to worry too much with managing infrastructure.

BigQuery Javascript Jan. 6, 2020

BigQuery create partitioned table and load CSV with Apps Script - Work with partitioned table and upload a csv file in BigQuery with Apps Script.

Big Data BigQuery Dec. 23, 2019

Partition on any field with BigQuery - BigQuery has introduced integer partition capability. Now you can partition on numeric field, but not only, and surprisingly!

Big Data BigQuery Dec. 23, 2019

BigQuery Integer Partitioning is in Beta - Demonstrating a new BigQuery integer partition feature on New York Taxi dataset.

AI Platform BigQuery Cloud Dataflow Dec. 23, 2019

Pro tips for Google Cloud Dataflow & BigQuery - Sharing accumulated knowledge about BigQuery and Cloud Dataflow.

Big Data BigQuery Dec. 16, 2019

k-Means Clustering in BigQuery now does better initialization - The Scalable k-Means++ initialization option in BigQuery ML

BigQuery Data Analytics Dec. 16, 2019

Analyzing BigQuery Public Datasets - Analyzing Motor Vehicle Collision BigQuery Public Dataset.

BigQuery GIS Dec. 16, 2019

Puppies & BigQuery: Analyzing Geospatial Data - Pet density analysis and visualization in BigQuery GIS.

BigQuery GCP Certification GIS Dec. 16, 2019

Nearest neighbor using BQ Scripting - GIS BigQuery script to find the nearest neighbor for a specific geo point.

BigQuery Dec. 16, 2019

Querying geographic raster data in BigQuery the brute force way - Using BigQuery to query rasters (pixels) geo data.

Big Data BigQuery Cloud Dataflow Data Analytics Official Blog Dec. 16, 2019

Using HLL++ to speed up count-distinct in massive datasets - There’s a better way to do the count distinct function using Google’s HyperLogLog++ algorithm in Dataflow and BigQuery.

BigQuery Data Analytics Official Blog Dec. 16, 2019

New climate model data now in Google Public Datasets - Explore new climate model data in Google Cloud’s public dataset program. Climate model datasets include details and simulations.

BigQuery Data Science Dec. 9, 2019

Advent of code: SQL + BigQuery - Solving the Advent of Code challenges with SQL and BigQuery.

Big Data BigQuery Serverless Dec. 2, 2019

Write efficient queries on BigQuery - A few tips which improve speed of queries in BigQuery.

BigQuery Data Analytics Official Blog Nov. 25, 2019

Achieve peace of mind with BigQuery pricing and control - Flexibility and easier planning for data warehousing costs arrive with BigQuery Reservations.

BigQuery Data Studio Nov. 25, 2019

Optimizing Google BigQuery with Data Studio reports - Automating Google Data Studio reports with Google BigQuery in cost and queries time-effective manner.

Big Data BigQuery Python Nov. 25, 2019

Simplify BigQuery ETL jobs using SQLAlchemy - Extract and move data between BigQuery and relational databases using a plugin for SQLAlchemy.

BigQuery Cloud Dataflow Machine Learning Nov. 25, 2019

Clustering air quality data by using Kotlin, DataFlow and BigQuery Machine Learning - The article describes an implementation of a serverless ETL pipeline, which loads data from CSV files into a BigQuery dataset and runs K-means clustering on loaded data

Big Data BigQuery Cloud Dataproc Nov. 25, 2019

Querying External Data with BigQuery - Demonstration of BigQuery querying Parquet files from Google Cloud Storage.

BigQuery Data Analytics Nov. 25, 2019

A Journey into BigQuery Fuzzy Matching — 4 of [1, ∞) — A Tribute to FuzzyWuzzy - Implementing and using Fuzzy matching in BigQuery.

Big Data BigQuery Data Science GCP Experience Nov. 18, 2019

Batch Processing Pipelines for Better Data Analysis - An overview of how Gojek is using batch processing to generate useful insights from our data warehouse.

Big Data BigQuery Data Science Nov. 18, 2019

BigQuery workflow from the Jupyter notebook - In this article, you will get to know how to create and schedule the BigQuery workflow using the Jupyter Lab and the Cloud Composer.

App Engine BigQuery Data Science Python Nov. 18, 2019

Python / Pandas & BigQuery in 7 minutes - Using BigQuery in Django app.

BigQuery Data Science Nov. 11, 2019

Anomaly Detection With SQL - Demonstrating SQL anomaly detection on a public dataset in BigQuery.

BigQuery Data Studio Nov. 11, 2019

“OK Boomer” escalated quickly — a reddit+BigQuery report - Analyzing Reddit posts with BigQuery and visualizing in Data Studio.

BigQuery Data Science Machine Learning Nov. 11, 2019

ML Design Pattern #5: Repeatable sampling - Use a well-distributed column to split your data into a train/valid/test.

BigQuery Data Analytics Nov. 11, 2019

Analysis of Google Political Ads using BigQuery - Analyzing Google Political Ads public data source in BigQuery.

BigQuery Data Analytics Official Blog Nov. 11, 2019

Command and control now easier in BigQuery with scripting and stored procedures - Scripting and stored procedures are now available in BigQuery to make queries and tasks easier to execute.

BigQuery Cloud Functions Cloud Scheduler NodeJS Serverless Nov. 11, 2019

End to end serverless data pipeline on Google Cloud - Scheduled serverless data pipeline that gets data from OpenWeatherMap and stores it into BigQuery.

BigQuery Data Science Data Studio Nov. 4, 2019

Analyzing the crisis with reddit and BigQuery: 2019 Chilean protests - Analyzing and visualizing data from Reddit with BigQuery and Data Studio.

Apache Beam Big Data BigQuery Cloud Dataflow Nov. 4, 2019

How to build a cleaning pipeline with BigQuery and DataFlow on GCP - Creating a small transformation pipeline on Dataflow to clean data in BigQuery.

BigQuery Cloud AutoML Nov. 4, 2019

Make your life easier with AutoML Tables on Google Cloud! - A brief overview of Cloud AutoML.

Big Data BigQuery Data Science Nov. 4, 2019

Let the kids into the library - An opinionated attempt at building a data driven company in the cloud.

BigQuery Blockchain Python Nov. 4, 2019

Getting started with Bitcoin data on Kaggle with Python and BigQuery - Analyzing Blockchain data from BigQuery with Python.

BigQuery Data Analytics Official Blog Nov. 4, 2019

Show off your BigQuery ML and Kaggle skills: Competition open now - Show off your BigQuery ML and Kaggle skills: Competition open now.

Big Data BigQuery Nov. 4, 2019

Return of the Living Data - A story about BigQuery about underlying data formats.

BigQuery Data Studio Nov. 4, 2019

Build a Google Data Studio report using BigQuery Public Data-Sets - Tutorial on how to build a dashboard in Data Studio using public data in BigQuery.

Big Data BigQuery Data Science Python Oct. 28, 2019

How to get into BigQuery analysis on Kaggle with Python? - Exploring ways to use BigQuery in Kaggle.

BigQuery Cloud Data Fusion Cloud SQL Oct. 28, 2019

SQL Server Data Movement with CDAP - The article goes through setting up Data Fusion and creating a pipeline to copy data from Cloud SQL (SQL Server) to BigQuery.

BigQuery Oct. 28, 2019

Long Lines - Description of how BigQuery GeoViz (a tool for BigQuery Geo data visualization) plots long lines.

Big Data BigQuery Data Studio Oct. 28, 2019

Unique dashboards for external customers with Google Cloud - Using BigQuery and Data Studio to create dashboards that are shared with different persons.

BigQuery Cloud SQL Data Studio Oct. 28, 2019

GCP Goodies Part 9 — Time series data handling and visualization - Visualizing data in Data Studio using BigQuery and as a source database in Cloud SQL.

BigQuery Data Analytics Official Blog Oct. 21, 2019

New geospatial data comes to BigQuery public datasets with CARTO collaboration - Data analytics on public datasets from CARTO and BigQuery.

BigQuery Data Analytics Official Blog Oct. 21, 2019

Grafana and BigQuery: Together at last - Visualizing data from BigQuery in Grafana.

BigQuery Firebase Oct. 21, 2019

Dynamic User Retention Using BigQuery (Firebase Project) - Few BigQuery queries to analyze user retention for Firebase mobile app.

BigQuery Data Analytics Oct. 21, 2019

How to instantly recover a table in Google BigQuery - If you need to Ctrl-Z (undo) in BigQuery after something went wrong, here are a couple of ways to get your data back.

Big Data BigQuery Official Blog Oct. 21, 2019

Migrating data warehouses to BigQuery: Introduction and overview - Solution series that helps you transition from an on-premises data warehouse to BigQuery.

Big Data BigQuery Official Blog Teradata Oct. 21, 2019

Migrating Teradata to BigQuery - Solution series that helps you transition from a Teradata data warehouse to BigQuery.

BigQuery Cloud Natural Language API Oct. 21, 2019

Visualizing Entity Networks Through The GEG: BigQuery, Gephi & Cloud Natural Language API - Analyzing and visualizing 11 billion entities from more than 100 million English language articles spanning the last three years in the GDELT Global Entity Graph.

Big Data BigQuery Oct. 14, 2019

Plus Codes (Open Location Code) and Scripting in Google BigQuery - A closer look at why Plus Codes are important, and using Google BigQuery scripting to encode them!

BigQuery Google Maps Platform Official Blog Oct. 14, 2019

How to build your first Google Maps Platform integration with deck.gl - This walkthrough shows you how to build your first Google Maps Platform integration with deck.gl and leaves you with boilerplate code to work from for future visualizations.

BigQuery Cloud Pub/Sub Oct. 14, 2019

Live Ethereum and Bitcoin Data in Google BigQuery and Pub/Sub - The crypto_ethereum and crypto_bitcoin datasets in BigQuery are now updated in near real-time and possible to subscribe to public PubSub topics.

BigQuery Cloud Data Fusion Oct. 14, 2019

How I used Google Cloud Data Fusion to create a data warehouse — Part 1 - Experience with using Google Data Fusion.

BigQuery Oct. 6, 2019

BigQuery Table Comparison - Examples of queries to compare 2 tables in BigQuery.

Apache Beam Big Data BigQuery Oct. 6, 2019

Type safe BigQuery in Apache Beam with Spotify’s Scio - Using Scala's Beam library for type-safe queries in BigQuery.

BigQuery Data Analytics Official Blog Oct. 6, 2019

How to manage BigQuery flat-rate slots within a project - Learn how to manage slots when using BigQuery’s flat-rate pricing, so you can run queries specific to applications within the same project.

BigQuery Data Analytics Official Blog Oct. 6, 2019

What’s the weather like? Using Colab to get more out of BigQuery - Use BigQuery and Colab, plus Python, to explore weather datasets to make data science predictions.

BigQuery Oct. 6, 2019

Data Warehouse storage or a data lake? Why not both? - Is BigQuery more data lake or data warehouse? This article explains concepts and properties.

BigQuery Data Studio Oct. 6, 2019

Implementing DataStudio Dashboards with Goal Markers - Visualizing data from BigQuery views in Data Studio.

BigQuery Cloud Composer Cloud Dataproc Oct. 6, 2019

Running Spark on Dataproc and loading to BigQuery using Apache Airflow - Example of Airflow data pipeline setup for Dataproc and BigQuery.

BigQuery Data Analytics Oct. 6, 2019

Multi-Session & Multi-Channel Funnel Reporting in Google Analytics BigQuery - Using data from Google Analytics API in BigQuery.

AWS BigQuery Cloud Dataflow Oct. 6, 2019

Creating an Elasticsearch to BigQuery Data Pipeline - Connecting data resources through a pipeline across AWS and GCP.

BigQuery Docker Python Sept. 30, 2019

Migrating our ETL pipeline to Luigi on a Cloud - Running Luigi framework for scheduling ETL jobs.

BigQuery Data Science Sept. 30, 2019

10 top tips: Unleash your BigQuery superpowers - If BigQuery was superhero, what kind of superpowers would it have?

BigQuery Billing Sept. 30, 2019

Snitching on expensive Google BigQuery queries - A simple tool that checks and alerts if some BigQuery query passes a certain threshold in terms of cost.

Big Data BigQuery Sept. 30, 2019

BigQuery DeDuplication — Window Function vs Group by For Stitch - Comparing the performance for BigQuery Deduplicate using window function vs group by. If you are using stitch you can do delete in BQ also.

BigQuery Data Analytics Official Blog Sept. 30, 2019

Cost optimization best practices for BigQuery - Find tips to optimize your BigQuery data warehouse costs so you’re getting the most for your business under budget.

BigQuery Machine Learning Sept. 30, 2019

BigQuery-Geotab Intersection Congestion - Kaggle contest to predict wait times at major city intersections.

BigQuery Data Analytics Sept. 23, 2019

Using MySQL as a Cache Layer for BigQuery - Using MySQL as a cahing layer BigQuery in Cube.js, open-source analytics framework.

BigQuery Machine Learning Sept. 23, 2019

Predict propaganda twitter accounts using Machine learning on Google Cloud BigQuery - Using BigQuery ML to create a model based on Twitter data to detect whether message is posted by a bot.

Big Data BigQuery Teradata Sept. 23, 2019

Teradata to Google BigQuery Migration. Converting the code - This article provides instructions on how to extract the schema of tables, views and SQL Queries from Teradata and convert it into BigQuery.

BigQuery Machine Learning Python TensorFlow Sept. 23, 2019

ML Design Pattern #1: Transform - Illustration of Transform design pattern using BigQuery ML & SQL.

BigQuery Sept. 23, 2019

How to improve the performance of BigQuery queries by optimizing the schema of your tables - Three tips to improve BigQuery performance at the storage level: Nested fields, Geography types, and Clustering.

BigQuery Sept. 23, 2019

NEXRAD L3 real-time and archive data - BigQuery open data set: NEXRAD Level 3 products are used to remotely detect atmospheric features, such as precipitation, precipitation-type, storms, turbulence and wind, for operational forecasting and data research analysis.

BigQuery Data Science Sept. 16, 2019

Loading MySQL backup files into BigQuery — straight from Cloud SQL - Loading Cloud SQL MySQL backup data into BigQuery.

Big Data BigQuery Sept. 16, 2019

End-to-End Crypto Shredding (Part II): Data Deletion/Retention with Crypto Shredding - Crypto-deletion in various storages in GCP.

Big Data BigQuery Sept. 16, 2019

BigQuery Deduplication - Explore some techniques for deduplication in BigQuery both for the whole table and by partition.

Big Data BigQuery Sept. 16, 2019

A Journey into BigQuery Fuzzy Matching — 3 of [1, ∞) — NYSIIS - Another article in ongoing series about fuzzy matching in BigQuery.

BigQuery Data Analytics Official Blog Sept. 16, 2019

Quantum Metric gets answers from customer data at light speed

Beginner Big Data BigQuery Sept. 9, 2019

The Caveat of Loading Data to Partitioned Table on BigQuery - Table Partitioning and Why

BigQuery Cloud Dataprep Data Studio Sept. 9, 2019

Self-Service Analytics on BigQuery live in 30 min, stopwatch in hand! - How to leverage BigQuery, Cloud DataPrep, and Data Studio to turn raw data into beautiful reports.

BigQuery Cloud Dataprep Data Analytics Data Studio Sept. 9, 2019

Understanding Self-Service Analytics on BigQuery with Cloud Dataprep - Using Google Cloud products for analytics.

Beginner BigQuery Sept. 9, 2019

BigQuery Drop or Change Column - Dropping columns in BigQuery table with DDL statements.

BigQuery GCP Experience Sept. 9, 2019

Using The Cloud To Explore The Linguistic Patterns Of Half A Trillion Words Of News Homepage Hyperlinks - Analyzing text data with BigQuery.

AI BigQuery Cloud ML Official Blog Sept. 2, 2019

How to quickly solve machine learning forecasting problems using Pandas and BigQuery - Learn how to quickly solve machine learning forecasting problems using Pandas, BigQuery, and Google Cloud AI Platform.

BigQuery Data Analytics Official Blog Sept. 2, 2019

What’s happening in BigQuery: Adding speed and flexibility with 10x streaming quota, Cloud SQL federation and more - The latest updates for Google Cloud’s BigQuery data warehouse include a streaming quota increase, automatic re-clustering, and lots more features.

BigQuery Data Science Python Sept. 2, 2019

Slow BigQuery results no more - How the use of BigQuery Storage API improves the speed of results retrieving from BigQuery.

BigQuery Sept. 2, 2019

Podcast Analytics with BigQuery - Doing podcast analytics in BigQuery.

BigQuery Sept. 2, 2019

Nearest neighbor in BigQuery GIS - Queries to find an item from some dataset nearest to each item in another dataset.

Apache Beam Big Data BigQuery Cloud Dataflow Sept. 2, 2019

Trimming down over 95% of your BigQuery costs using File Loads - Using BigQuery load jobs in Beam instead of streaming to reduce costs.

BigQuery Dialogflow Sept. 2, 2019

Deconstructing Chatbots: How to integrate Dialogflow with BigQuery - Writing data from Dialogflow fulfillment to BigQuery.

BigQuery Data Analytics Official Blog Sept. 2, 2019

Expanding your patent set with ML and BigQuery - You can use BigQuery and Python to perform faster patent landscaping.

BigQuery Data Analytics Official Blog Aug. 26, 2019

Skip the maintenance, speed up queries with BigQuery's clustering - Google Cloud’s BigQuery data warehouse automates tasks and maintenance. Here’s how automatic re-clustering works to save you time.

BigQuery Data Analytics Official Blog Aug. 26, 2019

Introducing the BigQuery Terraform module - The BigQuery module for Terraform brings an open-source data analytics option, so you can automate instantiation and deployment of BigQuery datasets and tables.

BigQuery Data Analytics Official Blog Aug. 26, 2019

Skip the heavy lifting: Moving Redshift to BigQuery easily - Moving data from AWS S3 into Google Cloud’s BigQuery data warehouse is now easier with a new data transfer service.

Apache Beam App Engine BigQuery Cloud AutoML Cloud Dataflow Aug. 26, 2019

Predicting the next 5 minutes of a Cricket Game - Proof of concept for real time prediction on GCP.

BigQuery Data Science Data Studio Aug. 19, 2019

Don’t Double Park in Brooklyn - Analyzing New York's open data about state vehicle registration using BigQuery and Data Studio.

Big Data BigQuery Aug. 19, 2019

A Journey into BigQuery Fuzzy Matching — 2 of [1, ∞) — More Soundex and Levenshtein Distance - Doing fuzzy matching in BigQuery on first and last names.

Big Data BigQuery Aug. 19, 2019

Finding top programming language with BigQuery - Analyzing Github public dataset with BigQuery's to get most popular programming languages based on number of repositories.

Big Data BigQuery Aug. 19, 2019

Tips and Tricks to Seamlessly Migrate BigQuery Dataset Across Regions - Description of cross regional BigQuery data migration.

BigQuery Data Studio Machine Learning Aug. 12, 2019

BigQuery and Data Studio for Model Monitoring - Monitoring machine learning model performance with BigQuery and Data Studio.

BigQuery Cloud Vision API Aug. 12, 2019

Detecting Traffic congestion using Google Cloud Vision API and Analyzing using BigQuery - Detecting traffic congestion with Cloud Vision API.

BigQuery Cloud Functions Data Analytics Official Blog Aug. 12, 2019

Streaming data from Cloud Storage into BigQuery using Cloud Functions - See how to move stored data easily into BigQuery from Google Cloud Storage using Cloud Functions to build a pipeline.

Big Data BigQuery Data Analytics Official Blog Aug. 12, 2019

Migrating Teradata and other data warehouses to BigQuery - Migration framework and architecture when moving data warehouse, like Teradata, to Google Cloud BigQuery.

BigQuery Aug. 12, 2019

Taking BigQuery HLL to the extreme - How Permutive has optimised it’s analytics workloads using Google BigQuery, HyperLogLog and the inclusion-exclusion principle

BigQuery Aug. 12, 2019

Authenticating to BigRQuery on GCP AI Platform Notebooks - When you’re using Jupyter Notebooks with R, authenticating with BigQuery can be tricky. Here’s how to do it.

BigQuery Aug. 12, 2019

An Adventure with my twitter feed using BigQuery - Loading and analysing Twitter data in BigQuery.

Big Data BigQuery Aug. 5, 2019

Efficient Aggregation, Roll-ups with BigQuery HyperLogLog++ functions - Description of incremental count distinct processing using BigQuery’s HyperLogLog++ functions and how they provide fast, scalable, incremental processing properties.

BigQuery Aug. 5, 2019

Know Datajoins, Jump over Pitfalls! - Overview of QwikLabs for BigQuery focus on joining data.

BigQuery Machine Learning Aug. 5, 2019

Binary Logistic Regression with BigQuery ML - Using BigQuery ML to train and predict diabetes.

BigQuery Machine Learning Aug. 5, 2019

Getting Started with BigQuery Machine Learning (BQML) - Example of using BigQuery ML on Google Analytics open dataset.

BigQuery Cloud Functions Cloud Pub/Sub Dataflow Python Aug. 5, 2019

Copy data from Pub/Sub to BigQuery - Inserting data from PubSub to BigQuery with Cloud Functions.

BigQuery Cloud SQL Official Blog Aug. 5, 2019

New GCP database options to power your enterprise workloads - Here’s what’s new in cloud databases at Google Cloud Next Tokyo ‘19, including SQL Server, Elasticsearch, and federated query updates.

AI Platform Notebooks BigQuery Machine Learning TensorFlow Aug. 5, 2019

Predicting the publisher’s name from an article: A case study - Developing ML model on AI platform.

BigQuery Data Analytics July 29, 2019

How to query and calculate Google Analytics data in BigQuery - Examples of BigQuery queries to analyze Google Analytics data.

BigQuery July 29, 2019

Efficient spatial matching in BigQuery - Finding all the points in dataset of polygons using BigQuery GIS

BigQuery Data Science July 29, 2019

BigQuery: SQL on Nested Data - Examples of working with nested data in BigQuery.

BigQuery Data Science Machine Learning July 29, 2019

Clustering 4,000 Stack Overflow tags with BigQuery k-means - Using BigQuery ML to cluster tags from StackOverflow.

BigQuery July 29, 2019

BigQuery Surrogate Keys - Use cases for using surrogate keys in BigQuery.

BigQuery Data Analytics Machine Learning Official Blog July 29, 2019

How to use BigQuery ML for anomaly detection - Step by step tutorial which demonstrates how to use BigQuery ML to perform unsupervised anomaly detection.

BigQuery Data Analytics July 22, 2019

Building an analytics stack - Process of creating analytics solution on GCP.

BigQuery Python July 22, 2019

How to load GeoJSON files into BigQuery GIS - An ETL pipeline for GeoJSON to BigQuery.

BigQuery July 22, 2019

Query and Visualize Lightning Strikes with BigQuery GIS

BigQuery July 15, 2019

Geomancer - Geomancer is a geospatial feature engineering library. It leverages geospatial data such as OpenStreetMap alongside a data warehouse like BigQuery.

BigQuery Data Analytics Official Blog July 15, 2019

Goodbye Hadoop. Building a streaming data processing pipeline on Google Cloud - Qubit discusses how they moved from Apache Hadoop and MapReduce to Google BigQuery, Dataflow and Cloud Pub/Sub.

BigQuery Data Analytics Official Blog July 15, 2019

Geolocation with BigQuery: De-identify 76 million IP addresses in 20 seconds - You can use the BigQuery data warehouse to explore large public datasets -- here’s how to de-identify user data for compliance.

BigQuery July 15, 2019

BigQuery in Kaggle — setup for tutorial - Tutorial on how to use BigQuery in Kaggle.

Big Data BigQuery Data Science Java July 15, 2019

Beast: Moving Data from Kafka to BigQuery - GOJEK’s open source solution for moving data from Kafka to Google BigQuery.

BigQuery July 15, 2019

Did my query get optimized spatial join? - Checking in BigQuery execution details if GIS query used optimized spatial join or not.

BigQuery GCP Experience July 15, 2019

Democratizing data analysis with Google BigQuery - Overview of how BigQuery is used in Twitter.

BigQuery July 15, 2019

How to create Tables inside Tables using Nested Data Structure and in Google BigQuery - Steps of creating a table inside table using Columnar Storage feature with Nested Data Structures in Google Big Query.

BigQuery July 15, 2019

Automating Google BigQuery Jobs with Google Analytics - Using BigQuery automation with Google Analytics data.

BigQuery July 15, 2019

A Journey into BigQuery Fuzzy Matching — 1 of [1, ∞) — Soundex - Implementing Master Data Management system in BigQuery.

BigQuery July 15, 2019

On-Premise Database to BigQuery Migration - Process of migrating from on-premise to BigQuery.

BigQuery Data Science July 8, 2019

New in BigQuery: Persistent UDFs - Using new functionality of saving User Defined Functions in BigQuery.

BigQuery Machine Learning Python July 8, 2019

How to do hyperparameter tuning of a BigQuery ML model - Bayesian Optimization using Cloud AI Platform.

BigQuery July 8, 2019

Impact of dataset locations on BigQuery query execution performance - Analysis of the impact when storying BigQuery data in regional and multi-regional dataset.

BigQuery Data Science Python July 8, 2019

BigQuery and Public Datasets. Overview for Data Analysts - In this article we’ll briefly explore what is BigQuery and how a data analyst can access and use it through various interfaces with…

BigQuery Data Science July 8, 2019

An open source Python package for moving HelpScout data into Google BigQuery - This article is written for business analysts, data scientists and engineers that need to integrate Help Scout data into their Google BigQuery pipeline, and have hands-on experience dealing with Python, APIs and SQL databases.

BigQuery July 8, 2019

Persistent UDFs + BQ GIS = ♥ - Using BigQuery Persistent UDFs related to GIS analysis.

Big Data BigQuery July 8, 2019

BigQuery for Big Data and AI - A brief intro to start working with BigQuery.

AI BigQuery Data Analytics Machine Learning Official Blog July 1, 2019

Analyze BigQuery data with Kaggle Kernels notebooks - BigQuery users can now query and create BQML models within an integrated development environment using Kaggle Kernels.

BigQuery July 1, 2019

BigQuery and Its Big Benefit - Overview of BigQuery and its features.

BigQuery July 1, 2019

Contains/Covers/Intersects/Within? - Discussion about BigQuery GIS features.

BigQuery Cloud Storage Ruby July 1, 2019

Exporting data from BigQuery to Google Drive and Cloud Storage using Ruby - Ruby scripts to move data between various storages on GCP.

BigQuery July 1, 2019

An Introduction to the Google Cloud Public Datasets Program

BigQuery Data Analytics Machine Learning Official Blog June 24, 2019

Predictive marketing analytics using BigQuery ML machine learning templates - To make machine learning more accessible to data scientists, BigQuery ML is now generally available, and we’ve published three new templates in collaboration with SpringML for marketing analytics use cases.

BigQuery Cloud Composer June 24, 2019

Data Warehousing Made Easy with Google BigQuery and Apache Airflow - Example of using products on Google CLoud for BI, ETL, and DWH.

BigQuery Python June 24, 2019

Creating a Serverless Data Pipeline in GCP - Example of simple serverless data pipeline.

Big Data BigQuery June 24, 2019

Optimising queries in BigQuery for Beginners - Learn what BigQuery contains under the hood and how to run efficient queries from a public session dataset in this step by step guide.

BigQuery June 24, 2019

Create BigQuery tables with Google Sheets and Apps Script - Creating BigQuery tables using the GUI can be a hassle. This article describes an alternative way to create BigQuery tables using the BigQuery Table builder sheet. This Google Spreadsheet automates th

BigQuery June 24, 2019

The subtle art of sharing “views” in BigQuery - Sharing BigQuery data between different group of users.

BigQuery June 24, 2019

Migrating data from Amazon Redshift - Beta release of BigQuery Data Transfer Service with which you can copy data from Amazon Redshift to BigQuery.

BigQuery Data Science Data Studio June 24, 2019

From College to the Pros with Google Cloud Platform (Part 1) - Getting together and analyzing NBA players stats.

BigQuery June 24, 2019

BigQuery View Analyzer - Command-line tool for visualizing dependencies and managing permissions between BigQuery views.

Big Data BigQuery Data Analytics GCP Experience June 17, 2019

A Song of Data and Fire: Building Bnext Wall (Data Lake) - Process of building data lake on Google Cloud Platform.

BigQuery Blockchain June 17, 2019

Qtum Analytics Using Google BigQuery - Utom (global smart contract platform based on a proof-of-stake consensus mechanism ) is using BigQuery to store data which are then used for visualization.

Big Data BigQuery Official Blog June 17, 2019

Building hybrid blockchain/cloud applications with Ethereum and Google Cloud - This post describes applications for making internet-hosted data available inside an immutable public blockchain by placing BigQuery data available on-chain using a Chainlink oracle smart contract.

BigQuery Data Science GCP Experience June 17, 2019

Analytics at lightspeed with Google BigQuery - The article describes how Aditya Birla Group created a digital platform on GCP to manage the travel of their employees.

BigQuery Machine Learning June 10, 2019

ML Study Jam — Predict Visitor Purchases with a Classification Model in BQML - Developing a Machine Learning model using BigQueryML.

BigQuery Cloud SQL June 10, 2019

Google Cloud Platform for SQL Practitioners - The purpose of this article is to give an overview of the SQL features in Google Cloud Platform.

BigQuery Cloud Composer Cloud SQL Kubernetes June 10, 2019

Copy data from cloud SQL to BigQuery using apache airflow/ cloud composer part 2 - Copying data from Cloud SQL to BigQuery using Cloud Composer (Apache Airflow).

Big Data BigQuery Tutorial June 3, 2019

How to easy understand Analytics Functions on BigQuery - An in-depth explanation of analytical BigQuery functions.

Big Data BigQuery June 3, 2019

Loading Terabytes of Data From Postgres Into BigQuery - The article describes approaches of exporting data from PostgreSQL and loading into BigQuery.

Apache Beam BigQuery Cloud Dataflow June 3, 2019

Extracting Data from BigQuery table to Parquet into GCS using Cloud Dataflow and Apache Beam - Extracting data using Dataflow from BigQuery into Parquet format and storying into Cloud Storage.

Big Data BigQuery Cloud Dataprep Machine Learning June 3, 2019

BigQuery GIS + ML on government open data - Analyzing & visualizing housing data using BigQuery.

BigQuery Security June 3, 2019

BigQuery Encryption Functions — Part I: Data deletion/retention with Crypto Shredding - Using BigQuery encryption functions for data deletion and retention

BigQuery Business Cloud AutoML June 3, 2019

Google's AutoML And BigQuery ML: The Rise Of One-Click Hyperscale Machine Learning - A look at Google's approach to Machine Learning.

BigQuery Official Blog June 3, 2019

Scan BigQuery for sensitive data using Cloud DLP - The Scan with DLP button lets you run DLP scans directly from the BigQuery UI in just a few clicks, so you can easily discover and classify sensitive data.

BigQuery Firebase May 27, 2019

Analyzing Custom Retention Cohorts Using BigQuery and Google Analytics for Firebase - Retention is a stat a lot of app developers care deeply about; after all, if you’re making an app that your users keep coming back to week…

BigQuery Machine Learning Python May 27, 2019

New York Taxi data set analysis - Creating Machine Learning model based on BigQuery's New York Taxi drives dataset.

BigQuery Cloud Storage Container Registry May 27, 2019

Google Container Registry statistics from GCS access_logs - Sample flow to extract Google Container Registry usage statistics (image push/pull counts, analytics, etc).

BigQuery Cloud Build Cloud Scheduler May 27, 2019

Scheduling BigQuery using Cloud Scheduler & Cloud Build - Scheduling BigQuery queries with Cloud Scheduler and Cloud Build.

BigQuery Official Blog May 20, 2019

Querying the Stars with BigQuery GIS - Using BigQuery-GIS to analyze astronomy datasets, in a similar manner to analyzing ground-based map data: using spherical coordinates.

BigQuery May 20, 2019

Visualising BigQuery - BQVisualiser is a tool to visualize BigQuery queries and thus gain more insights into how queries are executed.

BigQuery Data Studio May 20, 2019

Uber datasets in BigQuery: Driving times around SF (and your city too) - Using BigQuery GIS functions, partitioning, clustering, and BI Engine to create Interactive Data Studio dashboards to analyze Uber rides.

BigQuery May 20, 2019

HyperLogLog in Google BigQuery - Using HyperLogLog in BigQuery to get number of unique users.

Beginner BigQuery Tutorial May 20, 2019

Up and Running with BigQuery - Beginners tutorial to start working with BigQuery.

BigQuery DevOps GCP Experience May 6, 2019

A Database Migration Story: 99% Cost Reduction and 100% Hindsight - How BetterCloud’s Data Team executed a long database migration from MS Azure SQL Server to Bigquery.

BigQuery Cloud Dataflow Cloud Pub/Sub April 22, 2019

New Updates on Pub/Sub to BigQuery Dataflow Templates from GCP - Description of the new features for the Cloud Pub/Sub to BigQuery Templates.

AWS BigQuery April 22, 2019

Ingest Data from RDS MySQL to Google BigQuery - Example of Data pipeline which exports data from AWS RDS to BigQuery.

Big Data BigQuery Cloud Dataflow April 15, 2019

From data ingestion to insight prediction: Google Cloud smart analytics accelerates your business transformation - Cloud Next '19 news in more detail related to analytics products.

BigQuery April 8, 2019

Power Grafana with Google BigQuery! - Grafan plugin to display data from BigQuery.

AWS BigQuery Tutorial April 8, 2019

Connecting to Google BigQuery from AWS SageMaker - Connecting from AWS SageMaker (solution for using Jupyter Notebooks) to BigQuery.

BigQuery GCP Experience April 8, 2019

Why We Moved to Google Cloud Platform, in Two Slides - Benefits of migrating on-premises data warehousing platform to BigQuery.

BigQuery Cloud Dataflow Cloud Dataprep Data Science Machine Learning TensorFlow April 8, 2019

End-to-end churn prediction on Google Cloud Platform - Overview of GCP architecture to build customer churn prediction compromising of data acquisition, data wrangling, modeling, model deployment, and a business use case.

BigQuery Business Cloud Dataproc April 8, 2019

The Economics of Modernizing Your Enterprise Data Warehouse - Results of studies quantifying the economic value of Google data analytics services.

BigQuery Machine Learning April 8, 2019

How to do predictive maintenance using BigQuery ML for water utilities - Proof of concept to predict pipe breaks for public water utility organization.

BigQuery April 8, 2019

Which BI tool for BigQuery ? - The article focuses on specific requirements for successful Business Intelligence tool to use with BigQuery.

Big Data BigQuery GCP Experience April 1, 2019

Reflections On Designing An Enterprise Data Warehouse - Description of process for Data warehouse development on Google Cloud using BigQuery.

BigQuery Official Blog April 1, 2019

Simplify reporting with the Sheets data connector for BigQuery, and voila: automated content updates for G Suite - Example of using BigQuery connector with Google Sheets

BigQuery Official Blog April 1, 2019

Migrating your traditional data warehouse platform to BigQuery: announcing the data warehouse migration offer - Easier migration of traditional data warehouses to BigQuery via service from GCP.

BigQuery Monitoring Stackdriver April 1, 2019

Downsampling and Exporting Stackdriver Monitoring Data - This post explains how to use the Stackdriver Monitoring API to read, downsample and export data from Stackdriver to BigQuery.

BigQuery April 1, 2019

BigQuery datasource for Grafana - BigQuery datasource plugin provide support for BigQuery as a backend database.

BigQuery Cloud Functions Cloud Pub/Sub Javascript April 1, 2019

Dynamically Duplicating A BigQuery DataSet’s Tables - Pipeline to replicate data between two datasets in BigQuery.

BigQuery Machine Learning April 1, 2019

Getting Started with Google BigQuery’s Machine Learning — Titanic Dataset - Creating BigQuery ML model on Titanic public dataset.

Big Data BigQuery Official Blog March 25, 2019

Analyzing 3024 rice genomes characterized by DeepVariant - Exploring Rice genome dataset using BigQuery.

BigQuery Cloud Dataflow Data Studio Official Blog March 18, 2019

Let the queries begin: How we built our analytics pipeline for NCAA March Madness - Using GCP to create pipeline and do predictive analytics for NCAA games.

BigQuery Billing March 18, 2019

Reconcile Your Monthly GCP Invoice with BigQuery Billing Export - Getting correct billing information from billing exports to BigQuery.

BigQuery March 18, 2019

Why BigQuery is The Next Big Thing With Example - Overview of BigQuery properties.

BigQuery March 18, 2019

Fitting it in: Adjusting Team Metrics for Schedule Strength - Analyzing stats from NCAA games using BigQuery.

BigQuery March 18, 2019

Monitoring your BigQuery costs in real-time with the SuperQueryOperator - This post describes how you can get a view of your Airflow costs when you connect and implement Airflow tasks to and from BigQuery.

BigQuery Python March 18, 2019

BigQuery API To Manage Tables + Cloud Functions = ❤️ - Using BigQuery API and Cloud Functions to delete temporary tables.

BigQuery March 11, 2019

Slowly Changing Dimension Type 2 in BigQuery - Article describes 2 most common approaches for Implementing dimension history in BigQuery.

BigQuery March 11, 2019

Visualizing Google Big Query Datasets in PowerBI - Visualizing BigQuery datasets in PowerBI Dashboards.

BigQuery March 11, 2019

BigQuery for Data Science - Working with BigQuery in context of Data Science.

BigQuery Cloud Dataflow Java March 11, 2019

DataFlow: Dealing with BigQuery schema change - Detection of BigQuery schema changes in streaming Dataflow jobs.

BigQuery March 4, 2019

Google Cloud Platform tools and their possibilities: Query automation in BigQuery (Part 1) - Scheduling BigQuery queries to run periodically.

Apache Beam BigQuery Cloud Dataflow March 4, 2019

Dataflow Design Pattern: Dynamic Streaming pipeline : Dealing with mutable JSON schema - Handle BigQuery schema updates for streaming PubSub messages in Dataflow.

Big Data BigQuery Cloud Marketplace R March 4, 2019

RStudio and BigQuery in under 30 minutes - Article describes steps to provision an RStudio instance on Google Compute Engine and use it to do complex analytics on BigQuery.

Big Data BigQuery Cloud Composer GCP Experience March 4, 2019

How did we build a Data Warehouse in six months? - Sharing experience of creating data warehouse on Google Cloud Platform.

BigQuery March 4, 2019

BigQuery GIS performance tips - Random BigQuery GIS performance tips.

BigQuery Feb. 25, 2019

Hey, BigQuery! - Get hands-on training with the new BigQuery for Data Analysis quest with Qwiklabs.

BigQuery Cloud Functions Cloud Scheduler Feb. 25, 2019

How To Control Access To BigQuery At Row Level With Groups - How to integrate this group membership data with Authorized Views, via Google Groups and the G Suite Admin API (or the Cloud Identity API), in order to create a row level access control scheme based on groups.

BigQuery Cloud Pub/Sub Dataflow Feb. 25, 2019

Machine learning pipeline for predicting bike usage from weather forecasts: Part 1 - Create a data pipeline using Pub/Sub, Dataflow and Bigquery to automatically monitor and store TFL bike hire and weather data.

BigQuery Cloud Composer Cloud SQL Feb. 25, 2019

Copy data from Cloud SQL to BigQuery using Apache Airflow - Using Apache airflow to copy data from Cloud SQL to BigQuery.

BigQuery Feb. 25, 2019

The real top Stack Overflow questions - Using BigQuery to analyze most popular question on Stack Overflow.

BigQuery Official Blog Feb. 10, 2019

Query without a credit card: introducing BigQuery sandbox - BigQuery sandbox, a credit-card free path to enable new users and students to experiment with BigQuery at no cost.

BigQuery Feb. 10, 2019

BigQuery without a credit card: Discover, learn and share - The new sandbox mode for BigQuery includes free storage, no credit card required.

BigQuery Feb. 10, 2019

Analyzing Ethereum Classic with Google BigQuery - Getting insight from Ethereum Classic transactions with BigQUery.

BigQuery Machine Learning Feb. 10, 2019

BigQuery ML gets faster by computing a closed-form solution (sometimes) - Speeding up creation of ML model in BigQuery.

BigQuery Official Blog Feb. 4, 2019

How we built a derivatives exchange with BigQuery ML for Google Next ‘18 - Building a derivatives exchange with BigQuery ML.

BigQuery Feb. 4, 2019

BigQuery for Data Warehouse: PART ONE - BigQuery is an enterprise data warehouse that solves this problem by enabling super-fast SQL queries using the processing power of Google’s infrastructure.

BigQuery Feb. 4, 2019

Google BigQuery’s Python SDK: Creating Tables Programmatically - Create tables in Google BigQuery, auto-generate their schemas, and retrieve said schemas.

BigQuery Cloud Functions Cloud Pub/Sub Serverless Feb. 4, 2019

Simple serverless data pipeline on Google Cloud Platform - Serverless pipeline using Cloud Scheduler, PubSub and Cloud Function to store data into BigQuery.

BigQuery Jan. 28, 2019

JSON parsing error: How to Load JSON into BigQuery Successfully using NDJSON - Load JSON into BigQuery Successfully using Newline delimited JSON.

BigQuery Jan. 28, 2019

Google Cloud Platform for Data Scientist and Introduction to Big Query - BigQuery introduction and overview of properties.

BigQuery Python Jan. 21, 2019

Managing BigQuery field descriptions — bq-utils 0.1.0 - A small Python library that helps you with copying and uploading your BigQuery field descriptions.

BigQuery Cloud Dataflow Jan. 21, 2019

Towards a Multi-Cloud Serverless Data Warehouse - Using GCP’s Cloud Dataflow and BigQuery services.

BigQuery Official Blog Jan. 21, 2019

Connecting BigQuery and Google Sheets to help with hefty data analysis - The Sheets data connector for BigQuery will be generally available to G Suite Business, Enterprise and Education customers in the coming weeks.

App Engine BigQuery Cloud ML Machine Learning TensorFlow Jan. 21, 2019

Building Token Recommender in Google Cloud Platform - ERC20 token recommendation system based on collaborative filtering and data from public Ethereum dataset in BigQuery using products on GCP.

BigQuery NoSQL Jan. 14, 2019

Using MongoDB Change Streams to replicate data into BigQuery - Learnings and challenges faced while building a MongoDD to BigQuery data pipeline.

BigQuery Jan. 14, 2019

New BigQuery UI features help you work faster - New features in BigQuery UI like sharing queries or searching through queries.

BigQuery Jan. 14, 2019

BigQuery: a year in review - List of most prominent and exciting releases/updates for Bigquery throughout 2018.

BigQuery Machine Learning Jan. 14, 2019

Whisked Away by BigQuery ML - Creating ML model with BigQuery ML using data about whiskey.

BigQuery Cloud SQL Jan. 14, 2019

How to serve BigQuery results from MySQL with Cloud SQL - Using Google Cloud SQL as intermediary to serve results on Data Studio.

BigQuery Jan. 7, 2019

Analysing 1.2M mainnet contracts in 20 seconds using Eveem and BigQuery - Using BigQuery UDFs (User Defines Functions) on Ethereum contracts.

Apache Beam BigQuery Cloud Dataflow Jan. 7, 2019

How to transfer BigQuery table to Cloud SQL using Cloud Dataflow - Code example of exporting BigQuery data in Cloud SQL with Dataflow.

AI BigQuery Cloud AutoML Cloud ML TensorFlow Jan. 7, 2019

Choosing between TensorFlow/Keras, BigQuery ML, and AutoML Natural Language for text classification - Comparing text classification done three ways on Google Cloud Platform.

Apache Beam BigQuery Dec. 31, 2018

BigQuery Utilities for Apache Beam - Open Sourced BigQuery Utilities for Apache Beam.

BigQuery Cloud Functions Python Dec. 31, 2018

Google Cloud Functions Python Overview and Data Processing Example - Event driven serverless functions-as-a-service.

BigQuery Dec. 24, 2018

CodeLab — Connect Actions on Google with BigQuery - How to connect AoG with BigQuery.

BigQuery Dec. 24, 2018

BigQuery public datasets metadata - Metadata for BigQuery public datasets.

BigQuery Machine Learning Dec. 17, 2018

How to tune a BigQuery ML classification model to achieve a desired precision or recall - Article explains tuning ML model in BigQuery on flights delay prediction model.

BigQuery Data Studio Official Blog Dec. 17, 2018

Taking a practical approach to BigQuery cost monitoring - Data Studio dashboard which reports the daily BigQuery spending split by users at a particular organization.

BigQuery Data Studio GCP Experience Dec. 17, 2018

Enabling data accessibility at 7-Eleven (with Data Studio and BigQuery) - Using BigQuery and Data Studio to visualize KPIs for retailer

BigQuery Dec. 10, 2018

Snowplow for Google Cloud Platform is here - Snowplow Analytics supports loading data into BigQuery.

BigQuery Data Studio Dec. 10, 2018

Data Studio with BigQuery: 2018's best practices - Tips based on experience working with Data Studio and BigQuery

BigQuery Cloud Dataflow Cloud IoT Dec. 3, 2018

A solution for implementing industrial predictive maintenance: Part III - A full predictive maintenance reference solution from Google Cloud Platform products, including Cloud IoT Core and Cloud IoT Edge, big data and data processing tools like BigQuery and Cloud Dataflow, and machine learning platforms like Cloud ML Engine.

BigQuery Python Dec. 3, 2018

Loading JSON formatted strings into Google BigQuery (Python3) - Loading JSON into Google BigQuery using Python.

BigQuery Dec. 3, 2018

Import JSON into BigQuery with Google Cloud Functions - Using Google Cloud Functions to Import JSON into BigQuery.

BigQuery GCP Experience Dec. 3, 2018

Investing in Pandora’s Core Differentiators - Pandora's (music streaming service) experience with migration from on premise Hadoop to BigQuery.

BigQuery Nov. 26, 2018

Plotting Ethereum Address Growth Chart in BigQuery - Solution to plot ethereum address growth chart in BigQuery.

BigQuery Machine Learning TensorFlow Nov. 26, 2018

GCP Machine Learning Face-off: BigQuery ML -vs- Custom Estimators in TensorFlow - Article compares two different Machine Learning solutions on Google Cloud.

BigQuery Nov. 26, 2018

Using BigQuery as a data warehouse in B2B startup - Video recorded at DevFest Ukraine 2018.

BigQuery Machine Learning Nov. 26, 2018

Machine learning on machines: building a model to evaluate CPU performance - Training machine learning model to predict machine performance based on hardware and software specifications.

BigQuery Nov. 19, 2018

How to Query Balances for all Ethereum Addresses in BigQuery - Beta availability of transaction traces in GCP's public Ethereum dataset in BigQuery.

BigQuery Nov. 19, 2018

Data pipelines for everyone with CRMint - Automate BigQuery SQL queries with this elegant GCP pipeline application.

BigQuery Official Blog Nov. 5, 2018

Modern data warehousing with BigQuery: a Q&A with Engineering Director Jordan Tigani - Engineering Director Jordan Tigani to talk about the evolution of data warehousing, the current technology landscape, and how BigQuery fits in.

BigQuery Cloud Dataflow Oct. 29, 2018

How to transfer BigQuery tables between locations with Cloud Dataflow - Article explains process (with code sample) of copying data in BigQuery from one region to another

BigQuery Cloud Dataflow Oct. 29, 2018

Analyzing the Game of Baseball on GCP - Series of articles describing baseball data analysis using producs on Google Cloud Platform

BigQuery Business Oct. 22, 2018

Google's BigQuery Brings GIS Into The Petascale Era - How BigQuery is making difference for big data analysis.

BigQuery GCP Experience Official Blog Oct. 15, 2018

How Traveloka built a Data Provisioning API on a BigQuery-based microservice architecture - Building a Data Provisioning API on a BigQuery-based microservice architecture.

BigQuery Official Blog Oct. 15, 2018

BigQuery arrives in the London region, with more regions to come - Rollout of new regions for BigQuery starting with London, with more regions to follow in the coming months.

BigQuery Machine Learning Official Blog Oct. 15, 2018

What’s happening in BigQuery: a new ingest format, data type updates, ML, and query scheduling - New features in beta, including query scheduling, new BigQuery ML models and functions, and geospatial types and queries.

BigQuery Oct. 15, 2018

Benchmarking Google BigQuery at Scale - Benchmarking against BigQuery and migrating Data Warehouse to BigQuery on Google Cloud.

Beginner BigQuery Oct. 15, 2018

How BigQuery GIS scales up your geospatial projects - Overview of BigQuery GIS

BigQuery Oct. 8, 2018

BigQuery ML + Tableau - Using BigQuery ML and Tableau for dynamic model predictions.

BigQuery Oct. 8, 2018

Identifying Spammy ERC20 Transfers - How to identify Spammy ERC20 Transfers using BigQuery dataset.

BigQuery Cloud Composer Official Blog Oct. 8, 2018

How to transfer BigQuery tables between locations with Cloud Composer - How to create and run an Apache Airflow workflow in Cloud Composer.

BigQuery Official Blog Oct. 8, 2018

BigQuery and surrogate keys: a practical approach - Importance of surrogate keys and ways to define them.

BigQuery Official Blog Python Sept. 24, 2018

Ibis and BigQuery: scalable analytics with the comfort of Python - How Ibis works with BigQuery to provide an elegant and flexible Python interface for composing SQL queries.

Apache Beam BigQuery Cloud Dataflow Sept. 24, 2018

Micro-batching with Apache Beam and BigQuery - Explore option for overcoming BigQuery limit whilst still being able to import your data in a timely fashion.

BigQuery Google Kubernetes Engine Sept. 24, 2018

Data Lake API on Microservice Architecture using BigQuery - How Traveloka created solution to deliver data for business (Data Lake API) using GCP.

BigQuery Cloud Composer Sept. 17, 2018

Ethereum in BigQuery: how we built this dataset - Overview of how architecture behind BigQuery Ethereum Public Dataset is designed.

BigQuery Sept. 17, 2018

BigQuery: level up your queries with these advanced tricks - Exploring some of BigQuery features using public dataset for Metropolitan Museum of Art of New York.

BigQuery Cloud Functions Cloud Storage Tutorial Sept. 17, 2018

Loading Data Into BigQuery With Cloud Functions - Setting up Cloud Functions to upload file to BigQuery when file is uploaded to Cloud Storage.

BigQuery Sept. 17, 2018

Introduction to BigQuery Geographic Information Systems (GIS) - BigQuery GIS allows you to analyze and visualize geospatial data in BigQuery by using geography data types and standard SQL geography functions.

BigQuery GCP Experience Sept. 17, 2018

Moving to BigQuery — Data at our Fingertips - Description of migrating to BigQuery for hike.in (chat app).

Advanced BigQuery Data Studio Security Sept. 10, 2018

Share Data with Confidence: Cell-level Access Controls in BigQuery and Data Studio - Cell-level Access Controls in BigQuery and Data Studio.

BigQuery Cloud Storage Sept. 10, 2018

Nerdy McJumpyface — analyzing the jump shot - Flow of that raw data from Google Cloud Storage into a more manageable one-entry-per-shot state in BigQuery.

BigQuery Machine Learning Sept. 10, 2018

Prototyping a ML Model for Employee Turnover with Google BigQuery ML - Using Google BigQuery ML and Kaggle dataset for HR turnover data.

BigQuery Official Blog Sept. 3, 2018

Using BigQuery ML and BigQuery GIS together to predict NYC taxi trip cost - Building a machine learning model using BigQuery ML and use BigQuery’s support for spatial functions.

BigQuery Sept. 3, 2018

Ethereum in BigQuery: a Public Dataset for smart contract analytics - Ethereum dataset (transaction history) is available in BigQuery.

BigQuery Sept. 3, 2018

Date Partitioning and Table Clustering in Google BigQuery (and Looker PDTs) - Example on Date Partitioning and Table Clustering in Google BigQuery.

BigQuery Sept. 3, 2018

Using Google Datalab and BigQuery for Image Classification comparison - Using Google Datalab and BigQuery for image classification project.

BigQuery Sept. 1, 2018

Programmatic Patent Searches Using Google’s BigQuery & Public Patent Data - Patent Searches Using Google’s BigQuery & Public Patent Data.

BigQuery Aug. 27, 2018

Building Datawarehouse on Google Cloud Bigquery - Building Datawarehouse on Google Cloud Bigquery.

BigQuery Official Blog Aug. 20, 2018

What’s happening in BigQuery: integrated machine learning, maps, and more - New features that make BigQuery more performant and more cost effective.

BigQuery Aug. 20, 2018

How to do online prediction with BigQuery ML - How to pull out the necessary weights and scaling parameters from the training output tables and compute the prediction with BigQuery ML.

BigQuery Machine Learning Aug. 20, 2018

Predicting Taxi Fare Price With BigQuery ML - How BigQuery ML can be used to build liner regression model for taxi fare predictions with training 55M rows of data in 30 minutes.

BigQuery Cloud Dataflow Cloud Pub/Sub Python Aug. 13, 2018

Aggregated Audit Logging With Google Cloud and Python - Taking Apache2 server access logs from a web server, converting the log file line-by-line to JSON data, publishing that JSON data to a Google PubSub topic, transforming the data using Google DataFlow, and storing the resulting log file in Google BigQuery long-term storage.

BigQuery Aug. 13, 2018

Optimizing BigQuery: Cluster your tables - Clustering of tables in BigQuery explained in Wikipedia data set.

BigQuery Aug. 6, 2018

Configure BigQuery ODBC Driver On Linux - How to configure BigQuery ODBC driver on Linux.

BigQuery Aug. 6, 2018

Tips for using BigQuery in the enterprise - Tips for using BigQuery in the enterprise.

BigQuery Google Cloud Platform Python Aug. 6, 2018

Aggregated Audit Logging with Google Cloud and Python - Aggregating all of logs into Google BigQuery Audit Logs.

BigQuery Aug. 6, 2018

Performing large-scale mutations in BigQuery - Article explains why DML statement quotas are in place and goes through some approaches for accomplishing large scale mutations without going over DML quotas.

BigQuery Cloud Spanner Cloud SQL Official Blog July 30, 2018

On GCP, your database your way - New database features to get the most out of your databases for your business.

BigQuery Data Studio Official Blog July 30, 2018

Bridging the gap between data and insights - Number of updates for BigQuery , Data Studio Explorer, Cloud Composer and Dataproc that will make data analytics easier.

BigQuery Machine Learning July 30, 2018

Machine Learning in your Database? The Case For and Against BigQuery ML - Pros and Cons of BigQuery ML.

BigQuery GCP Experience July 30, 2018

How Buzzfeed democratised content analytics using BigQuery and Looker - How publisher Buzzfeed has rebuilt its analytics processes around BigQuery data warehouse and Looker dashboards for consumption by reporters and editors.

BigQuery Java July 23, 2018

Streaming data directly into BigQuery - Cost effective ways to streaming data directly into BigQuery.

Beginner BigQuery July 23, 2018

Google BigQuery — List all partitions in a partitioned table - Queries to list all partitions in a partitioned table in Google BigQuery.

BigQuery GCP Experience July 23, 2018

Streamlining predictive analytics in retail marketing - Online flash-sale retailer Zulily uses BigQuery and Tableau to help power its predictive analytics, which, in turn, boosts its marketing efforts and ability to manage incoming data.

BigQuery July 23, 2018

BigQuery Updates - BigQuery has (finally) new UI.

Apache Beam BigQuery Cloud Dataflow Official Blog July 16, 2018

Measuring patent claim breadth using Google Patents Public Datasets - Analysing Patent public dataset and building machine learning model using GCP products.

BigQuery July 9, 2018

Resolving Big Data Challenges: Why We Use BigQuery at Outfit7 - How gaming company Outfit7 is using BigQuery

BigQuery July 9, 2018

From BigQuery to Features - A look at under the hood of FIFA World Cup predictions.

BigQuery Data Studio July 2, 2018

The 2018 World Cup Visualized: All the Goals So Far - Visualization of goals from World Cup with BigQuery and Data Studio.

BigQuery July 2, 2018

BigQuery in June: a new data type, new data import formats, and finer cost controls - Monthly summary of important news: new data type, data format, enhancing DML.

BigQuery Python July 2, 2018

Google Search Console Data into Google BigQuery - Adapting an existing Python script to pull bulk data from Google Search Console into Google BigQuery.

BigQuery Cloud Datalab Cloud Dataprep July 2, 2018

Building a Personal Genome Data Warehouse with Google Cloud, 23andMe and Family Tree DNA - Using Cloud Dataprep to clenup DNA raw data and then import to BigQuery and analyzing in Cloud Datalab.

BigQuery Cloud Pub/Sub Compute Engine June 25, 2018

Infrastructure as Code with Terraform for Google Cloud - Using terraform for creating pubsub, compute engine and big-query resources in Google cloud.

BigQuery June 25, 2018

Visualising on-street parking in Melbourne with open data - Using BigQuery to prepare open data for visualization.

BigQuery Business GCP Experience June 18, 2018

Why Migrating your Data Warehouse to Google Big Query can be the Next Big Thing for your Enterprise? - What BigQuery is and examples of companies which have migrated their data to BigQuery.

BigQuery June 18, 2018

Manual partition tables in BigQuery - Partitions strategies in BigQuery.

BigQuery Dataflow Machine Learning June 18, 2018

Making World Cup Sausage with Cloud Dataflow and BigQuery - Making World Cup predictions with Cloud Dataflow and BigQuery.

BigQuery June 18, 2018

BigQuery Public Datasets - Why BigQuery public datasets are awesome.

BigQuery Cloud Dataflow Cloud Pub/Sub June 11, 2018

Serverless and realtime Data Analytics for a retailer on GCP - GCP customer journey from scale issues to serverless and from once a day refreshed dashboards to realtime analytics.

BigQuery Firebase June 11, 2018

Making sense of Google Analytics for Firebase BQ data - Querying data from Firebase in BigQuery.

BigQuery Machine Learning June 11, 2018

Explaining the joke: “Half the time when companies say they need ‘AI’, what they really need is a SELECT clause with a GROUP BY” - Deeper look at the claim.

BigQuery June 4, 2018

How to enable Pandas to access BigQuery from a service account - Using Pandas to run a query against BigQuery.

BigQuery Cloud Dataflow Kubernetes June 4, 2018

Say goodbye to Mixpanel. Meet Banias! - Banias is serverless event analytics pipeline based on Kubernetes, Apache Beam and Google BigQuery.

BigQuery Cloud Dataflow Cloud Pub/Sub June 4, 2018

Realtime Streaming Data Pipeline using Google Cloud Platform and Bokeh - Build a real-time streaming data pipeline and a simple dashboard to visualize the streaming data.

BigQuery Compute Engine May 14, 2018

Automatically Storing Tweets in BigQuery using Google’s Compute Engine and Twitter’s Search API - Storing Tweets in BigQuery using GCE and Twitter’s Search API.

BigQuery May 14, 2018

3 Step Setup Guide To Activating A Google BigQuery Data Warehouse Destination - Simple and easy setup guide for activating Google BigQuery within your Openbridge account.

BigQuery NoSQL Official Blog Stackdriver May 14, 2018

Transform publicly available BigQuery data and Stackdriver logs into graph databases with Neo4j - GCP announced availability of Neo4j Enterprise VM solution and Test Drive on Google Cloud. Launcher.

AWS BigQuery May 7, 2018

FileZilla: 3 Simple Steps To Load Data to Google BigQuery, Amazon Redshift, Amazon Redshift Spectrum or Amazon Athena - Loading CSV files to Google BigQuery and AWS warehouses using FileZilla.

BigQuery May 7, 2018

The Missing Guide To Setting Up Google Cloud Service Accounts For Google BigQuery - Setting Up Google Cloud Service Accounts For Google BigQuery.

BigQuery Official Blog April 30, 2018

Accessing external (federated) data sources with BigQuery’s data access layer - Description of how to use data access layer in BigQuery without moving your data to a BigQuery dataset.

BigQuery Business April 30, 2018

Google’s BigQuery Gaining Steam As Cloud Warehouse Wars Heat Up - Overview of BigQuery in context of other cloud data warehouses.

BigQuery April 23, 2018

BigQuery arrives in the Tokyo region - Roll out for regional availability for BigQuery in Google Cloud’s Tokyo region.

BigQuery Cloud Dataflow Dataflow GCP Experience April 23, 2018

Traveloka’s journey to stream analytics on Google Cloud Platform - Traveloka recently migrated streaming data processing pipeline from a legacy architecture to a multi-cloud solution that includes the Google Cloud Platform (GCP) data analytics platform.

BigQuery April 23, 2018

BigQuery lazy data loading: DDL, DML, partitions, and half a trillion Wikipedia pageviews - Analyze a 4 terabyte dataset of Wikipedia pageviews with BigQuery.

Beginner BigQuery April 23, 2018

What BigQuery is and isn’t? - Explore basics of BigQuery.

BigQuery Data Studio April 23, 2018

Harnessing the power of Phish.AI, PhishTank, Google Big Query and Google Data Studio to analyze Phishing Trends - Using Big Query and Google Data Studio to analyze Phishing Trends from PhishTank which is community website collecting phishing data.

BigQuery Official Blog April 16, 2018

BigQuery lazy data loading: SQL data languages (DDL and DML), partitions, and half a trillion Wikipedia pageviews - Analyze a 4 terabyte dataset of Wikipedia pageviews with BigQuery.

BigQuery Data Studio April 16, 2018

BigQuery and Data Studio cost optimization - Cost optimization using Data Studio on BigQuery.

BigQuery April 16, 2018

BigQuery beyond SQL and JS: Running C and Rust code at scale - BigQuery running arbitrary C and Rust code.

BigQuery Cloud Datalab TensorFlow April 16, 2018

Predicting San Francisco Bikeshare availability with TensorFlow and LSTMs - Using Google Datalab, BigQuery, and TensorFlow to perform machine learning.

BigQuery April 16, 2018

Introducing column based partitioning in BigQuery - Explanation of column date partitioning in BigQuery.

BigQuery Dataflow April 9, 2018

Give meaning to 100 billion analytics events a day - Orchestrate Kafka, Dataflow and BigQuery together to ingest and transform a large stream of events.

BigQuery Cloud Dataflow Cloud Dataprep April 9, 2018

Oracle data to Google BigQuery using Google Cloud Dataflow and Dataprep - Load gigabytes or terabytes of data from Oracle into BigQuery using Google Cloud Dataflow and Dataprep relatively easy and very efficiently.

BigQuery Cloud Natural Language API Java April 9, 2018

Analyzing Twitter Location Data with Heron, Machine Learning, Google’s NLP, and BigQuery - Using different products from Google Cloud Platform to get insights from Twitter data.

BigQuery Dataflow Official Blog April 2, 2018

How Tokopedia modernized its data warehouse and analytics processes with BigQuery and Cloud Dataflow - Tokopedia is leading online marketplace in Indonesia, the article explores their modernization journey of data warehouse and analytics processes with BigQuery and Cloud Dataflow.

BigQuery Cloud Spanner Dataflow Google Kubernetes Engine Official Blog April 2, 2018

Architecting live NCAA predictions: from archives to insights - Article explores architecting NCAA real-time predictions, achieved through a few months of data ingestion, ETL, analysis, and modeling.

BigQuery Cloud Natural Language API April 2, 2018

Sentiment analysis with BigQuery and Google Cloud Natural Language - Making sense of community sentiment using Google Cloud’s Google Cloud Natural Language.

BigQuery Python April 2, 2018

Getting Started with Google BigQuery in Python — Part 1: Setting Up the Dev Environment - Setting Up the Dev Environment for using BigQuery in Python

BigQuery March 26, 2018

Deficit Reduction - Analysis of NCAA public dataset using BigQuery.

BigQuery GCP Experience March 19, 2018

The switch to self-service marketing analytics at zulily: best practices for using Tableau with BigQuery - Zulily is e-commerce company and shares experience of using Tableau with BigQuery.

BigQuery Machine Learning March 19, 2018

Deep Neural Network implemented in pure SQL over BigQuery - Fun project to test out the limits of SQL and BigQuery and to look at neural network training from a declarative data transformation perspective.

BigQuery GCP Experience Official Blog March 12, 2018

How Color uses the new Variant Transforms tool for breakthrough clinical data science with BigQuery - GCP Customer Story: Use of new Variant Transforms tool for breakthrough clinical data science with BigQuery.

BigQuery March 12, 2018

Leaf #0 — Top 13 Techniques for Google BigQuery Optimization - BigQuery best practices.

BigQuery GCP Experience March 12, 2018

TeamSnap: Supercharging digital marketing with Google BigQuery and Tableau - TeamSnap began using Google Analytics 360, which integrates with Google BigQuery, to provide a fully managed big data analysis service. TeamSnap analyzes the data using Tableau, which connects directly to Google BigQuery for fast analytics and helps the company share and collaborate on that information with self-service ease.

BigQuery March 12, 2018

Statistics for NCAA men’s and women's basketball back to 1894 - Fans of basketball can play with different stats about teams, games etc. in BigQuery.

BigQuery March 12, 2018

Loading Parquet Data from Google Cloud Storage to BigQeury - Parquet is an open source column-oriented data format that is widely used in the Apache Hadoop ecosystem.

BigQuery Cloud Datastore Feb. 26, 2018

Bigquery-to-datastore with homebrew - Homebrew library for bigquery-to-datastore utility.

BigQuery Firebase Feb. 19, 2018

From Firestore to BigQuery with Firebase Functions - Using Firebase functions to get data from Firestore into BigQuery.

BigQuery Feb. 19, 2018

Incremental MYSQL loads to BigQuery using Matillion - Using Matillion, an ETL to Incremental data sync from MYSQL to BigQuery.

BigQuery Official Blog Feb. 12, 2018

Bitcoin in BigQuery: blockchain analytics on public data - The Bitcoin blockchain data are now available for exploration with BigQuery. Learn about some interesting queries and analysis.

BigQuery Feb. 12, 2018

I/O of the Google BigQuery Execution - Learn about the internals of Google BigQuery, and how it executes and gives the super performance for the big data problems.

BigQuery Feb. 12, 2018

Creating and Using Partitioned Tables - Long awaited feature of BigQuery: partitioning by column (DATE or TIMESTAMP type) if currently in Beta.

BigQuery Official Blog Feb. 5, 2018

How to process weather satellite data in real-time in BigQuery - Example of processing weather satellite data in real-time in BigQuery. Data is from the GOES-16 geostationary satellite and is freely available on Google Cloud.

BigQuery Cloud Dataprep Feb. 5, 2018

Stream Twitter Data into BigQuery with Cloud Dataprep - Guide to use Cloud DataPrep, BigQuery to analyze data gathered from Twitter’s Streaming API.

BigQuery Tutorial Feb. 5, 2018

Learning to analyze huge BigQuery datasets using Python on Kaggle - Step by step tutorial to set Python's client library for BigQuery and use in notebook.

BigQuery Feb. 5, 2018

BigQuery performance tips: Searching for text 8x faster — “LOWER() is slower” - Example of how to speed up query and get same result.

BigQuery Cloud Functions Cloud Pub/Sub Cloud Storage Jan. 29, 2018

Carefully calculating Google Cloud Storage Buckets size with Cloud Functions & Pub/Sub - Find an easy way to analyze all of your Google Cloud Storage buckets sizes with just a few clicks using Pub/Sub, Cloud Functions and BigQuery.

BigQuery Data Studio Jan. 29, 2018

The best code is no code! Using Google Cloud’s new automated services - Digesting and analyzing data from Internet Service Provider.

BigQuery Jan. 22, 2018

Analyzing your BigQuery usage with Ocado Technology’s GCP Census - GCP Census is a tool that collects metadata about BigQuery tables and stores it back into BigQuery for analysis.

BigQuery Cloud Functions Cloud Storage Jan. 22, 2018

Scheduling BigQuery jobs using Cloud Storage and Cloud Functions - Trigger BigQuery jobs periodically with Cloud Storage and Cloud Functions.

BigQuery Cloud Dataprep Jan. 22, 2018

How to schedule a BigQuery ETL job with Dataprep - Running periodical job in BigQuery with Cloud Dataprep

BigQuery Cloud ML GCP Experience Jan. 15, 2018

Trash talk: How moving Apigee Sense to GCP reduced our “data litter” and decreased our costs - Apigee deployed several services to Google Cloud Platform (GCP). This article talks about benefits of moving Apigee Sense to GCP to use its advanced machine learning capabilities.

BigQuery Jan. 15, 2018

Using Google Cloud Platform to store and query 1.4 billion usernames and passwords - The article explains process of importing large dataset into BigQuery and how to get interesting insights from it.

BigQuery Cloud Pub/Sub Jan. 15, 2018

Writing a Pub/Sub Stream to BigQuery - Publishing tweets from Twitter's to Pub/Sub and then streaming to BigQuery.

BigQuery Cloud Dataprep TensorFlow Jan. 15, 2018

Analyzing Israeli weed market with Google Cloud DataPrep, BigQuery and TensorFlow - Getting, cleaning and analyzing data about marijuana sales with Google Cloud Platform products.

BigQuery Data Studio Tutorial Jan. 8, 2018

Analytics for RESTful interface - This article demonstrate an example project on how to track each request to our RESTful API, analyze and visualize the data in Googles DataStudio Reports.

BigQuery Python Jan. 8, 2018

pandas-gbq Version 0.3.0 - Quick note on pandas-gbq Version 0.3.0

BigQuery Docker Tutorial Jan. 1, 2018

Stop Worrying & Face Facts: You Can Do Data Pipelines Like A Boss With Speedy Google BigQuery Platform - Step by step tutorial to create service for BigQuery tasks.

BigQuery Dec. 25, 2017

Busting 12 myths about BigQuery - Explaining some myths about BigQuery from originated from enterprise customers.

BigQuery Dec. 18, 2017

One year with BigQuery - Thoughts about BigQuery after using it for one year.

BigQuery Dec. 18, 2017

What Is Google BigQuery — Eye Popping Features, Scary Fast, Friendly Pricing and Does The Kessel Run In Less Than Twelve Parsecs - List of basic BigQuery features.

App Engine BigQuery Cloud Dataflow Cloud Dataproc GCP Experience Dec. 18, 2017

How We Implemented a Fully Serverless Recommender System Using GCP - In depth description with code samples of implementing recommendation (serverless) system on Google Cloud Platform.

Advanced App Engine BigQuery Cloud ML Machine Learning TensorFlow Dec. 18, 2017

Real-time forecasts in the cloud: from market feed capture to ML predictions - how to train a machine learning model to predict FX rates using TensorFlow in Google Cloud, with application components running as App Engine services and communicating with each other by publishing messages via Cloud Pub/Sub and by writing data into BigQuery.

BigQuery Dec. 18, 2017

State of npm scripts - Analyzing npm script from Github using BigQuery.

BigQuery Dec. 11, 2017

How to get real-time, actionable insights from your Fastly logs with Looker and BigQuery - Fastly, whose edge cloud platform offers content delivery, streaming, security and load-balancing, recently integrated its platform with Looker, a business intelligence tool. Using Google BigQuery as its analytics engine, you can use Fastly plus Looker to do things like improve your operations, analyze the effectiveness of marketing programs — even identify attack trends.

App Engine BigQuery Dec. 11, 2017

Drawings in the Cloud: introducing the Quick, Draw! dataset - Read how Quick Draw was created, using Google Cloud Platform of course.

BigQuery Dec. 11, 2017

Building a Recursive BigQuery Mapper - The New York Times wrote a Go application that can do the job of replicating our data from Datastore into BigQuery orders of magnitude faster than alternative solutions. Using this system, they were able to achieve over 1.5 million streaming inserts per second.

BigQuery Dec. 4, 2017

Separation of storage and compute in BigQuery - In depth description of how BigQuery works.

BigQuery Dec. 4, 2017

How to take control of your BigQuery costs - Tips and tricks how to control costs when using BigQuery.

Apache Beam BigQuery Dec. 4, 2017

Japanese tokenizer for BigQuery in Apache Beam - Approach to analyze Japanese text on BigQuery.

BigQuery Nov. 27, 2017

BigQuery UI Alpha launched, but is it what we've been waiting for? - Reflection on new BigQuery UI (currently in private testing).

BigQuery Cloud Dataflow Cloud Storage Nov. 27, 2017

Scheduling tasks on Google cloud platform - Examining different possibilities to schedule batch jobs on Google Cloud Platform.

BigQuery Data Studio Nov. 20, 2017

Monitor and manage your costs with Cloud Platform billing export to BigQuery - Article explains how to export billing data from Google Cloud Platform account to BigQuery and visualize in Data Studio

BigQuery Cloud SQL Nov. 20, 2017

Importing data from PostgreSQL to Google BigQuery - Article demonstrates exporting PostgreSQL data to BigQuery.

BigQuery Cloud Dataflow Nov. 20, 2017

Using Apache Beam and Cloud Dataflow to integrate SAP HANA and BigQuery - Leveraging both SAP HANA and BigQuery for analytics needs, synced with Cloud Dataflow.

BigQuery Nov. 20, 2017

Announcing BigQuery Data Transfer Service general availability - Service which transfers data from SaaS platforms like AdWords, Youtube to BigQuery is Generally Available.

BigQuery Nov. 20, 2017

BigQuery with Jordan Tigani

BigQuery Cloud Dataflow Nov. 20, 2017

How-To: Loading Eloqua Activity Data in to Google BigQuery - Article and github repository provides example how to import data from Eloqua into BigQuery via Dataflow.

BigQuery Nov. 13, 2017

Visualizing BigQuery jobs with Stackdriver, Cloud Functions, Firebase and Pub/Sub - Simple command-line utility as well as web application to let you view the currently running queries as well as some of the history.

BigQuery Nov. 6, 2017

Streaming with Redis — BigQuery - Demonstrating BigQuery streaming capability with pulling data from Redis.

BigQuery Nov. 6, 2017

Patch and Update Table — BigQuery - Article shows example of updating BigQuery table with Python script.

BigQuery Nov. 6, 2017

Scheduling Bigquery jobs using google apps script - Using Google Apps scripting in Spreadsheets, it's possible to run queries on BigQuery in specific time.

BigQuery Nov. 6, 2017

Google Patents Public Datasets: connecting public, paid, and private patent data - In BigQuery dataset, there are 90 million patent publications.

BigQuery Cloud Storage Data Studio Oct. 30, 2017

How I Created a Better Google Analytics in 3 Hours - Creating user website tracking analytics using Google Cloud Platform.

BigQuery Oct. 30, 2017

Data Warehouse in Google Cloud - GDG DevFest Ukraine 2017

BigQuery Oct. 30, 2017

Who contributed the most to open source in 2017? - Analyzing Github data with BigQuery to get the answer

BigQuery Oct. 30, 2017

Creating custom interactive dashboards with Bokeh and BigQuery - Bokeh is a Python interactive visualization library that targets modern web browsers for presentation. In tutorial, data from BigQuery is displayed on web application deployed on Google Container Engine.

BigQuery Cloud Dataflow Oct. 30, 2017

Big Data Processing at Spotify: The Road to Scio (Part 2) - Description of Scala wrapper for Apache Beam Java SDK created in Spotify.

BigQuery Oct. 30, 2017

Get to know your trees: US Forest Service (FIA) dataset now available in BigQuery - Dataset from the US Forest Service (USFS) Forest Inventory and Analysis (FIA) program (ongoing forest measurement program that provides a nationwide inventory of the forest resources in the United States and its territories) is publicly available in BigQuery.

BigQuery Cloud Datastore Oct. 30, 2017

Airflow meets bigquery-to-datastore - Using Apache Airflow to export data from BigQuery do Datastore.

BigQuery Cloud IoT Data Studio Firebase IoT Oct. 23, 2017

Build a Weather Station using Google Cloud IoT Core and MongooseOS - Building end to end prototype of weather station using Google Cloud Platform.

BigQuery Oct. 23, 2017

Accelerate BigQuery solution development with intelligent log analysis - With Stackdriver it's possible to see BigQuery errors by creating a logs based metric for the error which we want to detect, then set up alerts.

BigQuery Cloud Dataflow Oct. 16, 2017

Separation of compute and state in Google BigQuery and Cloud Dataflow (and why it matters) - Article explain in depth why seperation of state and compute improves speed of big data processing.

BigQuery Oct. 16, 2017

Redshift versus Snowflake versus BigQuery / Part 1: Performance - Benchmarking speed and cost of 3 datawarehouses.

BigQuery Oct. 16, 2017

Export & Load Job with MongoDB — BigQuery Part - Step by step instructions to export data from MongoDB to BigQuery.

BigQuery Sept. 25, 2017

Streaming Google Analytics Data for BigQuery - Data from Google Analytics can be now streamed every 10 minutes to BigQuery

BigQuery Sept. 25, 2017

Getting Started Accessing the HTTP Archive with BigQuery - Starting with BigQuery by analyzing http archive (public dataset)

BigQuery Sept. 25, 2017

Twitter Analytics (Part 1) - Streaming data from Twitter into BigQuery

BigQuery Sept. 18, 2017

GCP Podcast - Have you ever wanted to know what powers BigQuery under the hood?

BigQuery Cloud Dataflow Cloud Datastore Sept. 18, 2017

Export BigQuery to Google Datastore with Apache Beam/Google Dataflow

BigQuery Sept. 18, 2017

BigQuery: Managed storage for analytics - @Scale conference 2017, Jordan Tigani, Software Engineer, Google

BigQuery Sept. 11, 2017

How to crunch your business data from Sheets in BigQuery - Example how BigQuery can query Google Sheets just like any other table.

BigQuery Cloud ML Machine Learning TensorFlow Sept. 4, 2017

How to predict your Google Cloud Platform monthly bill with Google CloudML & BigQuery - Creating billing prediction system with BigQuery, TensorFlow and Cloud ML

BigQuery Sept. 4, 2017

Codelab: Querying and Visualising Location Data in BigQuery using Google Maps API - In this codelab, you'll write and run some queries that demonstrate how to provide location based insights into very large public datasets using BigQuery. You'll also build a web page that loads a map using the Google Maps JavaScript API, and that runs and visualizes spatial queries against the same very large public datasets using the Google APIs Client Library for Javascript, and the BigQuery API.

BigQuery Aug. 28, 2017

From data to insights: Preview a new Google Cloud training course for SQL analytics - Preview of content of course: From Data to Insights with Google Cloud Platform

BigQuery Windows Aug. 28, 2017

Guide to using Google BigQuery on Microsoft PowerShell - run BigQuery commands & queries straight from Windows PowerShell

BigQuery Cloud Storage Aug. 20, 2017

How to analyze Fastly real-time streaming logs with BigQuery - Fastly offers cloud, content delivery and now logs from Fastly can be streamed to Google Cloud Storage or BigQuery

BigQuery Aug. 20, 2017

How was Game Of Thrones S07 E05? Tweet Analysis with Kafka, BigQuery and Tableau - Analyzing data from Twitter regarding Game of Thrones using Tableau and BigQuery

BigQuery Cloud Dataflow Cloud Pub/Sub Aug. 20, 2017

How we saved over $240K per year by replacing Mixpanel with BigQuery, Dataflow & Kubernetes - Description how to use Google Cloud Platform Products to replace Mixpanel (Analytics for web / mobile)

BigQuery Aug. 20, 2017

BigQuery: Required Reading List - Tino Tereshko from Google put list of articles regarding BigQuery

BigQuery Aug. 14, 2017

When art meets big data: Analyzing 200,000 items from The Met collection in BigQuery - Analyzing meta data about items from The Metropolitan Museum of Art

BigQuery Data Studio Aug. 7, 2017

The most famous reddit accounts (analyzed with BigQuery) - Analyzing Reddit content to get most influential Reddit users using BigQuery and displaying in Data Studio

BigQuery Cloud Dataflow Aug. 7, 2017

Life of a Cloud Dataflow service-based shuffle - Shuffle implementation (currently in beta) is in the Cloud Dataflow SDK for Java version 2.0. In this post, it's explained and demonstrated the practical impact of the new shuffle on data pipelines using the Opinion Analysis project as an example.

BigQuery Cloud Dataflow Cloud Pub/Sub Aug. 7, 2017

Traveloka’s journey to stream analytics on Google Cloud Platform - Traveloka recently migrated this pipeline from a legacy architecture to a multi-cloud solution that includes the Google Cloud Platform (GCP) data analytics platform.

BigQuery Cloud Natural Language API Aug. 7, 2017

Using Google BigQuery, Google Cloud Natural Language API and Looker to Work-Out Exactly How Much Mail Online Readers Hate Me - Analyzing users comments of article using Natural Language API and displaying results in Locker.

BigQuery July 31, 2017

Leading with commas — ugly or efficient? An investigation over 320 GB of SQL code - How to analyze SQL queries files from Github and see if they use trailing or leading comma with BigQuery

BigQuery July 24, 2017

Google Cloud Platform for Data Scientists: Using R with Google BigQuery, Part 2 (storing and retrieving data frames) - How to create an R data frame and stash it in BigQuery and then access that data frame later from the BigQuery web interface and RStudio.

BigQuery July 17, 2017

The 12 Components of Google BigQuery - Overview of 12 BigQuery components (properties)

BigQuery July 17, 2017

Inside Google BigQuery - Overview of BigQuery properties

BigQuery July 17, 2017

How to aggregate data for BigQuery using Apache Airflow - Creating Airflow (workflow management framework that lets you programmatically create, schedule and monitor workflows using simple Python syntax) pipelines for BigQuery

BigQuery July 10, 2017

Counting uniques faster in BigQuery with HyperLogLog++

Big Data BigQuery June 26, 2017

The Google Data WareCity - Interesting and unique aspects of BigQuery’s data sharing capability

Big Data BigQuery June 26, 2017

GCE BigQuery vs AWS Redshift vs AWS Athena - Basic comparison on data loading and simple queries between Google BigQuery and Amazon Redshift and its cousin Athena.

BigQuery June 12, 2017

Analyzing Django requirement files on Gi - Getting insights about how Django is used in open source projects by analyzing Github data with BigQuery

BigQuery June 12, 2017

Analyzing Google Cloud Billing Data with Big Query - Step by step example with sample queries regarding costs analysis for Google Cloud Platform products and services with BigQuery

BigQuery Cloud Pub/Sub June 12, 2017

Infinite backup for Cloud Pub/Sub - Storing streaming data into BigQuery via Pub/Sub

BigQuery June 12, 2017

BigQuery, Looker And Big Data Analytics At Petabyte-Scale

BigQuery June 12, 2017

Google BigQuery, Large Table Joins and How Nested, Repeated Values and the Capacitor Storage Format (and Looker) Saves the Day - Example from BigQuery public data sets about how to structure data (by nesting) for efficient querying

BigQuery Business June 12, 2017

Think Economics -- Not Features -- When Evaluating Big Data Value - Using BigQuery instead Hadoop should save $$$ in long term

BigQuery June 12, 2017

Google + OpenAQ Team Up to Make Global Air Quality Data Easier to Access - Globally-aggregated data of air quality has now been added to the Google Cloud BigQuery Public Datasets program. For example, OpenAQ-aggregated data can be accessed, visualized and explored through Google Data Studio, or directly using Google

BigQuery Data Studio June 4, 2017

Visualize GCP Billing using BigQuery and Data Studio - Creating detailed billing reports of Google Cloud Platform with Data Studio

BigQuery June 4, 2017

Life of a BigQuery streaming insert - In depth article about how streaming inserts work in BigQuery

BigQuery Cloud Dataflow June 4, 2017

BigQuery partitioning with Beam streams - using TableReference functions

BigQuery Data Studio May 29, 2017

Analyze your Amazon Web Services (AWS) Bills w/Google BigQuery & Data Studio - Step by step tutorial about how to export billing data from AWS to GCP, load to BigQuery and display in Data Studio

BigQuery May 29, 2017

How To Make Learning Google Cloud and BigQuery Easy - Pre-built Docker Image With Google Cloud SDK and BigQuery goodness

BigQuery May 29, 2017

BigQuery now has 10 GB of free storage, and 1 TB of free monthly queries (try it today) - In free BigQuery tier is now included 10GB of data storage

BigQuery May 22, 2017

New healthcare and population datasets now available in Google BigQuery - RxNorm provides normalized names for clinical drugs and links its names to many of the drug vocabularies commonly used in pharmacy management and drug interaction software.

BigQuery Cloud Storage May 22, 2017

How to do serverless pixel tracking with GCP - One way to understand user behavior is by using pixels, small 1x1 transparent images embedded into the web property. When loaded, the pixel calls a web server that records the request parameters passed in the URL that can be processed later.

BigQuery May 15, 2017

Interpreting 23andme Raw Genome Data with Google Genomics and BigQuery

App Engine BigQuery Cloud Dataflow Cloud Pub/Sub May 15, 2017

Designing ETL architecture for a cloud-native data warehouse on Google Cloud Platform - Example of ETL process on Google Cloud Platform utilizing Dataflow, BigQuery, App Engine

BigQuery May 8, 2017

Let’s talk BigQuery - Short chat about BigQuery

BigQuery May 8, 2017

What BI Development Looks like with BigQuery, Google Cloud APIs, Looker and Fluentd - Examples of using BigQuery with BI tools

App Engine BigQuery May 1, 2017

How to build a BI dashboard using Google Data Studio and BigQuery - Use case for visualization of data from BigQuery with Google Data Studio

BigQuery May 1, 2017

Top 5 tips for migrating your data warehouse to Google BigQuery - Main points from article bellow Framework for migrating your data warehouse to Google BigQuery

BigQuery May 1, 2017

Framework for migration your data warehouse to Google BigQuery - Everything you need to know when migrating to BigQuery... 20 page description

BigQuery April 24, 2017

BigQuery — one store to rule them all - Description of BigQuery experience.

BigQuery April 24, 2017

Microservice Usage Logging with Openresty and Google BigQuery - Capturing number of transferred bytes in Nginx with Lua and storing data in BigQuery

BigQuery April 24, 2017

Why You Should Check Out BigQuery for Big Data - It's fast, it's easy, it's cheap, it's growing

BigQuery April 24, 2017

DNA Sequencing of 1000 Cannabis Strains publicly available in Google BigQuery - Applying standard bioinformatics analyses to newly sequenced Cannabis strains via Google BigQuery

BigQuery April 24, 2017

Whispers from the other side of the globe with BigQuery - Analyzing radio data with BigQuery

BigQuery April 24, 2017

Analyzing Big Data in less time with Google BigQuery

BigQuery April 24, 2017

Investigating Global Temperature Trends with BigQuery and Tableau - Digging through public database of climate observations with BigQuery and displaying with Tableau

BigQuery April 17, 2017

Fun with BigQuery and R — Building a Google Analytics Alternate - Short tutorial about how to start with BigQuery and R

BigQuery April 17, 2017

How to do cross-platform analytics with Google BigQuery - Namely Google Analytics 360 and Firebase Analytics

BigQuery April 17, 2017

The top GitHub projects per country - What is the most popular Github project in every country? You can find out by analyzing Github data with BigQuery

BigQuery April 17, 2017

Email Logs in BigQuery

Big Data BigQuery April 10, 2017

BI Performance Benchmarks with Google BigQuery

BigQuery April 10, 2017

How to Use BigQuery for Large-Scale SEO (Or Whenever Excel Fails) - Step by step tutorial about how to start with BigQuery and use it to analyse Google Analytics data

BigQuery April 3, 2017

Exploring 1.5 Billion NYC Taxi/Uber rides with LL Notebook and BigQuery - Nice visualizations of New York City taxi rides with BigQuery and LiquidLandscape

BigQuery April 3, 2017

Using Google’s BigQuery to Better Understand the Python Ecosystem - Analyzing Github data about Python with BigQuery

BigQuery April 3, 2017

How Ocado moved its databases to the cloud - "Since adopting the Google Cloud Platform, we’ve reduced storage costs to a tenth, increased our storage capacity over twenty times and improved performance by hundreds of times compared to our previous approach of hosting data on-premise" that's conclusion from Ocado

BigQuery Compute Engine Machine Learning March 27, 2017

Analyzing data with BigQuery and Machine Learning APIs (Forecast the Dutch elections based on social media presence) - Getting data from Twitter, using Translate API to translate from Dutch to English so that Natural Language API can be used. All with Javascript

BigQuery March 27, 2017

Big Data, BigQuery and a story of bikes - Analyzing bike rides via BigQuery

BigQuery Cloud SQL March 13, 2017

Alooma Provides Real-Time Data Pipelines to Google Cloud SQL and BigQuery

Big Data BigQuery PubSub March 6, 2017

Combining Thomson Reuters data with Google BigQuery and Google Cloud Pub/Sub API - Proof of concept to analyze data with BigQuery ingested from Reuters API

BigQuery March 6, 2017

Visitor Acquisition, Retention, and Attrition, Using BigQuery and a Simple Data Model - In depth article which explains how BigQuery can be used to analyze data from Google Analytics namely visitor acquisition, retention, attrition Export of results to Google Sheets to use it's functionality for further analysis

BigQuery Feb. 27, 2017

The Rise and Fall of New York City (311 complaints) - Lots of interesting insights with New York open data

BigQuery Feb. 27, 2017

The top weekend programming languages — based on GitHub’s activity - Playing with BigQuery and Stackoverflow data

BigQuery Dataflow Kubernetes Feb. 27, 2017

Adding machine learning to a serverless data analysis pipeline - When you put together Pub/Sub, Kubernetes, Dataflow, BigQuery you get serverless data analysis pipeline

BigQuery Feb. 27, 2017

BigQuery, Looker and Big Data’s Rediscovery of Data Warehousing and Semantic Models … at Google Scale

BigQuery Cloud Functions Python

Turning GA360 BigQuery exports into partitioned tables using Cloud Functions - Article describes how to create a cloud function that will copy a BigQuery GA360 data export to another BigQuery table.

BigQuery Official Blog

Finding data insights faster with BigQuery and GCP Marketplace solutions - GCP Marketplace offers other options to get data into BigQuery.

BigQuery Official Blog

Introducing six new cryptocurrencies in BigQuery Public Datasets—and how to analyze them - The six cryptocurrency blockchain datasets now available for Bitcoin Cash, Dash, Dogecoin, Ethereum Classic, Litecoin, and Zcash.

BigQuery Data Analytics Official Blog

What’s happening in BigQuery: New persistent user-defined functions, increased concurrency limits, GIS and encryption functions, and more - List of most recent releases and updates regarding BigQuery.

 

Latest Issues




Contact

Zdenko Hrček
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: zdenko@gcpweekly.com