Tag: Data Analytics

Data Analytics Official Blog July 27, 2020

Migrate and modernize your on-prem data lake with managed Kafka - Make sure your data lake is working for your business and see how to use tools like Apache Kafka to migrate from on-prem.

BigQuery Data Analytics Official Blog Teradata July 20, 2020

Use IAM custom roles to manage access to your BigQuery data warehouse - When you’re migrating your data warehouse from Teradata to BigQuery, pay attention to mapping user permissions using identity and access management tools.

Data Analytics Looker Official Blog July 20, 2020

Getting to know Looker – common use cases - Business intelligence (BI) tool Looker can help your cloud data work better for you with dashboards, visualizations, data modeling, and more.

AWS BigQuery Data Analytics Official Blog July 20, 2020

Bringing multi-cloud analytics to your data with BigQuery Omni - BigQuery Omni, powered by Anthos, lets you analyze data in Google Cloud, as well as AWS and Azure (coming soon). It’s multi-cloud data analytics for the modern age.

BigQuery Data Analytics Official Blog July 13, 2020

Enhancing multi-cloud data governance on Google Cloud - Good data governance practices are essential for cloud computing. See how Google Cloud’s BigQuery and Collibra work for multi-cloud data governance.

Cloud Dataproc Data Analytics Official Blog July 3, 2020

Presto optional component now available on Dataproc - The Presto query engine optional component is now available for Dataproc, Google Cloud’s fully managed Spark and Hadoop cluster service.

Data Analytics Official Blog July 3, 2020

Building a genomics analysis architecture with Hail, BigQuery, and Dataproc - Try a cloud architecture for creating large clusters for genomics analysis with BigQuery and Google-built healthcare tooling.

Data Analytics Official Blog July 3, 2020

Genomics analysis with Hail, BigQuery, and Dataproc - Try data analytics for genomics research in the cloud using BigQuery, Dataproc and Hail for fast large-scale research.

Cloud Dataproc Data Analytics Official Blog July 3, 2020

Dataproc Metastore: Fully managed Hive metastore now available for alpha testing - Dataproc Metastore is a fully managed open source Apache Hive metastore service, so you can easily build data lakes on Google Cloud.

Data Analytics GCP Experience Official Blog June 22, 2020

How Unity analyzes petabytes of data in BigQuery for reporting and ML initiatives - Learn how development platform Unity Technologies moved to BigQuery for a cloud data warehouse that enables ML and.

Cloud Dataproc Data Analytics Official Blog June 22, 2020

Introducing Spark 3 and Hadoop 3 on Dataproc image version 2.0 - Dataproc image version 2.0 is ready for testing, with Spark 3 and Hadoop 3 capabilities for open source data and analytics testing.

BigQuery Data Analytics Official Blog June 15, 2020

Introducing table-level access controls in BigQuery - Check out table-level access controls (ACLs) in cloud data warehouse BigQuery to share data more easily and help meet compliance.

Data Analytics Python June 8, 2020

How to automate financial data collection with Python using Tiingo API and Google Cloud Platform - A step-by-step tutorial for Python programmers looking to anayze stock prices and automate data collection through GCP.

Cloud Dataproc Data Analytics Jupyter Notebook Official Blog June 1, 2020

Combining the power of Apache Spark and AI Platform Notebooks with Dataproc Hub - Dataproc Hub: Administering Jupyter notebooks for Spark workloads on Dataproc.

AI Platform Notebooks Data Analytics Official Blog June 1, 2020

Google Cloud adds smart analytics frameworks for AI Platform Notebooks - Smart analytics notebooks is an enterprise notebook experience that extends the capabilities of the GCP Smart Analytics Platform.

Cloud Dataproc Data Analytics Official Blog June 1, 2020

Migrating Apache Hadoop clusters to Google Cloud - Moving on-premises Hadoop clusters can help your data analysts, data scientists, and more to work faster and more quickly in the cloud.

BigQuery Billing Data Analytics Official Blog June 1, 2020

Effectively using BigQuery Reservations - Cloud data warehouse BigQuery Reservations is a platform for cost and workload management.

BigQuery Billing Data Analytics Official Blog June 1, 2020

Optimize BigQuery costs with Flex Slots - Try Flex Slots in cloud data warehouse BigQuery to save costs when running jobs or workloads such as querying large tables.

BigQuery Billing Data Analytics Official Blog June 1, 2020

Choosing between BigQuery on-demand and flat rate pricing - Tips on using your BigQuery cloud data warehouse efficiently and saving costs with both on-demand and flat-rate pricing models.

Cloud Dataproc Data Analytics Official Blog May 25, 2020

Burst data lake processing to Dataproc using on-prem Hadoop data - Use Dataproc and Alluxio to burst workload processing to cloud from Hadoop on-prem data stores.

Billing Cloud Dataflow Data Analytics Official Blog May 25, 2020

Predicting the cost of a Dataflow job - Estimate the cost of batch and streaming analytics service jobs in Google Cloud’s Dataflow.

Cloud Composer Data Analytics Docker May 18, 2020

Get Started with Airflow + Google Cloud Platform + Docker - Setting up Airflow with Docker compose to connect to GCP.

BigQuery Data Analytics Official Blog May 11, 2020

Automating BigQuery exports to an email - Set up automated emails to export data from cloud data warehouse BigQuery, especially for regular queries or reports.

Data Analytics Official Blog May 11, 2020

Easy access to stream analytics with SQL, real-time AI, and more - Helping data engineers, ops teams access unified stream and batch data pipelines.

Cloud Composer Data Analytics Kubernetes May 11, 2020

Argo workflows as alternative to Cloud Composer - Using Argo Workflows on Kubernetes as an alternative for Cloud Composer.

BigQuery Data Analytics Data Studio Firebase Visualization May 11, 2020

How to make fast and convenient visualization in Data Studio based on BigQuery - Visualizing data in BigQuery from a Firebase app in Data Studio.

BigQuery Data Analytics Official Blog May 4, 2020

What’s happening in BigQuery: Efficient new views and Cloud AI integrations - Cloud data warehouse BigQuery now offers materialized views for improved query efficiency, plus new ML models and column-level security.

Data Analytics Official Blog May 4, 2020

Discover, understand and manage your data with Data Catalog, now GA - New cloud metadata management service available to discover, understand, and manage data from one interface for data discovery and more.

Billing Cloud Dataproc Data Analytics Official Blog May 4, 2020

Optimize Dataproc costs using VM machine type - Try optimizing big data clusters from Spark, Hadoop, and Presto with fully managed Dataproc. Choosing VMs wisely can save on Dataproc costs.

Billing Data Analytics Official Blog April 27, 2020

Best practices for optimizing your cloud costs - Following these best practices will help optimize your cloud costs to the needs of your business, so you can get through these unpredictable times.

Cloud Dataprep Cloud Functions Cloud Scheduler Data Analytics Data Studio Python April 27, 2020

Creation of an ETL in Google Cloud Platform for automated reporting - Learn how to create your own serverless and fully scalable ETL for automated reporting using PyTrends as an example.

Big Data Cloud Dataflow Data Analytics Official Blog April 20, 2020

Introducing Dataflow template to stream data to Splunk - Learn how to set up a streaming pipeline for Google Cloud data into Splunk Cloud or Enterprise with this new Pub/Sub to Splunk Dataflow template.

BigQuery Cloud Dataflow Data Analytics Official Blog April 13, 2020

How do I move data from MySQL to BigQuery? - See how to perform MySQL data migration to cloud with this change data capture (CDC) example. This helps move data into cloud data warehouse BigQuery.

Cloud Dataprep Data Analytics Official Blog April 13, 2020

New AI-driven features in Dataprep enhance the wrangling experience - Check out new AI-powered features in Cloud Dataprep from Trifacta to make your data wrangling experience easier.

Cloud Dataproc Data Analytics GPU Official Blog April 13, 2020

Machine learning with XGBoost gets faster with Dataproc on GPUs - Machine learning workloads can move a lot faster when run on GPUs vs. CPUs. See how to do it with NVIDIA, XGBoost and Dataproc for ML model building.

Big Data BigQuery Data Analytics Python April 13, 2020

Ibis: A Python Data Analysis Framework for Development and Production - An example of using Ibis (Python Data Analysis Productivity Framework) with BigQuery.

BigQuery Data Analytics Machine Learning Official Blog April 6, 2020

Filling the NCAA void: Using BigQuery to simulate March Madness - Check out how to simulate college basketball brackets with BigQuery and BigQuery ML, using ML predictions, in a year where March Madness isn’t happening.

BigQuery Data Analytics Official Blog April 6, 2020

Introducing BigQuery column-level security: new fine-grained access controls - Cloud data warehouse column-level security controls let you put policies on data classes for compliance reasons -- new in BigQuery.

BigQuery Data Analytics Official Blog Public Datasets April 6, 2020

COVID-19 public dataset program: Making data freely accessible for better public outcomes - Explore valuable data related to COVID-19 with free public datasets, available in Google Cloud’s BigQuery.

BigQuery Data Analytics Visualization April 6, 2020

Building a Custom Jira Reporting Solution with BigQuery, Stitch & Tableau - Using BigQuery as a data lake for Jira data and a source for visualization.

BigQuery Data Analytics Official Blog March 28, 2020

Loading geospatial data into BigQuery just got easier with FME - Load geospatial data into BigQuery using FME to load, transform, and ingest GIS file types for data analytics.

BigQuery Data Analytics March 28, 2020

10 tips for self-service analytics with Google BigQuery and Tableau - Tips and tricks when visualizing data from BigQuery in Tableau.

BigQuery Cloud Functions Data Analytics March 28, 2020

BigQuery + Cloud Functions: how to run your queries as soon as a new Google Analytics table is available - A step-by-step guide on how to make sure your tables, dashboards and data transfers are always up-to-date.

Data Analytics GCP Experience Official Blog March 23, 2020

Modernizing Twitter's ad engagement analytics platform - See how Twitter has modernized its ad engagement platform using Google Cloud to build data transformation pipelines to scale.

CI Cloud Data Fusion Data Analytics March 23, 2020

CI/CD and Change Management for Pipelines — Part 2 - Examples for extracting pipelines from CDF/CDAP and using GitHub as a repository for storing pipelines and related artifacts.

AWS BigQuery Data Analytics Official Blog March 16, 2020

Modern analytics made easy with new Redshift, S3 migration tools - Data warehouse migrations to Google Cloud’s BigQuery are now easier with new tools to move your Redshift and S3 workloads.

Anthos Cloud Marketplace Data Analytics Official Blog March 16, 2020

Get the Flink Operator for Kubernetes in Anthos on Marketplace - The open source Apache Flink for Kubernetes operator is now available in the Google Cloud Marketplace to deploy in your own cluster.

CI Cloud Data Fusion Data Analytics DevOps March 16, 2020

CI/CD and Change Management for Pipelines — Part 1 - Process and steps to take in order to implement a CI/CD pipeline for CDAP (Cloud Data Fusion).

BigQuery Data Analytics March 16, 2020

How to query and calculate GA App + Web event data in BigQuery - In-depth of new Firebase Google Analytics way of measurement and how to use raw data in BigQuery.

BigQuery Data Analytics GCP Experience Official Blog March 9, 2020

Discord's migration from Redshift to BigQuery: lessons learned - Gaming app creator Discord moved from Amazon Redshift to Google Cloud BigQuery to eliminate downtime and scale faster.

BigQuery Data Analytics Official Blog March 9, 2020

DML without limits, now in BigQuery - Cloud data warehouse BigQuery removes all quota limits to support unlimited DML statements and make working with BigQuery tables easier.

BigQuery Data Analytics Official Blog March 2, 2020

BigQuery leads the way toward modern data analytics - BigQuery’s customer, partner, and analyst momentum is strong. The cloud data warehouse makes migration easy and brings data analytics to enterprises.

BigQuery Data Analytics Official Blog March 2, 2020

Introducing BigQuery Flex Slots for unparalleled flexibility and control - Cloud data warehouse BigQuery now offers Flex Slots, so you can buy analytics resources for short amounts of time to scale up and down quickly.

Data Analytics Official Blog Feb. 17, 2020

Taking a practical approach to BigQuery slot usage analysis - See how to understand slots in BigQuery, Google Cloud’s enterprise data warehouse, to keep an eye on resource usage.

Business Data Analytics Official Blog Feb. 17, 2020

Google completes Looker acquisition - We’re pleased to announce that Google has completed its acquisition of Looker. Together, we’ll support more businesses globally to address their most challenging data analytics and business intelligence needs.

Data Analytics Official Blog Feb. 17, 2020

Google Cloud named a Leader in the Forrester Wave: Data Management for Analytics - Google is a Leader in the Forrester Wave: Data Management for Analytics, the first time this category has existed. See why cloud data analytics at Google won praise.

BigQuery Data Analytics Official Blog Feb. 17, 2020

BigQuery under the hood: How zone assignments work - Get a look at the technical details of zone assignments in BigQuery, the cloud enterprise data warehouse.

Data Analytics GCP Certification Official Blog Feb. 17, 2020

Now updated: Our Data Engineering Learning Path - To address the evolving skill set today’s data engineers need, we updated our Data Engineering on Google Cloud Platform learning path.

Cloud Dataflow Data Analytics Official Blog Feb. 17, 2020

Bring 20/20 vision to your pipelines with enhanced monitoring - New observability features in cloud batch and stream data processing let Google Cloud users identify pipeline problems faster.

Cloud Data Fusion Data Analytics Official Blog Feb. 10, 2020

Building more secure data pipelines with Cloud Data Fusion - Building more secure ELT and ETL pipelines in the cloud can help protect your data. See how you can easily build integrated pipelines with Cloud Data Fusion.

Cloud Composer Data Analytics Official Blog Feb. 10, 2020

Scale your Composer environment together with your business - Write pipelines across on-prem data centers and cloud with Cloud Composer workflow orchestration service. See how to improve Cloud Composer performance.

BigQuery Data Analytics Firebase Feb. 10, 2020

Firebase Event Analytics with Google BigQuery - An extensive guide to help you get started with app analytics.

BigQuery Data Analytics Firebase Feb. 10, 2020

Free Product Analytics with Firebase + BigQuery + Rakam - Exporting Firebase Analytics to BigQuery and visualizing in Rakam

BigQuery Data Analytics Official Blog Feb. 3, 2020

10 top tips: Unleash your BigQuery superpowers - The BigQuery data warehouse offers a lot of analytics superpowers. Check out how you can take advantage of teleportation, time travel, and super speed.

Cloud Pub/Sub Data Analytics Official Blog Feb. 3, 2020

Exploring an Apache Kafka to Pub/Sub migration: Major considerations - Yes, it’s possible to migrate from Apache Kakfa to Google Cloud Pub/Sub.

BigQuery Data Analytics Official Blog Feb. 3, 2020

What’s happening in BigQuery: New federated queries, easier ML, and more metadata - An enterprise cloud data warehouse should be flexible and forward-looking. See new federated queries, better ML options and more metadata in BigQuery.

Data Analytics Official Blog Jan. 27, 2020

New GA Dataproc features extend data science and ML capabilities - Data scientists can now use features like autoscaling, notebooks, logging and monitoring, and attaching GPUs to clusters in cloud Dataproc.

BigQuery Data Analytics Jan. 20, 2020

Check-list: selecting the right data transformation service for Google BigQuery - List of products on Google Cloud Platform to use for moving data to BigQuery.

Data Analytics Official Blog Jan. 13, 2020

Exploratory data analysis, feature selection for better ML models - Before you start a machine learning project, you need clean, up-to-date data. Use exploratory data analysis (EDA) to help find ML success.

Cloud Dataproc Data Analytics Official Blog Jan. 6, 2020

Getting started with new table formats on Dataproc - You can now use table format projects Apache Iceberg and Delta Lake with Google Cloud’s Dataproc, built to run Hadoop systems in the cloud.

Big Data Data Analytics Official Blog Dec. 23, 2019

Opening doors, embracing change with cloud data warehouses - Cloud data warehouse migrations bring technology changes and new ways of working for data analysts and administrators. Change management is important.

Data Analytics Official Blog Dec. 23, 2019

Big data, big world: new NOAA datasets available on Google Cloud - Weather, climate and more datasets from NOAA are now available on Google Cloud. Explore atmospheric and other big data.

Data Analytics Official Blog Dec. 23, 2019

Year in review: smart analytics makes great strides - Cloud data analytics highlights from 2019 include data warehouse, streaming, and BI news. See how smart analytics at Google Cloud made strides.

Big Data BigQuery Cloud Dataflow Data Analytics Official Blog Dec. 16, 2019

Using HLL++ to speed up count-distinct in massive datasets - There’s a better way to do the count distinct function using Google’s HyperLogLog++ algorithm in Dataflow and BigQuery.

BigQuery Data Analytics Official Blog Dec. 16, 2019

New climate model data now in Google Public Datasets - Explore new climate model data in Google Cloud’s public dataset program. Climate model datasets include details and simulations.

BigQuery Data Analytics Dec. 16, 2019

Analyzing BigQuery Public Datasets - Analyzing Motor Vehicle Collision BigQuery Public Dataset.

Data Analytics Official Blog Dec. 9, 2019

Simplified data transformations for machine learning in BigQuery - New features in BigQuery ML do the work of cleansing data, with data transformation and preprocessing now available to help you build models faster.

Data Analytics Official Blog Dec. 9, 2019

Announcing the GA of Data Fusion, the bridge to data analytics - Cloud Data Fusion is a data integration and ingestion service that lets you build ETL and ELT pipelines.

Cloud Dataflow Data Analytics Official Blog Nov. 25, 2019

Streaming analytics now simpler, more cost-effective in Cloud Dataflow - Cloud streaming data analytics is now easier and more cost-effective with Streaming SQL and FlexRS in Cloud Dataflow.

BigQuery Data Analytics Official Blog Nov. 25, 2019

Achieve peace of mind with BigQuery pricing and control - Flexibility and easier planning for data warehousing costs arrive with BigQuery Reservations.

BigQuery Data Analytics Nov. 25, 2019

A Journey into BigQuery Fuzzy Matching — 4 of [1, ∞) — A Tribute to FuzzyWuzzy - Implementing and using Fuzzy matching in BigQuery.

Data Analytics Official Blog Nov. 18, 2019

Leave manual cluster resizing behind with Cloud Dataproc’s autoscaling - New autoscaling capabilities help cluster admins right-size their clusters for data analytics projects and deal with traffic spikes.

Apache Beam Cloud Dataflow Data Analytics Official Blog Python Nov. 11, 2019

Introducing Python 3, Python streaming support from Cloud Dataflow - Python 3, support for Python streaming is now available for data processing with Cloud Dataflow.

BigQuery Data Analytics Official Blog Nov. 11, 2019

Command and control now easier in BigQuery with scripting and stored procedures - Scripting and stored procedures are now available in BigQuery to make queries and tasks easier to execute.

BigQuery Data Analytics Nov. 11, 2019

Analysis of Google Political Ads using BigQuery - Analyzing Google Political Ads public data source in BigQuery.

BigQuery Data Analytics Official Blog Nov. 4, 2019

Show off your BigQuery ML and Kaggle skills: Competition open now - Show off your BigQuery ML and Kaggle skills: Competition open now.

Cloud Composer Cloud Dataprep Data Analytics Official Blog Nov. 4, 2019

How to orchestrate Cloud Dataprep jobs using Cloud Composer - Integrate your data analytics prep tools with orchestration services in the cloud, like Cloud Dataprep and Cloud Composer.

AI Data Analytics Machine Learning Official Blog Oct. 28, 2019

Updates make Cloud AI platform faster and more flexible - Improvements in AI Platform provide more flexibility to ML teams looking to optimize their workloads for cost and performance.

Cloud Dataflow Data Analytics Official Blog Oct. 28, 2019

Is your pipeline fine? Managing and monitoring a Cloud Dataflow setup - Qubit discusses how it manages its Cloud Dataflow real-time streaming pipeline on Google Cloud.

Cloud Dataflow Data Analytics Official Blog Security Oct. 28, 2019

Keeping your Cloud Dataflow pipelines safe with customer-managed encryption keys - Protect your data analytics pipelines with customer-managed encryption keys, new for Cloud Dataflow from Google Cloud.

Data Analytics Official Blog Oct. 28, 2019

Bringing Teradata Vantage to Google Cloud - Beginning next year, customers will be able to run Teradata’s cloud analytics platform, Vantage, on Google Cloud Platform.

BigQuery Data Analytics Official Blog Oct. 21, 2019

New geospatial data comes to BigQuery public datasets with CARTO collaboration - Data analytics on public datasets from CARTO and BigQuery.

BigQuery Data Analytics Official Blog Oct. 21, 2019

Grafana and BigQuery: Together at last - Visualizing data from BigQuery in Grafana.

BigQuery Data Analytics Oct. 21, 2019

How to instantly recover a table in Google BigQuery - If you need to Ctrl-Z (undo) in BigQuery after something went wrong, here are a couple of ways to get your data back.

Data Analytics GCP Experience Official Blog Oct. 14, 2019

S4 Agtech picks Google Cloud to transform agricultural risk management - See how S4 Agtech is using Google Cloud to speed up data analytics for farmers to improve crop yields and other agricultural innovations.

BigQuery Data Analytics Official Blog Oct. 6, 2019

How to manage BigQuery flat-rate slots within a project - Learn how to manage slots when using BigQuery’s flat-rate pricing, so you can run queries specific to applications within the same project.

BigQuery Data Analytics Official Blog Oct. 6, 2019

What’s the weather like? Using Colab to get more out of BigQuery - Use BigQuery and Colab, plus Python, to explore weather datasets to make data science predictions.

BigQuery Data Analytics Oct. 6, 2019

Multi-Session & Multi-Channel Funnel Reporting in Google Analytics BigQuery - Using data from Google Analytics API in BigQuery.

Data Analytics Official Blog Sept. 30, 2019

Data warehouse migration challenges and how to meet them - Moving legacy data warehouse to cloud can bring challenges. Here are some tips to make the data warehouse cloud migration process easier.

Data Analytics GCP Experience Official Blog Sept. 30, 2019

Adopting cloud, with new inventions along the way, charges up HSBC - Learn how moving their legacy data warehouse to BigQuery and using custom-built tools and an automation-first approach allowed HSBC to make huge leaps in data analytics capabilities and ensure high-fidelity data.

Data Analytics Machine Learning Official Blog Sept. 30, 2019

Building ML models for everyone: understanding fairness in machine learning - The article explains why implementing ML fairness into an ML workflow is so important, and goes through tools and techniques to get started.

BigQuery Data Analytics Official Blog Sept. 30, 2019

Cost optimization best practices for BigQuery - Find tips to optimize your BigQuery data warehouse costs so you’re getting the most for your business under budget.

Data Analytics Google Cloud Platform Official Blog Sept. 30, 2019

Google Cloud named a leader in the Forrester Wave: Streaming Analytics - Google Cloud has been named a Leader in The Forrester Wave: Streaming Analytics Q3 2019. See why Cloud Pub/Sub and Cloud Dataflow scored high marks.

Data Analytics Official Blog Sept. 23, 2019

Moving a publishing workflow to BigQuery for new data insights - Using BigQuery from Google Cloud can help streamline an internal process, like web publishing, to get better data insights faster.

BigQuery Data Analytics Sept. 23, 2019

Using MySQL as a Cache Layer for BigQuery - Using MySQL as a cahing layer BigQuery in Cube.js, open-source analytics framework.

BigQuery Data Analytics Official Blog Sept. 16, 2019

Quantum Metric gets answers from customer data at light speed

Business Data Analytics GCP Experience Official Blog Sept. 16, 2019

Architecting data pipelines at Universe.com puts customer experience on center stage

Cloud Dataproc Data Analytics Google Kubernetes Engine Official Blog Sept. 16, 2019

Cloud Dataproc Spark Jobs on GKE: How to get started - Cloud Dataproc offers alpha access to Spark jobs on Google Kubernetes Engine (GKE) for data analytics with speed and scale.

Cloud Dataproc Data Analytics Google Kubernetes Engine Official Blog Sept. 16, 2019

Modernize Apache Spark with Cloud Dataproc on Kubernetes - Alpha availability of Cloud Dataproc for Kubernetes.

BigQuery Cloud Dataprep Data Analytics Data Studio Sept. 9, 2019

Understanding Self-Service Analytics on BigQuery with Cloud Dataprep - Using Google Cloud products for analytics.

Data Analytics Official Blog Sept. 2, 2019

New release of Cloud Storage Connector for Hadoop: Improving performance, throughput and more - The latest release of the Google Cloud Storage Connector for Hadoop makes it even easier to substitute your HDFS with Cloud Storage for high performance.

BigQuery Data Analytics Official Blog Sept. 2, 2019

Expanding your patent set with ML and BigQuery - You can use BigQuery and Python to perform faster patent landscaping.

BigQuery Data Analytics Official Blog Sept. 2, 2019

What’s happening in BigQuery: Adding speed and flexibility with 10x streaming quota, Cloud SQL federation and more - The latest updates for Google Cloud’s BigQuery data warehouse include a streaming quota increase, automatic re-clustering, and lots more features.

BigQuery Data Analytics Official Blog Aug. 26, 2019

Skip the maintenance, speed up queries with BigQuery's clustering - Google Cloud’s BigQuery data warehouse automates tasks and maintenance. Here’s how automatic re-clustering works to save you time.

Data Analytics Official Blog Aug. 26, 2019

Analyzing GCP costs using folders and BigQuery Billing export - Check out how to get your Google Cloud billing data into BigQuery using folders and Billing export for comprehensive spending reports.

Data Analytics Official Blog Aug. 26, 2019

5 reasons your legacy data warehouse won’t cut it - Legacy data warehouses are expensive and hard to maintain. Here are 5 reasons they aren’t cutting it, and why migrating to the cloud opens up lots of possibilities.

BigQuery Data Analytics Official Blog Aug. 26, 2019

Introducing the BigQuery Terraform module - The BigQuery module for Terraform brings an open-source data analytics option, so you can automate instantiation and deployment of BigQuery datasets and tables.

BigQuery Data Analytics Official Blog Aug. 26, 2019

Skip the heavy lifting: Moving Redshift to BigQuery easily - Moving data from AWS S3 into Google Cloud’s BigQuery data warehouse is now easier with a new data transfer service.

Data Analytics GCP Experience Official Blog Aug. 19, 2019

GlideFinder: How we built a platform on Google Cloud that can monitor wildfires - Dmitry Kryuk, founder and CTO of GlideFinder, shares how they built a platform that can locate wildfires, alert subscribers, and provide analytics that can help prevent or contain wildfires in a timely manner.

Cloud Spanner Data Analytics Aug. 19, 2019

How to connect Tableau to Google Cloud Spanner - The article describes how to connect Tableau with Cloud Spanner.

BigQuery Cloud Functions Data Analytics Official Blog Aug. 12, 2019

Streaming data from Cloud Storage into BigQuery using Cloud Functions - See how to move stored data easily into BigQuery from Google Cloud Storage using Cloud Functions to build a pipeline.

Big Data BigQuery Data Analytics Official Blog Aug. 12, 2019

Migrating Teradata and other data warehouses to BigQuery - Migration framework and architecture when moving data warehouse, like Teradata, to Google Cloud BigQuery.

BigQuery Data Analytics July 29, 2019

How to query and calculate Google Analytics data in BigQuery - Examples of BigQuery queries to analyze Google Analytics data.

BigQuery Data Analytics Machine Learning Official Blog July 29, 2019

How to use BigQuery ML for anomaly detection - Step by step tutorial which demonstrates how to use BigQuery ML to perform unsupervised anomaly detection.

Cloud Datalab Data Analytics Machine Learning July 29, 2019

Analyzing Financial Time Series Using BigQuery and Cloud Datalab - This solution illustrates the power and utility of BigQuery and Cloud Datalab as tools for quantitative analysis.

Big Data Data Analytics Machine Learning July 29, 2019

Beginners Introduction to Data Lifecycle on Google Cloud Platform - Description of 4 categories of data lifecycle on GCP.

AI Platform Notebooks Cloud Deployment Manager Data Analytics July 29, 2019

Automating AI Platform Notebook Instance Creation With GCP Deployment Manager - Creating Deep Learning Notebook VM with Deployment Manager.

BigQuery Data Analytics July 22, 2019

Building an analytics stack - Process of creating analytics solution on GCP.

BigQuery Data Analytics Official Blog July 15, 2019

Goodbye Hadoop. Building a streaming data processing pipeline on Google Cloud - Qubit discusses how they moved from Apache Hadoop and MapReduce to Google BigQuery, Dataflow and Cloud Pub/Sub.

BigQuery Data Analytics Official Blog July 15, 2019

Geolocation with BigQuery: De-identify 76 million IP addresses in 20 seconds - You can use the BigQuery data warehouse to explore large public datasets -- here’s how to de-identify user data for compliance.

Data Analytics Official Blog July 8, 2019

Tips and tricks to get your Cloud Dataflow pipelines into production - Doing stream and batch processing with Cloud Dataflow depends on good data pipelines. Here are some tips to build and manage those pipelines.

Big Data Data Analytics Data Catalog Data Science July 8, 2019

Google Cloud Data Catalog hands-on guide: templates & tags with Python - This quickstart guide brings a practitioner approach to Data Catalog, covering Templates & Tags management using the Python client library.

Data Analytics Data Catalog Official Blog July 1, 2019

Google Cloud Data Catalog now available in public beta - Data Catalog, our fully managed data discovery and metadata management service is now available in public beta so you can quickly discover, manage, and understand your data in Google Cloud.

AI BigQuery Data Analytics Machine Learning Official Blog July 1, 2019

Analyze BigQuery data with Kaggle Kernels notebooks - BigQuery users can now query and create BQML models within an integrated development environment using Kaggle Kernels.

Big Data Data Analytics July 1, 2019

Data and Analytics on Google Cloud Platform - Overview of data and analytics services available on Google Cloud Platform.

BigQuery Data Analytics Machine Learning Official Blog June 24, 2019

Predictive marketing analytics using BigQuery ML machine learning templates - To make machine learning more accessible to data scientists, BigQuery ML is now generally available, and we’ve published three new templates in collaboration with SpringML for marketing analytics use cases.

Cloud Dataflow Data Analytics Official Blog June 17, 2019

How to efficiently process both real-time and aggregate data with Cloud Dataflow - How to use design pipeline for both streaming inserts and load jobs, with significant cost savings.

Cloud Dataproc Data Analytics Official Blog June 17, 2019

7 best practices for running Cloud Dataproc in production - Best practices to develop reliant and stable production processes with Cloud Dataproc.

Big Data BigQuery Data Analytics GCP Experience June 17, 2019

A Song of Data and Fire: Building Bnext Wall (Data Lake) - Process of building data lake on Google Cloud Platform.

Apache Beam Cloud Dataflow Data Analytics Java June 17, 2019

Creating a simple Cloud Dataflow with Kotlin - Simple Beam pipeline which subscribes to a Pub/Sub topic and creates Entities of Datastore for each message and runs on Cloud Dataflow, written in Kotlin.

BigQuery Data Analytics Official Blog

What’s happening in BigQuery: New persistent user-defined functions, increased concurrency limits, GIS and encryption functions, and more - List of most recent releases and updates regarding BigQuery.

 

Latest Issues




Contact

Zdenko Hrček
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: zdenko@gcpweekly.com