Tag: BigQuery

Resources about BigQuery collected from the weekly GCP Weekly newsletter — a hand-curated collection of Google Cloud Platform news, technical articles, tutorials, videos and release notes. Each entry below links back to the original GCP Weekly issue and retains its publish date and title, giving you a focused, searchable knowledge base for this topic.

BigQuery Dec. 15, 2025

Optimizing BigQuery Cost for the Solana Community Dataset: A Petabyte-Scale Project - An engineering team successfully optimized the petabyte-scale Solana Community Dataset on Google Cloud's BigQuery, which previously incurred high costs from full-history scans.

BigQuery dbt Dec. 15, 2025

SCD2 in BigQuery + dbt: Historical Versioning, Hashing Strategies and DOF Full-Load Processing - A deep dive into scalable SCD2 pipelines using hash-based change detection and DOF processing in BigQuery + dbt.

AI BigQuery Dec. 8, 2025

Goodbye, Pipelines: Building AI Search in Seconds with BigQuery Autonomous Embeddings - TL;DR: BigQuery has launched Autonomous Embedding Generation and AI.SEARCH (Public Preview).

BigQuery Official Blog Public Datasets Public Sector Dec. 8, 2025

Accelerate medical research with PubMed data now available in BigQuery - Accelerate medical research by accessing PubMed data in BigQuery. Learn how to use Vertex AI to perform semantic search for drug discovery and oncology.

BigQuery Data Analytics GCP Experience Official Blog Dec. 8, 2025

Back Market: Migrating to Google Data Cloud halves data costs and aligns with eco-first priorities - Migrating off AWS infrastructure, Snowflake and Databricks to BigQuery had a measurable impact on Back Market’s performance, costs, and productivity.

BigQuery Cloud Storage Earth Engine Dec. 8, 2025

AlphaEarth Foundations Satellite Embeddings: Now Available on Google Cloud Storage - The AlphaEarth Foundations Satellite Embedding dataset is now available on Google Cloud Storage, offering geospatial users enhanced flexibility for analysis workflows outside of Earth Engine. This extensive dataset, provided as Cloud Optimized GeoTIFFs (COGs), is designed for seamless integration with Google Cloud services like BigQuery and Vertex AI.

BigQuery Dataform dbt Paywall Dec. 1, 2025

How We Migrated from dbt Cloud to GCP Dataform (And Saved Significant Cost) - Step-by-step process, feature comparison, and real-world insights for data engineers.

BigQuery FinOps Paywall Dec. 1, 2025

BigQuery Cost FireDrill: Guardrails, Quotas, and Kill Switches - How to stop one bad query, one rogue dashboard, or one “quick export” from torching your entire data budget.

API API Gateway BigQuery Dec. 1, 2025

How we slashed data-API costs by 99.8% using flAPI + Google BigQuery + DuckDB - This article outlines a cost-optimization strategy using flAPI to cache periodic BigQuery aggregations within a local DuckDB instance for high-frequency API endpoints. This architectural pattern decouples heavy data warehouse queries from user traffic, resulting in millisecond response times and a reported 99% reduction in operational costs.

BigQuery Data Science Dataform Dec. 1, 2025

Building Dataform Pipelines: A Practical Guide To Materializations - This article details how to optimize data warehouse costs and performance by strategically selecting Dataform materialization types: view for freshness, table for simplicity, incremental for efficient updates on large datasets, and operations for complex custom logic. It provides a decision-making framework based on dataset size, update frequency, and team maturity to ensure scalable and maintainable data models.

BigQuery Cloud Firestore Cloud Run Nov. 24, 2025

Migration of cloud components of Cool Maze - Push to Computer - Modernizing app on GCP to improve performance, and optimize costs.

BigQuery Data Science Dataform Nov. 24, 2025

How We Cut 80% of Redundant SQL Across BigQuery Using Dataform — Practical Guide - Every analytics engineer has that moment, when your warehouse feels like a junk drawer.

BigQuery Cloud Storage Terraform Nov. 24, 2025

Migrating Terraform state from local to GCS bucket - When working with Terraform in a small, individual environment, storing the state file locally is often sufficient.

BigQuery Data Analytics Databases Official Blog Nov. 24, 2025

TimesFM in Data Cloud: The future of forecasting in BigQuery and AlloyDB - Learn about enhancements to the TimesFM foundation model that performs "zero-shot" forecasting, now available for BigQuery and AlloyDB.

BigQuery Data Analytics Official Blog Nov. 24, 2025

Expanding BigQuery Data Transfer Service with new connectors, features, and more - Learn about recent enhancements to the BigQuery Data Transfer Service connector ecosystem, security and compliance features, and the user experience.

AI BigQuery Data Analytics Official Blog Nov. 24, 2025

BigQuery AI: The convergence of data and AI is here - BigQuery AI, brings together BigQuery’s built-in ML capabilities, generative AI functions, vector search, intelligent agents, and agent tools.

BigQuery Paywall Nov. 17, 2025

BigQuery Join Order: Let the Optimizer Win - How to write join-friendly SQL that’s fast, cheap, and easy to maintain — without micromanaging the plan.

BigQuery Data Analytics Official Blog Nov. 17, 2025

BigQuery under the hood: How Google brought embeddings to analytics - We reflect on the past two years since launching vector search in BigQuery, with a focus on scale, simplicity, and cost performance.

AI BigQuery Data Analytics Official Blog Nov. 17, 2025

Announcing BigQuery-managed AI functions for better SQL - BigQuery managed AI functions let you use generative AI for common analytical tasks within SQL queries, without complex prompt tuning or new tools.

BigQuery Data Analytics Official Blog Nov. 17, 2025

Do you detect a pattern? BigQuery’s new MATCH_RECOGNIZE function can! - The new MATCH_RECOGNIZE feature in BigQuery allows you to perform complex pattern matching on your data directly within your SQL queries.

BigQuery BigQueryML Data Analytics GCP Experience Official Blog Partners Nov. 17, 2025

Zeotap: How BigQuery ML and vector search help customers build their own AI models - Zeotap uses BigQuery, including BigQuery ML and Vector Search, to solve the end-to-end lookalike problem in its Zeotap CIP platform.

BigQuery Paywall Nov. 10, 2025

BigQuery Join Order: Let the Optimizer Win - Subtitle: How to write intent-driven SQL BigQuery can optimize — plus when to step in with hints and materialization.

BigQuery Data Analytics Official Blog Nov. 10, 2025

The Data Engineering Agent is now in preview - The Data Engineering Agent in BigQuery, now in preview, automates many tedious development, maintenance, and troubleshooting tasks.

AI BigQuery Gemini CLI Nov. 3, 2025

BigQuery Data Analytics with Gemini CLI — Part 1 - A Deep Dive and Tutorial into the new BigQuery Extension for Gemini CLI.

BigQuery Cloud Storage Nov. 3, 2025

Migrating Delta Lake Tables to Google Cloud Storage using Storage Transfer Service - The Scenario.

AI BigQuery Data Analytics Nov. 3, 2025

Effortless AI in BigQuery: Meet the New Managed AI Functions - TL;DR: BigQuery’s new Managed AI functions are here to automate your most common AI tasks.

BigQuery Data Analytics Databases Official Blog Oracle Nov. 3, 2025

From Oracle transactions to AI actions: Activate your data with intelligent automation - Unlock Oracle data in BigQuery for enterprise AI by building automated workflows and activating real-time insights with Bigquery and Gemini for Enterprise (previously Agentspace).

BigQuery FinOps Oct. 27, 2025

FinOps Cost Management for BigQuery - The article discusses applying FinOps principles to Google BigQuery, focusing on cost visibility, allocation, optimization, and governance.

BigQuery FinOps Oct. 27, 2025

The 6 BigQuery Personas: Which One Are You? - After analyzing feedback from over 100 BigQuery clients, the article identifies six distinct personas based on their approach to BigQuery pricing, ranging from "On-Demand Native" to "Adaptive Automator.".

BigQuery Cloud Spanner Machine Learning Oct. 27, 2025

Spanner better with BigQuery: streaming insights, faster federated queries, Iceberg tables support and more - Google Cloud enhances Spanner's integration with BigQuery, enabling real-time insights and faster federated queries. New features include support for Postgres-dialect Spanner databases in BigQuery external datasets, accelerated queries with materialized views, and real-time reverse ETL for streaming data from BigQuery to Spanner.

Showing 241–270 of 2427 resources

 

Latest Issues




Contact

Zdenko Hrček
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]