Tag: BigQuery
Resources about BigQuery collected from the weekly GCP Weekly newsletter — a hand-curated collection of Google Cloud Platform news, technical articles, tutorials, videos and release notes. Each entry below links back to the original GCP Weekly issue and retains its publish date and title, giving you a focused, searchable knowledge base for this topic.
BigQuery Data Analytics Dataform Gemini Nov. 9, 2026From spreadsheets to a governed pipeline: Bridging Google Drive and BigQuery with the Data Engineering Agent - Integrating Google Drive with the BigQuery Data Engineering Agent allows analytics teams to seamlessly connect unstructured data sources like Google Sheets, CSVs, and Avro files directly into BigQuery pipelines using Dataform. The AI-powered agent securely previews file schemas, handles messy data values, and generates automated SQL tables that keep data constantly up to date with zero manual imports.
BigQuery Data Analytics Official Blog Nov. 9, 2026Zero-shot predictions in Pandas using the new BigQuery Accessor - Scale machine learning directly in Pandas and boost productivity using enterprise-grade BigQuery AI functions without leaving your DataFrame.
BigQuery Data Analytics Databases Official Blog Nov. 9, 2026Bringing conversational analytics to Gemini with Agentic Data Cloud connectors - Query live data across BigQuery, databases, and Looker in plain language with Data Cloud connectors in Gemini, grounded by Knowledge Catalog.
BigQuery Data Analytics Official Blog Nov. 9, 2026Semantic aggregation over millions of rows in BigQuery with AI.AGG - AI.AGG provides multi-level semantic aggregation function natively embedded within BigQuery.
AlloyDB BigQuery Data Analytics Databases Official Blog Nov. 9, 2026Unify operational and Lakehouse data with direct Iceberg access in AlloyDB for PostgreSQL - Query Apache Iceberg tables stored in cloud storage directly from AlloyDB and join them with live operational data in a single SQL query.
BigQuery dbt Nov. 2, 2026What Really Happens to Your Data When the Schema Changes in dbt (BigQuery Edition) - Incremental models, on_schema_change, and the quiet ways a pipeline can lose data.
BigQuery Dataform Nov. 2, 20261. Stop Copy-Pasting SQL in Dataform: A Practical Guide to Reusable Functions - Six reusable SQL patterns for incremental models, and how to change a shared macro without breaking production.
BigQuery Data Science Gemini Nov. 2, 2026Data Governance at Scale with Gemini 4 Argon & BigQuery - Perform Agentic Data Remediation for 1 Million Records!
BigQuery dbt Nov. 2, 2026Reprocessing BigQuery at Scale: The Hidden Failure Modes of Incremental dbt Pipelines - Designing deterministic backfills, safe partition replacement, and dependency-aware recovery in production data platforms.
BigQuery Data Analytics Official Blog Nov. 2, 2026BigQuery measures is now GA, unifying BI metrics and knowledge graphs for AI accuracy - BigQuery measures is now generally available, unifying BI metrics and knowledge graphs in one model so AI agents and dashboards share trusted data.
BigQuery Oct. 26, 2026From Cloud Storage to Structured Data: Building an AI-Native ELT Pipeline in BigQuery - This article explores how to build an AI-native ELT pipeline in Google Cloud by combining Cloud Storage and BigQuery's generative AI functions to transform unstructured documents into queryable data. It details how tools like object discovery and multimodal inference allow data engineers to extract structured schemas directly through SQL without relying on complex, separate parsing infrastructure.
BigQuery FinOps LLM Oct. 26, 2026How to manage costs when prompting open source LLMs from BigQuery - A practical guide to keeping your cloud budget under control when running open LLMs in BigQuery.
Apache Beam BigQuery Dataflow Oct. 26, 2026Handling Late-Arriving Data in Google Cloud Dataflow: A Production Architecture for 100% Eventual Data Correctness - How event time, watermarks, allowed lateness, deduplication, BigQuery, reconciliation, and replay work together to prevent silent data loss.
BigQuery Oct. 26, 2026Don’t mock BigQuery, test on BigQuery: the rewrite of BigTesty - This article introduces BigTesty 1.x, an open-source testing tool designed to test Google Cloud BigQuery SQL and infrastructure directly on the real engine rather than using unreliable mocks or shared datasets.
BigQuery Oct. 26, 2026How to prompt open LLM models across massive datasets - Query Gemma, Llama, Mistral, and Hugging Face models directly from BigQuery SQL with zero data movement.
BigQuery Data Analytics Official Blog Oct. 26, 2026BigQuery ObjectRef now GA: Build multimodal data platforms for conversational analytics entirely in SQL - BigQuery ObjectRef is now GA. Combine unstructured data with Gemini to build powerful multimodal analytics and conversational agents using SQL.
BigQuery Data Analytics Official Blog Python Oct. 26, 2026How to Use Python UDF Logging for Pipeline Observability - Ensure data pipeline reliability and troubleshoot issues fast by using standard Python logging directly in BigQuery UDFs for real-time observability.
BigQuery Data Science Machine Learning Oct. 19, 2026Prompting LLMs over your data at scale in Python with bigframes and BigQuery AI - How to prompt Gemini, rank semantically, and build semantic search directly from your Python notebook without the infrastructure overhead.
BigQuery dbt Generative AI Oct. 19, 2026Automating Snowflake-to-BigQuery dbt Migrations with AI Skills - This article explores how to automate the complex process of migrating a dbt project from Snowflake to Google BigQuery using Google’s open-source AI skills.
BigQuery Oct. 19, 2026Domain-Driven BigQuery Column Security: Moving to Data Governance Tags - How to build domain-driven BigQuery column security using regional data policies, custom SQL masks, and dbt for data mesh architectures.
BigQuery Data Analytics FinOps Official Blog Oct. 19, 2026Predictable AI spend in BigQuery: Introducing cost management for generative AI functions - Token-based cost management for BigQuery generative AI functions lets you set daily quotas on AI token consumption so you can keep within your budget.
BigQuery Data Analytics Official Blog Oct. 19, 2026Introducing TimesFM 3.0 with multivariate time-series forecasting in BigQuery - Google Research’s TimesFM 3.0 is a 330-million parameter foundation model that unlocks native multivariate time-series forecasting in BigQuery SQL.
BigQuery FinOps Oct. 12, 2026Making Sense of BigQuery Pricing Models: On-Demand, Capacity, Editions (2026) - This article provides a comprehensive guide to understanding and optimizing Google Cloud's BigQuery pricing models, specifically breaking down On-Demand versus Capacity pricing and various edition tiers.
BigQuery FinOps Oct. 12, 2026BigQuery Cost Optimization: The Complete FinOps Framework - This article introduces a comprehensive FinOps framework tailored specifically for Google Cloud's BigQuery, structured as a four-layer pyramid ranging from query-level optimizations to enterprise contract negotiations.
BigQuery Gemini Enterprise Agent Platform Oct. 12, 20269 Mistakes to Avoid When Building Gemini Enterprise Agents - This article outlines nine critical design and architectural mistakes to avoid when building production-ready AI agents using Gemini Enterprise and BigQuery. It provides practical guidance on managing enterprise data permissions, handling identity authentication, and structuring secure tool integrations across complex business environments. The insights help developers transition from basic AI prototypes to trusted, enterprise-wide deployments with proper governance.
BigQuery Data Analytics GCP Experience Official Blog Partners Oct. 12, 2026Modernizing Unstructured Data Workflows: Alteryx Live Query meets Google Cloud BigQuery - Build code-free pipelines with Live Query + BigQuery. Use Gemini securely within your data platform to process and analyze unstructured data.
BigQuery Billing FinOps Sept. 28, 2026Eliminate First: How We Architected a 60% + BigQuery Cost Reduction - From a struggling MySQL monolith to a high-performance, predictable-cost cloud analytics ecosystem.
AI BigQuery Data Science Machine Learning Sept. 28, 2026Jev and BigQuery AI functions, from one row to ten million - Testing quality, latency, and cost across Jev and BigQuery’s AI Functions and how combining them in a model cascade gives the best of both.
BigQuery Data Science Sept. 28, 2026Why I Reworked a BigQuery Sink from Pending Streams to Buffered Streams - This article explains how the Apache SeaTunnel data integration platform redesigned its BigQuery sink connector to improve reliability during failures.
AI BigQuery Cloud Run Data Science Machine Learning Sept. 28, 2026Bring Jev to BigQuery with Cloud Run - Turn unstructured text into typed, queryable SQL columns with TypeSafe’s Jev model.
Showing 1–30 of 2423 resources
Useful Links
Contact
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]