Tag: Apache Iceberg

Resources about Apache Iceberg collected from the weekly GCP Weekly newsletter — a hand-curated collection of Google Cloud Platform news, technical articles, tutorials, videos and release notes. Each entry below links back to the original GCP Weekly issue and retains its publish date and title, giving you a focused, searchable knowledge base for this topic.

Apache Iceberg BigQuery Oct. 5, 2026

One Table, Two Engines - I built a small African weather lakehouse, let Spark and BigQuery take turns editing the same table, and the whole thing cost me less than….

Apache Iceberg Oct. 5, 2026

Building an Autonomous Agentic Data Architect: How We Modernized Legacy Data Estates into a… - A comprehensive technical guide to replacing multi-million dollar manual ETL migrations with 12 specialized Gemini 3 agents, Zero-Egress….

Apache Iceberg BigQuery Oct. 5, 2026

From Fragmented Logistics Data to Governed AI Insights with Google Cloud’s Open Lakehouse - What a missing cargo investigation can teach us about Apache Iceberg, BigQuery, Spark, Gemini, and governance.

Apache Iceberg Oct. 5, 2026

Migrate vs. Federate: How to Choose the Right Strategy for Your Multi-Cloud Iceberg Data - A battle-tested decision framework with concrete cost/latency trade-offs for Chief Architects and Lead Data Engineers building on Google….

Apache Iceberg BigQuery Sept. 28, 2026

Semantic SQL — Direct Integration of Gemini Models on Apache Iceberg Data in BigQuery - The Convergence of Artificial Intelligence and Open Data Platforms.

Apache Iceberg BigQuery Paywall Sept. 28, 2026

I Put Spark and BigQuery on the Same Iceberg Table. Here’s What Broke. - Three months of sharing one table taught me that the hard part isn’t reading the data. It’s agreeing on the table state.

Apache Iceberg Big Data BigQuery Paywall Sept. 28, 2026

I Moved Iceberg Scan Planning Off the Spark Driver. Here’s What Changed. - The driver wasn’t running out of memory because of the query. It was spending too much time figuring out which files the query needed.

Apache Iceberg BigQuery Sept. 21, 2026

How considering an Iceberg migration made me rethink BigQuery costs — Platforming Data - An evaluation of a potential Apache Iceberg migration revealed unexpected cost and performance trade-offs in Google Cloud's BigQuery, such as faster execution times that paradoxically required higher compute consumption. This discovery prompted a comprehensive reassessment of BigQuery pricing models, prompting a deeper look at how storage billing, query execution, and capacity pricing interact.

Apache Iceberg BigQuery Workspace Sept. 14, 2026

Unifying Google Workspace and Apache Iceberg: Serverless Lakehouse Management - Turn Google Sheets into a Petabyte Lakehouse with Sub-Second ACID Queries.

Apache Iceberg BigQuery Workspace Sept. 14, 2026

Serverless Multimodal Vector Search on Apache Iceberg via Google Apps Script - This article explores a serverless architecture that combines Google Apps Script, Apache Iceberg, and the Gemini API to build a zero-maintenance multimodal vector search engine. It demonstrates how to ingest and index diverse enterprise assets—such as Google Docs, spreadsheets, binary images, and text notes—into an open Parquet table without needing expensive, dedicated vector databases.

Apache Iceberg BigQuery Workspace Sept. 14, 2026

Bidirectional Writeback for Apache Iceberg via Google Sheets: Serverless Lakehouse Console - This article explores a serverless, zero-cost architecture that turns Google Sheets into an interactive ACID mutation console for Apache Iceberg on Google Cloud Storage. By combining a Change Data Capture (CDC) engine in Google Apps Script with BigQuery compute, frontline business users can query, edit, and commit data modifications directly back to open lakehouse tables without expensive Reverse ETL SaaS platforms.

Apache Iceberg Sept. 7, 2026

Seven Iceberg REST Catalogs: What They Declare, and What They Serve - This article evaluates seven Apache Iceberg REST catalog implementations—including options from Google Cloud, AWS, Databricks, Snowflake, and Microsoft—by comparing their published specifications against actual API behavior.

Apache Iceberg AWS Aug. 24, 2026

Leveraging the Freedom of Open-Table Formats: A Guide to Cross-Cloud Migration - Introduction.

Apache Iceberg Aug. 24, 2026

A Practical Blueprint for Google Cloud’s Lakehouse with Iceberg - Catalog topology, namespace IAM gotchas, FinOps chargebacks, and making multi-tenant data mesh actually work on Google Cloud.

Apache Iceberg BigQuery Databricks Aug. 10, 2026

Databricks Iceberg — BigQuery query - This article provides a comprehensive technical guide on how to configure and query Apache Iceberg tables created in Databricks (hosted on Google Cloud Platform) using BigQuery. It explains how to set up Google Cloud Storage, Databricks Unity Catalog, and IAM permissions to successfully implement catalog federation between the two platforms. Ultimately, the piece enables data teams to seamlessly read and analyze Databricks-managed Iceberg data directly through Google's cloud-native query engine.

Agents Apache Iceberg AWS Data Analytics Serverless Spark Aug. 3, 2026

The borderless Lakehouse: Bring AWS, Databricks and Snowflake data to your AI agents - The borderless Lakehouse provides secure, bi-directional access via BigQuery and Managed Service for Apache Spark to any Iceberg-compatible engine.

Apache Iceberg Python July 27, 2026

Setting the PyIceberg catalog connection for Google Lakehouse - This article demonstrates how to connect PyIceberg applications to the Google Lakehouse Runtime Catalog. It details both manual configuration methods and a more streamlined approach that dynamically retrieves connection parameters. By leveraging the Google Cloud BigLake API, users can programmatically fetch necessary Iceberg catalog details, simplifying the PyIceberg setup for data stored in Google Lakehouse.

Apache Iceberg July 6, 2026

Building a Cross-Cloud Data Sharing Pipeline with BigLake, Iceberg, and Snowflake Catalog-Linked… - Sharing GCP-native Iceberg data with Snowflake consumers no longer requires complex integration patterns or stale copies. By combining….

Apache Iceberg BigQuery dbt June 22, 2026

Building a Serverless, Multi-Source Data Ingestion Framework on GCP (Snowflake & Databricks to BigQuery) - This article details a serverless, multi-source data ingestion framework developed on Google Cloud Platform, designed to consolidate data from Snowflake and Databricks into BigQuery. Leveraging GCP Workflows for orchestration and Dataproc Serverless for compute, this solution significantly reduces costs and operational overhead by eliminating persistent clusters.

Apache Iceberg June 22, 2026

Google Cloud Next ’26, Data Infrastructure Perspectives - “AI” was the headline at Google Cloud Next ’26, but underneath the AI announcements was a sustained data infrastructure story: Google is….

Apache Iceberg BigLake June 8, 2026

BigLake - Why a Lakehouse Without Iceberg Isn’t Really a Lakehouse - In this blog, I’ll walk you through the Lakehouse ecosystem in a simple and practical way, focusing on Apache Iceberg, Big Data Lakes, and….

Apache Iceberg Cloud Storage Data Analytics Official Blog Streaming June 8, 2026

Accelerating data lakes: Optimizing Apache Iceberg and Spark with gcs-analytics-core - Boost Iceberg and Spark on Google Cloud Storage with gcs-analytics-core. Maximize speed and cut data workload costs.

Apache Iceberg BigQuery June 1, 2026

How BigQuery Reads Iceberg and Parquet: A Simple Lakehouse Query Walkthrough - I spent time today thinking through a question that sounds simple on the surface, but is actually the core of a modern lakehouse workflow:.

Apache Iceberg June 1, 2026

Building a Telemetry Data Lakehouse with FastAPI, Iceberg, DuckDB, and GCP - I have been building a telemetry ingestion pipeline for fleet data.

Apache Iceberg June 1, 2026

The BigQuery Iceberg Handbook: Data Integration Patterns — Part 1 Introduction - Google Cloud has been consistently working since last 2–3 years on deepening the integration between iceberg and the GCP platform. The….

Apache Iceberg June 1, 2026

The BigQuery Iceberg Handbook: Data Integration Patterns — Part 2 Hadoop Catalog - This integration pattern showcases Apache Iceberg on GCS using a Hadoop catalog with Spark-based processing and BigQuery analytics.

Apache Iceberg Databricks June 1, 2026

Build a cross-cloud open data lakehouse without copying bytes - “Let’s just migrate all data into a single, centralized repository.”.

Apache Iceberg Data Catalog June 1, 2026

Lakehouse Demystified — Part 4: Just enough about Lakehouse runtime catalog - Welcome to Part 4 of Lakehouse Demystified blog series — a practical guide to lakehouse on Google Cloud. My goal is to share an opinionated….

Apache Iceberg June 1, 2026

The BigQuery Iceberg Handbook: Data Integration Patterns — Part 4 Apache Iceberg REST Catalog - GCP platform introduced support for REST catalog for Biglake Metastore in late 2025. The Biglake Metastore has now been renamed as….

Apache Iceberg June 1, 2026

The BigQuery Iceberg Handbook: Data Integration Patterns — Part 3 Apache Iceberg Catalog for… - In this blog, we will be discussing on Lakehouse Runtime Catalog — Apache Iceberg Catalog for Bigquery.

Apache Iceberg May 4, 2026

The Temporal Memory Gap: Using Iceberg time travel for Autonomous Security Swarms - How to bypass the ‘Read Amplification Wall’ and architect sub-second temporal state for autonomous reasoning loops.

Apache Iceberg April 27, 2026

Lakehouse Demystified — Part 1: Just enough about the lakehouse stack on Google Cloud - Welcome to Part 1 of the Lakehouse Demystified blog series — a practical guide to lakehouse on Google Cloud. My goal is to share an….

Apache Iceberg Data Analytics Official Blog Serverless Spark April 27, 2026

The future of data lakehouse: Open and interoperable for the agentic era - Transition to an AI-native, cross-cloud Lakehouse built for agentic AI. Deliver 117% ROI with managed Apache Iceberg, always-on context, and high-performance Spark.

Apache Iceberg BigQuery Data Analytics Official Blog April 13, 2026

Openness without compromises for your Apache Iceberg lakehouse - Apache Iceberg tables in Google-managed Iceberg REST Catalog provides read and write interoperability between BigQuery and Iceberg-compatible engines.