Tag: BigQuery
Resources about BigQuery collected from the weekly GCP Weekly newsletter — a hand-curated collection of Google Cloud Platform news, technical articles, tutorials, videos and release notes. Each entry below links back to the original GCP Weekly issue and retains its publish date and title, giving you a focused, searchable knowledge base for this topic.
BigQuery Data Analytics Earth Engine Official Blog Sustainability May 12, 2025Expanding BigQuery geospatial capabilities with Earth Engine raster analytics - Earth Engine in BigQuery unlocks raster analytics directly within BigQuery, enabling SQL users to analyze geospatial datasets derived from satellite imagery. By using the ST_RegionStats() function and accessing Earth Engine datasets in BigQuery Sharing, users can gain insights for climate risk assessment, sustainable sourcing, and emissions monitoring. This integration facilitates data-driven decision-making across various industries by combining raster and vector data analysis in one platform.
BigQuery Data Analytics Official Blog May 12, 2025New column-granularity indexing in BigQuery offers a leap in query performance - BigQuery introduces column-granularity indexing, enhancing query performance and cost efficiency by pinpointing relevant data within specific columns. This feature is beneficial when search tokens are selective in some columns but common across others, reducing processing and latency.
AI BigQuery Data Analytics Firebase GCP Experience Official Blog Partners Sustainability May 5, 2025Pushing the limits of electric mobility: Formula E's Mountain Recharge - Formula E and Google Cloud collaborated on "Mountain Recharge," an experiment where a Formula E car with only 1% battery regenerated energy by braking downhill through the Alps to complete a lap in Monaco. AI, using Gemini 2.5, was crucial in planning, route selection, real-time monitoring with Firebase and BigQuery, and developing a dashboard, demonstrating AI's potential for innovation and efficiency across industries. The project highlights the possibilities of AI in enhancing planning, streamlining project management, and enabling data-driven decision-making.
AlloyDB BigQuery Generative AI May 5, 2025MCP Toolbox for Databases - The article introduces Google's MCP Toolbox for Databases, an open-source MCP server designed for enterprise-grade database integration with AI agents. It simplifies development by handling complexities like connection pooling and authentication, enhances security with integrated auth, and provides end-to-end observability. A codelab demonstrates using the toolbox with AlloyDB to calculate toy prices, showcasing its ability to streamline database management in agentic applications.
AI BigQuery Data Analytics Official Blog May 5, 2025Introducing BigQuery DataFrames 2.0 for the era of multimodal data science - BigQuery DataFrames 2.0 introduces multimodal data processing and AI capabilities directly into BigQuery Python workflows, extending Pandas DataFrames to handle text, images, audio, and more, alongside structured data. This update streamlines AI and machine learning pipelines with features like Pythonic operators for BigQuery AI Query Engine, Gemini Code Assist, partial ordering for performance, Python UDF integration, and dbt integration. These enhancements aim to unify data analysis, unlock LLM-powered insights, and simplify workflows while leveraging BigQuery's scalability and governance.
BigQuery Data Analytics Official Blog May 5, 2025What’s new with BigQuery AI and ML? - BigQuery ML introduces new AI and ML capabilities, including the TimesFM forecasting model, structured data extraction with LLMs, row-wise inference functions, and expanded model choices like Gemini and OSS models. Contribution Analysis feature is now generally available, which helps to explain changes in business metrics. These updates bring AI/ML capabilities directly into data workflows, enabling faster insights and impactful outcomes.
BigQuery Generative AI April 28, 2025Tutorial : MCP Toolbox for Databases - Exposing BigQuery Datasets - MCP Toolbox for Databases, formerly known as GenAI Toolbox for Databases, now supports BigQuery as a data source. Users can now query their BigQuery datasets directly within Gen AI clients using MCP client mode.
BigQuery Cloud Composer FinOps April 28, 2025Unlocking Savings: A look at Google’s new BigQuery & Composer CUDs - CUDs for BigQuery and Composer finally arrived — Am I going to save money?
BigQuery Python Streaming April 28, 2025Streaming One Row to BigQuery! - A walkthrough of the new usability improvements for the 2.30 release of the Storage Write API Python client library.
BigQuery Data Analytics Generative AI Official Blog April 28, 2025Automate data pipelines with BigQuery's new data engineering agent - BigQuery data engineering agent automates data pipeline building, modification, and troubleshooting, freeing data teams to focus on extracting value from data. It understands data engineering best practices, your specific environment, and context, and generates SQL code, builds pipelines, and creates unit tests. The agent monitors pipelines, identifies issues, and proposes fixes, acting as a dedicated expert constantly watching over your data infrastructure.
BigQuery Data Analytics Official Blog April 28, 2025Accelerate your data-to-insights journey with enhanced BigQuery data canvas - BigQuery data canvas is a visual workspace that democratizes data analysis and empowers everyone to unlock the power of their BigQuery data. It features a built-in AI-assistive chat experience powered by Gemini, which allows users to generate and refine queries, ask questions about their data, and receive intelligent suggestions and insights using natural language.
BigQuery dbt April 21, 2025Reap all the benefits of incremental dbt-models in BigQuery - Incremental dbt models in BigQuery enable efficient processing of new or updated data, improving performance and potentially reducing costs. However, using them with BigQuery requires proper clustering and variable handling to avoid unnecessary data processing. The solution involves creating a variable for the event time offset and handling potential errors and reference issues. By following these steps, you can optimize incremental models and save costs when working with large datasets in BigQuery.
BigQuery April 21, 2025Migrating Kafka to BigQuery — Fixing Field Name Compatibility in Self-Managed Connectors - A Deep Dive Into Schema Sanitization When Moving Away From Confluent Managed Connectors.
BigQuery LLM April 21, 2025Forecasting the Future with BigQueryML TimesFM: A Game-Changer in Time Series Analysis - TimesFM, a foundation model built on Google's Large Language Model (LLM) architecture, revolutionizes time series forecasting by offering zero-shot performance and eliminating the need for dataset-specific training. Integrated into BigQuery ML as the AI.FORECAST function, it empowers data analysts to generate sophisticated forecasts using familiar SQL syntax.
BigQuery Data Analytics Official Blog April 14, 2025Simplify your data platform migration with AI-powered BigQuery Migration Services - Google Cloud’s BigQuery Migration Services now offers several new innovations, including coverage for data science and expanded support for data engineering and data analytics workloads. These new capabilities span across four stages of a data platform migration: automated assessment and planning, automatic code translation, data migration, and validation. Customers can now benefit from automated discovery and assessment with estimated total cost of ownership, automated code translations, data, metadata, and permissions migration, and intelligent end-to-end validation.
BigQuery Data Analytics Official Blog April 14, 2025What's new with BigQuery — the autonomous data-to-AI platform - BigQuery, the autonomous data-to-AI platform, enables organizations to leverage enterprise data for AI agents, intelligent search, and AI-powered analytics. It offers a self-managing multimodal data foundation, advanced AI assistance, simplified governance, and enhanced enterprise capabilities. With BigQuery, businesses can accelerate their journey to AI-driven insights at a lower cost.
BigQuery DevOps April 7, 2025BigQuery Trick That Saved My Sanity (and Budget) on Dev/Test - This article introduces BigQuery's Table Clones and Snapshots, which offer a faster and more cost-effective way to create isolated copies of large tables for development, testing, and backup purposes.
BigQuery Cloud Run Firebase April 7, 2025The cloud architecture of Cool Maze - Cool Maze is a mobile app that lets you send a photo from your mobile to your computer, by scanning a QR code.
BigQuery April 7, 2025SQL Pipe Syntax Style Guide & Best Practices - A Comprehensive and Pioneering Edition for Adoption.
BigQuery Data Analytics Official Blog April 7, 2025Accelerate analytics with AI-assisted data preparation in BigQuery, now GA - BigQuery data preparation, now generally available, leverages AI to simplify and automate data preparation tasks, reducing the time spent on data wrangling and improving productivity. It offers comprehensive transformation capabilities, data standardization, automated schema mapping, and AI-suggested join keys for data enrichment. With its visual, low-code data pipeline features, users can design, execute, and monitor complex data pipelines, enforce data quality with error tables, and streamline deployment with GitHub integration.
BigQuery GCP Experience GKE Official Blog Vertex AI April 7, 2025How WindTL is transforming wildfire management with Google Cloud - WindTL, developed by Improving Aviation, is a decision support tool that leverages AI-powered models to deliver accurate wildfire spread, ember behavior, and ignition risk predictions. By utilizing Google Kubernetes Engine (GKE), BigQuery, and Vertex AI, Improving Aviation has achieved accelerated model execution, scalable data processing, and improved prediction accuracy, revolutionizing wildfire prediction and saving lives.
BigQuery Data Analytics March 31, 2025Building a Marketing Data Warehouse on Google Cloud Platform - This blog post discusses building a marketing data warehouse on Google Cloud Platform to solve challenges in marketing measurement and activation. It highlights the importance of extracting data from various platforms, storing it in a central location, and using tools like BigQuery for analysis and transformation.
BigQuery March 31, 2025Your Open Source BigQuery Backup&Restore Buddy - An open-source service that makes BigQuery backups & restores simple, scalable, and accessible to everyone.
BigQuery Cloud Dataproc Cloud Memorystore March 31, 2025Migrate from Bigquery to multi-regional Memorystore using Dataproc - This article explains how to migrate data from BigQuery to Memorystore using a Dataproc pipeline.
BigQuery Billing FinOps March 31, 2025How we saved $3.5M in BigQuery costs on deleting inactive user data - 5 key BigQuery optimisations for reducing the costs associated with deleting the data of 150,000 inactive customers.
BigQuery March 31, 2025BigQuery User Defined Aggregate Functions (UDAF) to handle large precision - BigQuery User Defined Aggregate Functions (UDAFs) allow users to overcome precision limitations by defining custom aggregate functions in SQL or JavaScript. These functions enable calculations and aggregations on data with precision and scale that exceed BigQuery's native support.
BigQuery Paywall March 24, 2025Oracle to BigQuery Migration: The Challenges, The Fixes, and The Wins - The article discusses the challenges, fixes, and wins experienced during the migration of an entire data warehouse from Oracle to BigQuery. The migration involved over 100 terabytes of data, 5000 tables, and complex transformation requirements. Despite encountering data type mismatches, SQL rewrites, performance issues, and hidden costs, the team successfully completed the migration and achieved a modern, scalable, and cost-effective cloud solution.
AWS BigQuery GCP Experience March 24, 2025BigQuery’s Ridiculous Pricing Model Cost Us $10,000 in Just 22 Seconds!!! - Yes, you read that right. $10,000 burned in less than half a minute.
BigQuery Gemini March 24, 2025How to Implement Hybrid Search for RAG with BigQuery - This article discusses how to implement hybrid search for RAG (Retrieval Augmented Generation) with BigQuery. It explains the shortcomings of traditional RAG approaches that rely solely on vector search and introduces the concept of hybrid search, which combines keyword and vector searches.
BigQuery Data Science Python March 24, 2025Build a vector search application in Python using BigFrames - Vector search, powered by generative AI, is the key to unlocking valuable insights from unstructured data. BigFrames, an open-source Python library, empowers data scientists and developers to leverage familiar Python tools like Pandas and Scikit-learn for vector search within BigQuery.
Showing 391–420 of 2427 resources
Useful Links
Contact
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]