Tag: LLM

Resources about LLM collected from the weekly GCP Weekly newsletter — a hand-curated collection of Google Cloud Platform news, technical articles, tutorials, videos and release notes. Each entry below links back to the original GCP Weekly issue and retains its publish date and title, giving you a focused, searchable knowledge base for this topic.

Big Data BigQuery LLM Machine Learning June 15, 2026

You Probably Don’t Need a Vector Database - If Your Data Already Lives in BigQuery - How I built an end-to-end RAG proof-of-concept in pure SQL: no new infrastructure, no data movement, and pay-per-query cost.

AI Gemma LLM June 15, 2026

DiffusionGemma: The Developer Guide - DiffusionGemma is an experimental text-generation model built on the Gemma 4 architecture that uses diffusion-based parallel generation instead of token-by-token autoregression, enabling much faster inference, bidirectional context awareness, and real-time self-correction while remaining deployable on consumer GPUs. Its architecture generates and refines 256-token blocks in parallel through iterative denoising, allowing it to handle complex constraint-based tasks such as Sudoku more effectively than traditional language models and demonstrating strong gains from fine-tuning. The model integrates with vLLM and other popular inference frameworks, giving developers access to a new non-autoregressive approach that combines high performance, efficient long-context scaling, and straightforward customization and deployment.

AI GKE LLM Networking Official Blog June 15, 2026

Report: GKE Inference Gateway delivers up to 92% faster AI responses - GKE Inference Gateway uses prefix caching and other routing algorithms to land requests on the best accelerator for the job.

LLM Official Blog June 15, 2026

Claude Fable 5: Available on Google Cloud - Claude Fable 5, Anthropic’s latest frontier model, is now generally available on Google Cloud.

Antigravity Generative AI LLM Official Blog June 15, 2026

Choosing your surface: Antigravity 2.0, Antigravity CLI, Antigravity IDE, or Antigravity SDK - Compare Antigravity surfaces: 2.0 (Desktop), CLI, IDE, and SDK. Choose the best interface for your workflow—whether desktop orchestration, terminal, or custom Python.

Generative AI LLM Official Blog June 15, 2026

10 Indispensable Prompts Our Team Refuses to Build Without - Boost your developer productivity with 10 proven AI prompts used by our engineering team to ship high-quality, robust code. Learn how to de-risk your development process and streamline your workflow with these expert-tested prompt strategies.

Antigravity Generative AI LLM June 8, 2026

Deep Dive: Antigravity Agent Skills - This article dives into Antigravity Agent Skills, defining them as prescriptive instructions that guide AI tools in using Large Language Models to complete specific tasks. It illustrates how these skills, structured with metadata and instructions, can be executed sequentially or in parallel within the Google Antigravity developer environment. Utilizing "sub agents" allows for efficient parallel execution and improved context management, enhancing the overall AI workflow.

AI Gemma LLM June 8, 2026

Gemma 4 12B: The Developer Guide - The newly released Gemma 4 12B is a dense, multimodal model designed for high-performance local AI execution on consumer devices. By introducing a novel, encoder-free architecture, it bypasses traditional visual and audio encoders to feed multimodal data directly into the LLM backbone.

AI Gemma LLM June 8, 2026

Bringing Gemma 4 12B to your Laptop: Unlocking Local, Agentic Workflows with Google AI Edge - Google DeepMind’s Gemma 4 12B model brings agentic, multimodal AI capabilities to everyday laptops with 16GB of RAM, enabling local data processing and visual insight generation. Users can leverage this model on macOS through the Google AI Edge Gallery for dynamic Python code execution and visualization, as well as via Google AI Edge Eloquent for completely offline voice dictation and text editing. Additionally, developer workflows are enhanced by the LiteRT-LM CLI new serve command, which creates an industry-compatible local endpoint to power fully-local AI tools and agents.

Kubernetes LLM Paywall TPU June 1, 2026

Autoscaling vLLM on GKE with TPU Nodes: Autopilot vs Standard Mode Compared - A practical ops-focused guide for deploying and scaling LLM inference on Google Kubernetes Engine with TPU node pools.

LLM Model Armor June 1, 2026

Model Armor: How to Actually Secure LLMs in Production (Without Killing Innovation) - Google Cloud Model Armor provides an essential security layer for Large Language Models in production, addressing critical risks such as prompt injection, data leakage, and harmful outputs. Acting as an inline proxy, it screens both user inputs and model responses to enforce security policies, redact sensitive information, and log activities for compliance.

Agents LLM June 1, 2026

Agents Are Now Files - Google’s new Managed Agents API isn’t the interesting part. The fact that you define an agent in two markdown files is.

AI Gemma LLM June 1, 2026

How the community trained Gemma to "Think" with Tunix and TPUs - The Google Tunix Hackathon on Kaggle challenged developers to transform small, non-reasoning base models into general reasoning engines using Kaggle TPUs and a limited compute budget. The winning teams achieved this by implementing multi-stage post-training pipelines that combined Supervised Fine-Tuning (SFT) with advanced alignment techniques like GRPO and SimPO.

LLM Official Blog June 1, 2026

Nano Banana 2 and Nano Banana Pro are generally available, and already powering creative workflows - Nano Banana 2 and Nano Banana Pro are generally available today via Gemini Enterprise Agent Platform. These models empower you to integrate high-quality image generation and editing capabilities directly into your applications and workflows.

Infrastructure LLM Python May 25, 2026

Smoothing Spiky LLM Traffic: Maximize Provisioned Throughput Utilization With a Queuing Architecture - To effectively manage unpredictable bursts of LLM traffic and maximize dedicated Provisioned Throughput, this article proposes a serverless queuing architecture. By using Google Cloud Tasks as a "shock absorber," it smooths request processing, ensuring consistent performance for near real-time applications and preventing requests from being dropped.

LLM Model Armor May 25, 2026

I built a red team agent to test Google’s AI firewall — here’s what Model Armor actually catches - An expert developed an autonomous red team agent to systematically evaluate Google's AI firewall, Model Armor, uncovering significant limitations. The testing revealed that Model Armor's floor settings can disrupt sessions and that its confidence levels exhibit inconsistent protection, allowing bypasses for hypothetical jailbreaks and certain sensitive data.

Cloud Run LLM May 18, 2026

`gcloud run compose up`: Deploy a Multi-Service GPU Stack to Cloud Run from Docker Compose - A practical guide to gcloud run compose up, and the pitfalls nobody tells you about.

AI Gemma GKE Kubernetes LLM May 18, 2026

Part 1: Use GKE managed DRANET with GPUs and autopilot cluster - This article demonstrates how to deploy high-performance AI workloads on Google Kubernetes Engine (GKE) using its managed DRANET feature, B200 GPUs, and Autopilot clusters. It provides a detailed guide on setting up the environment, including creating resource claims and compute classes, to deploy and interact with a large language model like Gemma 4-31B via vLLM containers.

Agents Generative AI LLM Official Blog Security May 18, 2026

Beyond source code: The files AI coding agents trust — and attackers exploit - As AI coding agents become embedded in developer workflows, defenders must rethink how to protect against malicious files. Here’s what you need to know.

Data Analytics Databases LLM Official Blog May 18, 2026

The power of LLMs on your data, more than two orders of magnitude faster and cheaper - Proxy models use embeddings to replace most LLM calls, boosting speed and cutting token costs by >100x. Benchmarks confirm they deliver commensurate quality to LLMs.

LLM Model Armor May 4, 2026

How to wear Model Armor 2: Integrating with ADK and LangChain - Secure your AI agents. Learn to interpret Model Armor API responses and implement direct security hooks in both LangChain and Google ADK.

LLM TPU May 4, 2026

Beyond the Basics: 4.5x Performance with Disaggregated Serving on TPUs - This article demonstrates a significant performance boost for large language models (LLMs) on Google Cloud TPUs through a disaggregated serving architecture. By separating the prefill and decode phases and utilizing the GKE Inference Gateway, throughput increased 4.5x, from 3,000 to over 14,000 tokens/sec.

LLM TPU May 4, 2026

Serve and Inference Gemma 4 on TPU - This article outlines how to efficiently serve Google's Gemma 4 multimodal model on Tensor Processing Units (TPUs) within Google Cloud. It details a step-by-step process using vLLM, a high-performance inference engine, to maximize hardware utilization and achieve rapid, sub-second inference for complex AI workflows.

AI Gemini LLM May 4, 2026

Building with Gemini Embedding 2: Agentic multimodal RAG and beyond - Google has announced the general availability of Gemini Embedding 2, a unified model that maps text, images, video, audio, and documents into a single semantic space. This model allows developers to process interleaved multimodal inputs in a single request, significantly improving performance for tasks like agentic RAG, visual search, and content moderation. By supporting over 100 languages and offering features like task-specific prefixes and Matryoshka dimensionality reduction, the model provides a highly efficient and accurate foundation for building complex AI agents.

Gemini LLM Official Blog April 20, 2026

Guide to prompting Gemini 3.1 Flash TTS (text-to-speech) - Today, we're introducing the Gemini 3.1 Flash Text-to-Speech (TTS) model, our latest TTS model, available on Google AI studio and Vertex AI. It delivers precise controllability and expressivity, empowering developers and enterprises to build advanced AI-speech applications.

LLM Official Blog Vertex AI April 20, 2026

Claude Opus 4.7 on Vertex AI - By pairing Opus 4.7 with Vertex AI, your business can build, scale, and govern agents on a platform that provides the optimized infrastructure, agentic tooling, and unified security controls needed to run AI workloads with confidence.

GKE LLM April 13, 2026

vLLM: Production AI Inference on GKE with OpenWebUI, Gateway API, and TLS - This article outlines how to build a production-grade AI inference platform on Google Kubernetes Engine (GKE) Autopilot. It details using vLLM for high-throughput, low-latency LLM serving with features like continuous batching and PagedAttention, connected to OpenWebUI for a user-friendly interface.

Generative AI LLM Official Blog April 13, 2026

Build music generation into your apps with Lyria 3 models on Vertex AI - Lyria 3, Google's family of music generation models, is now available on Vertex AI in public preview. With Lyria 3, you can generate high-quality, high-fidelity stereo audio from text prompts and from images with vocal support.

Generative AI LLM Official Blog April 13, 2026

Ultimate prompting guide for Lyria 3 models - Lyria 3 and Lyria 3 Pro are our most advanced music generation models, designed to give you granular control over vocals, instrumentation, and arrangement. Our guide shares exactly what we learned and how you can get the best results.

LLM Machine Learning TPU April 6, 2026

Engineering Journal: Fine-Tuning Gemma 3 1B with JAX and Tunix on Google Cloud TPU v5e — Full Workflow and Troubleshooting Guide - This article provides a comprehensive guide to fine-tuning Gemma 3 1B on Google Cloud TPU v5e using JAX and Tunix, detailing the full workflow and troubleshooting common issues encountered.

Showing 61–90 of 302 resources

 

Latest Issues




Contact

Zdenko Hrček
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]