Tag: LLM
Resources about LLM collected from the weekly GCP Weekly newsletter — a hand-curated collection of Google Cloud Platform news, technical articles, tutorials, videos and release notes. Each entry below links back to the original GCP Weekly issue and retains its publish date and title, giving you a focused, searchable knowledge base for this topic.
Generative AI LLM July 28, 2025It’s a Bird, It’s a Plane, It’s… One Tool with Many Powers! - Simplify Your Agent Tools with Optional Parameters.
Generative AI LLM July 14, 2025Gen AI Evaluation Service — Model-Based Metrics - The article discusses model-based metrics within Vertex AI's Gen AI Evaluation Service, highlighting the use of LLMs as judges for evaluating model outputs. It covers built-in metrics for translation, fluency, safety, and more, as well as custom metrics, including RAG triad implementation.
Chronicle Gemini LLM July 14, 2025Implementing Custom AI Investigators in Vertex AI for Google SecOps - This article details how to leverage Gemini AI models within Google Cloud's Vertex AI and SecOps platform to automate alert triage.
ADK Generative AI LLM Official Blog July 7, 2025A guide to converting ADK agents with MCP to the A2A framework - Transform standalone Google ADK agents into collaborative A2A components. This guide shows how to unlock multi-agent potential and interoperability.
ADK Generative AI LLM Official Blog July 7, 2025How to build a simple multi-agentic system using Google’s ADK - Learn how to build a simple multi-agentic system in just a few steps using Google’s ADK – Agent Development Kit.
AI Data Science LLM Paywall June 30, 2025Talk to Your Docs: Building a Scalable RAG App on Google Cloud - Build a modular, secure, and scalable RAG system with Python, LangChain, and Google Cloud’s serverless stack.
Gemini LLM Official Blog Vertex AI June 30, 2025How to fine-tune Gemini 2.5 using videos via Vertex AI - Gemini 2.5 is making it possible to fine-tune video outputs on Vertex AI. Read more to learn how to conduct truly effective tuning experiments using the Vertex AI tuning service.
AI LLM Official Blog June 30, 2025You dream it, Veo creates it: Veo 3 is now available for everyone in public preview on Vertex AI - Veo 3 text-to-video is now available for all Google Cloud customers in public preview on Vertex AI. Learn more about Veo 3 and try it on Vertex AI Media Studio today.
GCP Certification LLM June 23, 2025Want to become Google Cloud GenAI Leader? Your Guide to AI Mastery - The article provides a comprehensive guide to Generative AI certificate on Google Cloud, covering fundamental concepts, models, the ML lifecycle, and Google Cloud's GenAI offerings like Gemini and Vertex AI.
LLM June 23, 2025Using HTTP endpoints as tools with MCP Toolbox for Databases - Turn external endpoints into MCP compatible tools using MCP Toolbox.
AI LLM Official Blog June 16, 2025Cloud CISO Perspectives: How Google secures AI Agents - To help mitigate potential agentic AI risks, we need to invest in a new field of study focused specifically on securing agent systems.
LLM Vertex AI June 9, 2025Step-by-Step: Serving PyTorch Models with a Custom Handler on Vertex AI - The article provides a step-by-step guide on deploying PyTorch models with custom handlers on Google Cloud's Vertex AI.
AI Hypercomputer LLM Official Blog May 26, 2025Introducing the next generation of AI inference, powered by llm-d - We’re making inference easier and more cost-effective with llm-d, an open-source, Kubernetes-native, distributed and disaggregated inference platform.
Generative AI LLM Official Blog May 26, 2025Announcing Anthropic’s Claude Opus 4 and Claude Sonnet 4 on Vertex AI - Today, we're announcing the expansion of our Model Garden collection with the addition of two new models from Anthropic: Claude Opus 4 and Claude Sonnet 4.
Generative AI LLM Official Blog May 26, 2025Mistral AI's Le Chat Enterprise and Mistral OCR 25.05 model are available on Google Cloud - Announcing Mistral AI’s Le Chat Enterprise and Mistral OCR 25.05 model are available on Google Cloud.
Generative AI LLM Official Blog Vertex AI May 19, 2025Evaluate your gen media models with multimodal evaluation on Vertex AI - Google Cloud introduces Gecko on Vertex AI, a new rubric-based autorater for evaluating generative AI models, addressing the challenge of assessing the quality of images and videos produced by models like Lyria, Imagen, and Veo.
AI Hypercomputer LLM Official Blog May 12, 2025From LLMs to image generation: Accelerate inference workloads with AI Hypercomputer - Google Cloud is enhancing its AI Hypercomputer with new inference capabilities, including the Ironwood TPU, vLLM support for TPUs, and GKE Inference Gateway and Quickstart. JetStream, Google's inference engine, now integrates Pathways for lower latency and supports multi-host inference, while MaxDiffusion delivers improved image generation performance on TPUs. MLPerf™ Inference v5.0 results highlight the powerful inference performance of A3 Ultra (NVIDIA H200) and A4 (NVIDIA HGX B200) VMs.
Gemini LLM Vertex AI May 5, 2025Vertex AI Batch Generation - Vertex AI Batch Generation offers a 50% cost reduction for Gemini models by enabling parallel processing of multiple multimodal requests as asynchronous jobs. It supports data from Cloud Storage (in JSONL format) and BigQuery, allowing for processing of text, images, audio, and video. The tool offers customizable generation parameters and can be integrated with other tools like Google Search.
Gemini Generative AI LLM May 5, 2025DeepEval adds native support for Gemini as an LLM Judge - DeepEval, an open-source evaluation framework for LLMs, now natively supports Gemini models via the unified Google GenAI SDK. This integration allows users to utilize Gemini as an LLM Judge within DeepEval, either through the command line or directly in code, on both Vertex AI and Google AI. The new integration simplifies the process of evaluating LLM outputs, offering more flexibility and options for developers.
LLM Official Blog May 5, 2025Create chatbots that speak different languages with Gemini, Gemma, Translation LLM, and Model Context Protocol - The article introduces an architecture leveraging Google's Gemma, Translation LLM, and Gemini models, orchestrated via Model Context Protocol (MCP), to build multilingual chatbots. This approach uses specialized AI models for tasks like translation and complex reasoning, improving efficiency and maintainability. A GitHub repository is provided to illustrate the architecture, highlighting its adaptability and ease of management for various applications.
AI Kubernetes LLM April 28, 2025Inference Gateway: Intelligent Load Balancing for LLMs on GKE - GKE Inference Gateway, an extension of the standard GKE Gateway controller, optimizes routing and load balancing for generative AI workloads on Google Kubernetes Engine (GKE). It addresses the unique challenges of stateful LLM inference, such as cache affinity and queue length awareness, to maximize cache reuse and minimize prefill operations.
Gemini LLM Paywall April 28, 2025Chatting With Dataproc Clusters Using An AI Agent - A Dataproc AI agent built using Google’s Agent Development Kit (ADK).
Databases Generative AI LLM Official Blog April 28, 2025Google Cloud Database and LangChain integrations now support Go, Java, and JavaScript - Google Cloud Database and LangChain integrations now support Go, Java, and JavaScript. Developers can now create intricate workflows and easily interchange underlying components as needed to align with specific use cases.
LLM Security April 21, 2025Shielding Your AI Models: A Dive into Google Cloud Model Armor for Securing LLMs - An overview of Google Cloud Model Armor.
Firebase Generative AI LLM April 21, 2025Extending Your AI Application with Genkit MCP - This article introduces Genkit MCP, a framework for connecting large language models to external data and tools. It explains how to integrate Genkit MCP with Genkit, Google Firebase's AI orchestration framework, using the genkitx-mcp plugin.
BigQuery LLM April 21, 2025Forecasting the Future with BigQueryML TimesFM: A Game-Changer in Time Series Analysis - TimesFM, a foundation model built on Google's Large Language Model (LLM) architecture, revolutionizes time series forecasting by offering zero-shot performance and eliminating the need for dataset-specific training. Integrated into BigQuery ML as the AI.FORECAST function, it empowers data analysts to generate sophisticated forecasts using familiar SQL syntax.
Gemini Generative AI LLM April 14, 2025Building AI Agents with Google’s Agent Development Kit (ADK) as MCP Client — A Deep Dive (Full Code) - This article explores how to use the open-source Agent Development Kit (ADK) to build an agent setup assistant using the Model Context Protocol (MCP) with Google Gemini LLM as an MCP Client.
LLM Official Blog Vertex AI April 14, 2025Vertex AI is now the only platform with generative media models across video, image, speech, and music - Google Cloud's Vertex AI platform now offers Lyria, a text-to-music model, making it the only platform with generative media models across video, image, speech, and music.
Gemini LLM Official Blog April 14, 2025Gemini 2.5 brings enhanced reasoning to enterprise use cases - Gemini 2.5, Google's latest AI model, offers enhanced reasoning capabilities for enterprise use cases. Gemini 2.5 Pro excels in complex tasks requiring deep reasoning and coding expertise, while Gemini 2.5 Flash prioritizes speed, low latency, and cost-efficiency for high-volume applications. Vertex AI Model Optimizer helps choose the best model for specific needs, and the Live API enables real-time interactions with streaming audio, video, and text.
AI Kubernetes LLM Official Blog April 7, 2025Google, Bytedance, and Red Hat make Kubernetes generative AI inference aware - Google, ByteDance, and Red Hat have collaborated to enhance Kubernetes for generative AI inference. New capabilities include LLM-aware routing, an inference performance project for benchmarking, and Dynamic Resource Allocation for efficient scheduling of accelerators.
Showing 151–180 of 302 resources
Useful Links
Contact
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]