Tag: LLM

Resources about LLM collected from the weekly GCP Weekly newsletter — a hand-curated collection of Google Cloud Platform news, technical articles, tutorials, videos and release notes. Each entry below links back to the original GCP Weekly issue and retains its publish date and title, giving you a focused, searchable knowledge base for this topic.

AI LLM Security March 31, 2025

Leveraging GCP Model Armor for Robust LLM and Agentic AI Security - Model Armor, a conceptual framework for securing AI models, addresses vulnerabilities in agentic AI systems, such as prompt injection, data poisoning, model extraction, and unintended consequences.

Cloud Firestore Generative AI LLM March 31, 2025

RAG with a PDF using LlamaIndex and SimpleVectorStore on Vertex AI - A sample on how to set up a PDF-based RAG pipeline with LlamaIndex and Vertex AI is presented. The process involves loading the PDF into documents, splitting the documents into chunks, creating vector embeddings, and querying the index with a Vertex AI model.

AI Cloud Run LLM Serverless March 31, 2025

Deploy your first LLM on GCP: Gemma with Cloud Run (Serverless & GPU-powered) - Deploy your own powerful language model (LLM) in the cloud using Google Cloud Run GPU. With Ollama and Cloud Run, you can easily run LLMs like Gemma without the need for a powerful local GPU. This serverless solution allows you to pay only when your model is in use, making it cost-effective for occasional or on-demand workloads.

Cloud Spanner Databases Generative AI LLM Official Blog March 24, 2025

Build GraphRAG applications using Spanner Graph and LangChain - Spanner Graph and LangChain streamline GraphRAG development by combining Spanner Graph's enterprise-grade reliability, scalability, and distributed graph processing with LangChain's versatile tools. This enables rapid prototyping of intelligent applications and unlocks valuable data insights. GraphRAG outperforms conventional RAG by providing richer, more informative answers through graph traversals and context retrieval.

Cloud Run Generative AI LLM March 17, 2025

Ollama on Cloud Run with GPU in less than 20 seconds!

Cloud Run LLM Official Blog March 17, 2025

How to deploy serverless AI with Gemma 3 on Cloud Run - Gemma 3, a family of lightweight, open AI models, is now available on Cloud Run. Gemma 3 is engineered for exceptional performance with lower memory footprints, making it ideal for cost-effective inference workloads.

Gemini LLM Official Blog March 10, 2025

Use Gemini 2.0 to speed up document extraction and lower costs - Gemini 2.0, a powerful AI tool, can help businesses speed up document extraction and lower costs. This article presents a multi-step approach to document extraction using Gemini 2.0 and structured, externalized rules. This method offers advantages like modular extraction, externalized rule management, and easy integration with existing data pipelines.

AI Generative AI Kubernetes LLM March 3, 2025

Streamline your LangChain deployments with LangServe - LangServe is a helpful tool designed to simplify the deployment of LangChain applications as REST APIs.

Generative AI LLM Official Blog March 3, 2025

Announcing Claude 3.7 Sonnet, Anthropic’s first hybrid reasoning model, is available on Vertex AI - Anthropic's Claude 3.7 Sonnet, the first hybrid reasoning model, is now available on Vertex AI. It combines rapid responses with step-by-step reasoning visible to users and is optimized for real-world use cases.

LLM Official Blog Vertex AI March 3, 2025

Evaluate gen AI models with Vertex AI evaluation service and LLM comparator - Vertex AI evaluation service and LLM Comparator are tools that help evaluate and compare generative AI models. Vertex AI evaluation service allows users to define custom metrics and perform pairwise evaluations, while LLM Comparator provides human-in-the-loop evaluation capabilities with visualizations and insights.

AI LLM Feb. 3, 2025

How Generative AI Transforms Enterprise Data Insights with Google Gemini and Teradata - GenAI tools, like Google Gemini and Teradata Vantage are transforming the way businesses analyze vast amounts of unstructured data.

Generative AI LLM Vertex AI Feb. 3, 2025

Running DeepSeek: From Open Source Model to Production-Ready API on Google Cloud — VertexAI - This guide breaks down the end-to-end deployment of the 7B parameter language model DeepSeek, tackling performance, cost optimization, and best practices to make it efficient, responsive, and cloud-native on Google Cloud Vertex AI.

AI Cloud Run LLM Jan. 27, 2025

Building GenAI Chat App (Part 1): How to Deploy Gemma 2 on Cloud Run Utilizing Ollama - This article provides a step-by-step guide on deploying Gemma 2, an open-source large language model, on Google Cloud Run using Ollama.

Generative AI LLM Jan. 27, 2025

Improve the RAG pipeline with RAG triad metrics - This article discusses how to improve the performance of a Retrieve-and-Generate (RAG) pipeline using RAG triad metrics (answer relevancy, faithfulness, and contextual relevancy).

AI BigQuery LLM Jan. 20, 2025

What is an agent, and does your data need one? - This blog introduces the idea of agents and explores the opportunities (and challenges) they bring to the world of data.

Generative AI LLM Jan. 13, 2025

Evaluating RAG pipelines - This article goes through different approaches to evaluating RAG pipelines and what metrics to use.

Gemini Generative AI LLM Dec. 16, 2024

Introducing Gemini 2.0: our new AI model for the agentic era - An Introduction to Gemini 2.0 Flash and other AI-related projects.

Gemini LLM Dec. 16, 2024

Building product recommendation bot using Gemini — Part 2— Voice, Gemini 2.0 announcement - In this part we cover giving our bot a voice input (using Speech-to-Text or LLM) and voice output (using Text-to-Speech or new Gemini 2.0).

Cloud Firestore Cloud Run LLM Vertex AI Dec. 9, 2024

Deploying AI Agents on Google Cloud Platform - Deploying AI agents with large language models (LLMs) can be challenging, but this article demonstrates how to do it cost-effectively on Google Cloud Platform using LangChain and LangGraph. The technology stack includes Firestore for the vector store, Vertex AI for text embedding and the LLM, Cloud Run for deployment, Cloud Functions for preprocessing, and Cloud SQL for persistence.

Cloud Run Gemini LLM Dec. 9, 2024

Deploying LlamaIndex Workflows to Cloud Run with Llama Deploy - This guide provides a comprehensive walkthrough of deploying custom LLM workflows on Google Cloud Run with Llama Deploy. It covers containerization, building an interactive Flask app, and empowering users to deploy and scale AI solutions with ease. The full code for the sample application is available in the provided repository.

GKE Kubernetes LLM Dec. 9, 2024

Deploying vLLM on Google Cloud: A Guide to Scalable Open LLM Inference - This guide explores deploying a production-ready LLM inference service on Google Cloud Platform using vLLM. It includes a step-by-step deployment guide, configuration considerations, and production best practices for memory management, request handling, Kubernetes infrastructure setup, and security.

Gemini LLM Monitoring OpenTelemetry Dec. 2, 2024

Tracing with Langtrace and Gemini - Langtrace is an open-source observability tool that helps you improve your Large Language Model (LLM) apps by collecting and analyzing traces. It has an SDK to collect traces from LLM APIs, Vector Databases, and LLM-based Frameworks. The traces are OpenTelemetry compatible and can be exported to Langtrace or any other observability stack.

BigQuery LLM Dec. 2, 2024

Text-to-SQL with Gemini and BigQuery: Using LlamaIndex to Simplify Dynamic Prompt Generation - This article demonstrates how to build a text-to-SQL application using LlamaIndex, Gemini, and Google BigQuery. It addresses common challenges like handling dynamic business context, multiple tables, and dynamic prompts. Real-world applications include business intelligence dashboards, customer support tools, data exploration, and data engineering.

LLM Official Blog Vertex AI Nov. 25, 2024

Announcing Mistral AI’s Large-Instruct-2411 on Vertex AI - Google Cloud has announced the availability of Mistral AI's newest model, Mistral-Large-Instruct-2411, on Vertex AI Model Garden. This advanced dense large language model (LLM) has 123B parameters and offers strong reasoning, knowledge, and coding capabilities.

API LLM Official Blog Nov. 25, 2024

Don't let resource exhaustion leave your users hanging: A guide to handling 429 errors - This article explores strategies to handle 429 resource exhaustion errors when using large language models (LLMs) in production. It discusses three practical approaches: backoff and retry mechanisms, dynamic shared quota, and provisioned throughput.

LLM Security Nov. 18, 2024

LLM Guard and Vertex AI - LLM Guard is a comprehensive security toolkit for LLMs, offering input and output scanners for sanitization, harmful language detection, data leakage prevention, and more. It integrates with Vertex AI, allowing users to securely interact with LLMs and protect sensitive information. LLM Guard also includes anonymize and de-anonymize scanners to ensure personal data is not shared with the LLM.

AI LLM Official Blog Threat Intelligence Nov. 18, 2024

Pirates in the Data Sea: AI Enhancing Your Adversarial Emulation - This blog post discusses how artificial intelligence (AI) and large language models (LLMs) can be used to enhance adversarial emulation and improve cybersecurity.

Cloud Run Generative AI LLM Official Blog Nov. 18, 2024

How to deploy Llama 3.2-1B-Instruct model with Google Cloud Run GPU - Deploy the Meta Llama 3.2 1B Instruction model on Cloud Run with NVIDIA GPUs. This guide provides step-by-step instructions for local model testing, deployment, and cold start improvements using Cloud Storage FUSE.

Gemini LLM Official Blog Vertex AI Nov. 18, 2024

Use AI to build AI: Save time on prompt design with AI-powered prompt writing - Vertex AI introduces AI-powered prompt writing tools to streamline prompt engineering for generative AI models. The Generate prompt feature creates comprehensive prompts from simple objectives, while the Refine prompt feature provides AI-powered suggestions for prompt improvement based on user feedback.

LLM Vertex AI Web3 Nov. 11, 2024

Talk to Your Cronos Data: AI Agent based User Experiences for Blockchain Insights - Talk to Your Cronos Data: AI Agent based User Experiences for Blockchain Insights explores the use of AI agents to simplify complex blockchain data and enhance its accessibility. By leveraging Google Cloud's Vertex AI and Agent Builder, users can interact with on-chain data using natural language queries, making blockchain insights readily available to a broader audience.

Showing 181–210 of 302 resources

 

Latest Issues




Contact

Zdenko Hrček
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]