Tag: LLM

Resources about LLM collected from the weekly GCP Weekly newsletter — a hand-curated collection of Google Cloud Platform news, technical articles, tutorials, videos and release notes. Each entry below links back to the original GCP Weekly issue and retains its publish date and title, giving you a focused, searchable knowledge base for this topic.

LLM Vertex AI Nov. 4, 2024

PPT Query Tool with Google’s LLMs - This blog post introduces a pipeline that allows users to quickly retrieve relevant slides from content-heavy slide decks using Google's Vertex AI Text Embedding model and cosine similarity. The pipeline involves converting PowerPoint slides to images, generating embeddings for semantic search, storing embeddings and metadata in BigQuery, processing user queries, and retrieving top matches with summarization.

Gemini GitHub LLM Official Blog Nov. 4, 2024

Gemini models are coming to GitHub Copilot - GitHub Copilot, a popular AI coding assistant, is partnering with Google Cloud to bring Gemini models to its platform. Developers will soon be able to use Gemini 1.5 Pro, which excels in code generation, analysis, and optimization, within GitHub Copilot.

Generative AI LLM Oct. 28, 2024

Building a Scalable Pipeline for Continuous Document Indexing to Power RAG based Q&A - Continuous Document Indexing and Q&A Solution with Google Cloud, Redis, and LangChain.

Generative AI LLM Machine Learning Oct. 28, 2024

Designing Cognitive Architectures: Agentic Workflow Patterns from Scratch - This article explores 8 advanced agentic workflow patterns that enhance the capabilities of AI systems using Large Language Models (LLMs) and AI agents.

Generative AI LLM Machine Learning Vertex AI Oct. 28, 2024

Model Alignment Through Automatic Prompt Updates From User Feedback - Google researchers have developed a technique to automatically improve prompts for language models based on user-provided feedback. The technique is available as an open-source Python library and through a user interface in Vertex AI Studio, making it easy for prompt developers to use. Prompt refinement with this model alignment technique has been shown to boost the quality of prompts and save significant time during prompt design.

LLM Official Blog Partners Vertex AI Oct. 28, 2024

Announcing Anthropic’s upgraded Claude 3.5 Sonnet on Vertex AI - Anthropic's upgraded Claude 3.5 Sonnet model is now generally available on Vertex AI, featuring a new "computer use" capability in public beta. This means you can use the model to direct the model to generate computer actions, like keystrokes and mouse clicks, allowing it to interact with your user interface (UI).

Generative AI LLM Machine Learning Oct. 14, 2024

Building ReAct Agents from Scratch: A Hands-On Guide using Gemini

Generative AI LLM Oct. 14, 2024

Multi-Agent interactions with Autogen and Gemini — Part 2 : Terminating Conversations - This is the second part of a series exploring multi-agent conversations using the Autogen framework. In this part, we focus on terminating conversations based on specific feedback from one of the agents. We introduce the `is_termination_msg` condition in the CFP Writer agent, which checks for a specific message (e.g., "Looks good") in the response from the CFP Reviewer agent. If this message is detected, the conversation is terminated. We also modify the System Message for the CFP Reviewer to suggest mentioning "looks good" when there are no significant improvements. The final code is provided, and the complete repository is available on GitHub.

AI Cloud Firestore LLM Oct. 7, 2024

Persisting LLM chat history to Firestore - LangChain and Firestore can be used to build LLM powered chat applications. LangChain's RunnableWithMessageHistory helps manage chat message history, while Firestore's FirestoreChatMessageHistory stores messages to a Firestore collection. This allows for persistent chat history and more meaningful conversations. Future posts will explore advanced use cases for Firestore in LLM applications.

Generative AI LLM Official Blog Oct. 7, 2024

When to use supervised fine-tuning for Gemini - This article delves into what SFT (Supervised Fine-Tuning) is, when to embrace SFT, and how it compares to other methods for optimizing your models output.

Generative AI LLM Sept. 30, 2024

Fine-Tuning LLM: Crafting Personalized Ad Copy with Tuned-Gemini Model - This article presents a proof of concept for fine-tuning large language models for specific marketing needs. The authors fine-tuned Google's Gemini-1.0-pro-002 model on a dataset of Facebook ads from Planned Parenthood Action, resulting in a specialized AI capable of generating ad copy that closely mimics the organization's style and messaging.

Generative AI LLM Official Blog Partners Vertex AI Sept. 30, 2024

Meta's Llama 3.2 is now available on Google Cloud - Meta's new generation of multimodal models, Llama 3.2, is now available on Google Cloud's Vertex AI Model Garden. Llama 3.2 includes new vision and lightweight models designed for edge devices, enabling more private and personalized AI experiences.

AlloyDB LLM Sept. 23, 2024

AI on your Laptop with AlloyDB Omni and Ollama. - AlloyDB Omni, a fully-managed PostgreSQL-compatible database service, can be integrated with Ollama, an open-source tool for running large language models locally, to generate embeddings from user inputs stored in databases. The process involves setting up Ollama on the local laptop, integrating AlloyDB Omni with Vertex AI, setting up input and output transformation, and loading the local model into AlloyDB Omni.

Cloud Functions LLM Sept. 16, 2024

Using Google Workflows and Cloud Functions to build an LLM-based app - This article describes the architecture of Biglang.app, a language-learning tool that leverages LLMs to enable users to create exercises from any content they like.

LLM Official Blog Vertex AI Vertex AI Agent Builder Sept. 16, 2024

Next-gen search and RAG with Vertex AI - Vertex AI offers a comprehensive suite of tools and services to build next-gen search applications. It provides out-of-the-box solutions for building semantic and hybrid search applications, as well as DIY APIs for developers who want to construct their own end-to-end RAG solutions. Vertex AI Search can be used to tackle analytical queries, and it integrates with other Google Cloud capabilities such as Vertex AI Agent Builder and BigQuery data canvas.

Gemini LLM Official Blog Sept. 16, 2024

Test it out: an online shopping demo experience with Gemini and RAG - An online shopping demo showcases how Gemini, a large language model, can enhance the shopping experience by providing personalized recommendations. Retrieval-Augmented Generation (RAG) improves the accuracy of Gemini's responses by incorporating relevant data from an external database, ensuring that recommendations are based on actual products in the store's inventory.

BigQuery Data Analytics Generative AI LLM Official Blog Partners Sept. 9, 2024

BigQuery and Anthropic’s Claude: A powerful combination for data-driven insights - Google Cloud has integrated Anthropic's Claude models with BigQuery, allowing organizations to leverage advanced AI capabilities directly within their data platform. This integration enables tasks like text generation, summarization, translation, and more, to be performed directly on data in BigQuery.

AI LLM Machine Learning Vertex AI Sept. 2, 2024

Vertex AI Function Calling - LLMs are turning into reasoning engines using capabilities like web search and calling external APIs.

AI Generative AI LLM Official Blog Sept. 2, 2024

Magic partners with Google Cloud to train frontier-scale LLMs - Magic, a generative AI startup, has partnered with Google Cloud to build two new cloud-based supercomputers to support its mission of developing code assistants with a context window reaching 100 million tokens.

Gemini LLM Aug. 26, 2024

Semantic Kernel and Gemini - Semantic Kernel is an open-source development kit from Microsoft that lets you easily build AI agents and integrate the latest AI models into your applications. This blog post demonstrates how to use Semantic Kernel to build a chat application with Gemini.

LLM Official Blog Security Aug. 26, 2024

Testing your LLMs differently: Security updates from our latest Cyber Snapshot Report - Security teams should update their approach to assessing and adapting existing security methodologies for LLMs. LLMs' ability to accept non-structured prompts can expose security weaknesses and lead to exploitation, such as sensitive information disclosure. Incorporating probabilistic testing can help provide better evaluation and protection against prompt injection, excessive agency, and overreliance.

LLM Official Blog Partners Vertex AI Aug. 26, 2024

Announcing the Jamba 1.5 Model Family from AI21 Labs on Vertex AI - The Jamba 1.5 Model Family from AI21 Labs is now available on Vertex AI Model Garden. They excel in handling key enterprise use cases such as summarizing and analyzing lengthy documents, powering RAG-based solutions, and a wide range of applications that demand both high-quality output and efficiency.

Generative AI GKE LLM Official Blog Vertex AI Aug. 26, 2024

Choosing between self-hosted GKE and managed Vertex AI to host AI models - A comparison of managed Vertex AI solutions with self-hosted options on Google Kubernetes Engine for deploying Large Language Model (LLM) and Gen AI applications on Google Cloud Platform.

GKE GPU LLM Official Blog Aug. 26, 2024

Maximize your LLM serving throughput for GPUs on GKE — a practical guide - This blog post contains recommendations that can help you maximize your serving throughput on NVIDIA GPUs on GKE. Combining these recommendations with the performance benchmarking tool will enable you to make data-driven decisions when setting up your inference stack on GKE.

Generative AI LLM Vertex AI Aug. 19, 2024

DeepEval and Vertex AI - DeepEval is an open-source evaluation framework for Large Language Models (LLMs) that allows "unit testing" LLM outputs. It can be configured to work with Vertex AI, Google's machine learning platform.

Gemini LLM Vertex AI Aug. 5, 2024

Beyond temperature: Tuning LLM output with top-k and top-p - What are top-k and top-p? What do they mean, how do they work, and how can they be tuned?

Cloud SQL Generative AI LLM Aug. 5, 2024

Retrieval Augmented Generation (RAG) with Cloud SQL for MySQL - How to build a Generative AI application with your Cloud SQL for MySQL database.

Gemini Generative AI Java LLM Aug. 5, 2024

Sentiment analysis with few-shot prompting - This article explores sentiment analysis using few-shot prompting with Gemini and LangChain4j. It demonstrates three approaches: using a big string of inputs/outputs, a low-level list of messages, and an AiServices abstraction.

Generative AI LLM Official Blog Aug. 5, 2024

Enhancing LLM quality and interpretability with the Vertex AI Gen AI Evaluation Service - The Vertex AI Gen AI Evaluation Service helps developers improve the quality and interpretability of large language models (LLMs) by generating diverse responses, automating the selection of the best response, and providing quality metrics and explanations. This workflow can be applied to any modality or use case, including text, images, and audio, and can be parallelized to minimize latency.

Generative AI LLM July 29, 2024

Portable Training Data Generation for Supervised Fine-tuning: A Reverse RAG approach! - This blog introduces an automated approach to fine-tune large language models (LLMs) using a "Reverse RAG" method. The key idea is to generate question-and-answer pairs from raw information using an arbiter model, and then use these pairs as training data for fine-tuning. This approach can significantly streamline the fine-tuning process and improve the performance of LLMs on specific tasks.

Showing 211–240 of 302 resources

 

Latest Issues




Contact

Zdenko Hrček
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]