Google Cloud

AlloyDB Vector Database for Retrieval Augmented Generation

folder_openAI Infrastructure
turned_in_notAlloyDB, Embeddings Models, Generative AI, Google Cloud, LibreChat, PostgreSQL, Retrieval Augmented Generation, Vector Databases
AlloyDB is a fork of PostgreSQL on Google Cloud, optimized for high performance with vector embedding & retrieval workloads. As a PostgreSQL-compatible database, AlloyDB can be used as a drop-in replacement for any application that relies on a Postgres backend.…
Read More

Serverless Deployment of AI Middleware, LiteLLM, with Google Cloud Run

folder_openAI Infrastructure
turned_in_notAI Middleware, AI Proxy, Azure, Cloud Run, Generative AI, Google Cloud, LiteLLM, Microservices, Open Source AI, PostgreSQL, Serverless
AI middleware is an emerging term for the layer of the technology stack that facilitates the interfacing of AI end user applications with the Large Language Models and GPU-accelerated machines that drive them. Here are the major sub-categories of this…
Read More