Open Source AI

Embeddings models convert data into numerical representations that can be stored in a vector database, and retrieved by a large language model through a framework such as LangChain for retrieval augmented generation. A common use case is embedding unstructured data,…

Serverless Deployment of AI Middleware, LiteLLM, with Google Cloud Run

AI Infrastructure

AI Middleware, AI Proxy, Azure, Cloud Run, Generative AI, Google Cloud, LiteLLM, Microservices, Open Source AI, PostgreSQL, Serverless

AI middleware is an emerging term for the layer of the technology stack that facilitates the interfacing of AI end user applications with the Large Language Models and GPU-accelerated machines that drive them. Here are the major sub-categories of this…

AI Retrieval Augmented Generation in the (Virtual) Private Cloud

AI Infrastructure

ChatGPT Alternative, GenAI, Generative AI, Open LLM Models, Open Source AI, Private AI, Retrieval Augmented Generation

Retrieval Augmented Generation (RAG) is an AI technique for getting more tailored responses from a foundation model, without the need for training or fine-tuning a model from scratch. Large Language Models, such as Meta’s LLaMA 2, provide high quality responses…

Run Open AI Models for Enterprise with a ChatGPT “Clone”

AI Infrastructure

Bionic-GPT, ChatGPT Alternative, GenAI, Generative AI, LibreChat, Open AI Models, Open LLM Models, Open Source AI, OpenAI Compatible API, Self-Hosted Apps

Are you looking for an alternative to ChatGPT Enterprise with no minimum number of seats or annual contract, with enterprise features such as single-sign on (SSO) through Google Workspace, OpenID, or Microsoft Entra ID? It is worth considering running an…

Locally Hosted Open Source LLM AI Models

Private, Local AI with Open LLM Models

AI Infrastructure

GenAI, Generative AI, GPT4All, LLaMA 2, LocalAI, Open LLM Models, Open Source AI, OpenAI Alternative, OpenAI Compatible API, Private AI, Self Hosted AI

To date, most implementations of AI in applications using GPT Large Language Models (LLMs) rely on calling the OpenAI API, which surprisingly, contrary to what its name might suggest, is not open-source. This pattern has become so common that a…

Open Source AI

Local Embeddings with Hugging Face Text Embedding Inference

Serverless Deployment of AI Middleware, LiteLLM, with Google Cloud Run

AI Retrieval Augmented Generation in the (Virtual) Private Cloud

Run Open AI Models for Enterprise with a ChatGPT “Clone”

Private, Local AI with Open LLM Models