Open LLM Models

Llama 3 on Cloudflare Workers AI – AI at the Edge

AI as a Service, Cloud Run, CloudFlare, Docker, Edge AI, Generative AI, LibreChat, LiteLLM, Llama 3, NextCloud, Open LLM Models

Cloudflare Workers is a serverless computing platform leveraging Cloudflare’s global network of datacenters, also known as edge locations, in over 300 cities and 100 countries around the world. The Workers service is used by Cloudflare’s customers to host & run…

AI Retrieval Augmented Generation in the (Virtual) Private Cloud

AI Infrastructure

ChatGPT Alternative, GenAI, Generative AI, Open LLM Models, Open Source AI, Private AI, Retrieval Augmented Generation

Retrieval Augmented Generation (RAG) is an AI technique for getting more tailored responses from a foundation model, without the need for training or fine-tuning a model from scratch. Large Language Models, such as Meta’s LLaMA 2, provide high quality responses…

Run Open AI Models for Enterprise with a ChatGPT “Clone”

AI Infrastructure

Bionic-GPT, ChatGPT Alternative, GenAI, Generative AI, LibreChat, Open AI Models, Open LLM Models, Open Source AI, OpenAI Compatible API, Self-Hosted Apps

Are you looking for an alternative to ChatGPT Enterprise with no minimum number of seats or annual contract, with enterprise features such as single-sign on (SSO) through Google Workspace, OpenID, or Microsoft Entra ID? It is worth considering running an…

Retrieval Augmented Generation (RAG) with Local Embeddings

AI Infrastructure

Bionic-GPT, GenAI, Generative AI, Graph Databases, LiteLLM, Neo4j, Open LLM Models, pgVector, Retrieval Augmented Generation, Vector Databases

Retrieval Augmented Generation (RAG) could very well be the hottest topic in generative AI right now. It has been clear since ChatGPT took the world by storm that RAG is one of the best use cases of GenAI for enterprises.…

Proxies & Load Balancers for AI LLM Models (AI Middleware)

AI Infrastructure

AI Middleware, Docker, GenAI, Generative AI, HAProxy, LiteLLM, LLaMA 2, Locally Hosted AI, Ollama, Open LLM Models, OpenAI Compatible API

The Cambrianesque explosion of capable, open Large Language AI Models represents an opportunity to extend virtually any application with AI capabilities, but a strategy for managing multiple AI endpoints is clearly needed. Hosting open models in your own environment requires…

Locally Hosted Open Source LLM AI Models

Private, Local AI with Open LLM Models

AI Infrastructure

GenAI, Generative AI, GPT4All, LLaMA 2, LocalAI, Open LLM Models, Open Source AI, OpenAI Alternative, OpenAI Compatible API, Private AI, Self Hosted AI

To date, most implementations of AI in applications using GPT Large Language Models (LLMs) rely on calling the OpenAI API, which surprisingly, contrary to what its name might suggest, is not open-source. This pattern has become so common that a…