OpenAI Compatible API

Integrating Azure OpenAI with Search & Retrieval Plugins for RAG

folder_openAI Infrastructure
turned_in_notAzure, Azure AI Search, Cognitive Search, Generative AI, LangChain, LibreChat, OpenAI Compatible API, Retrieval Augmented Generation
If you have ever used ChatGPT Plus, OpenAI’s SaaS GenAI offering, you are likely familiar with the Browsing extension which retrieves current information from the Internet using Bing search to inform the GPT model’s response to the user’s prompts. One…
Read More

Run Open AI Models for Enterprise with a ChatGPT “Clone”

folder_openAI Infrastructure
turned_in_notBionic-GPT, ChatGPT Alternative, GenAI, Generative AI, LibreChat, Open AI Models, Open LLM Models, Open Source AI, OpenAI Compatible API, Self-Hosted Apps
Are you looking for an alternative to ChatGPT Enterprise with no minimum number of seats or annual contract, with enterprise features such as single-sign on (SSO) through Google Workspace, OpenID, or Microsoft Entra ID? It is worth considering running an…
Read More

Proxies & Load Balancers for AI LLM Models (AI Middleware)

folder_openAI Infrastructure
turned_in_notAI Middleware, Docker, GenAI, Generative AI, HAProxy, LiteLLM, LLaMA 2, Locally Hosted AI, Ollama, Open LLM Models, OpenAI Compatible API
The Cambrianesque explosion of capable, open Large Language AI Models represents an opportunity to extend virtually any application with AI capabilities, but a strategy for managing multiple AI endpoints is clearly needed. Hosting open models in your own environment requires…
Read More