Azure

AI Data Loss Prevention (DLP) with Microsoft Presidio

folder_openAI Infrastructure
turned_in_notAI Middleware, Azure, GenAI, Generative AI, LibreChat, LiteLLM, Open Source AI, Privacy Protection, Retrieval Augmented Generation, Self Hosted AI
Even if you have deployed an enterprise GPT platform as a dedicated workspace for your organization, it remains best practice to avoid storing unnecessary PII in your AI data infrastructure. In fact, many regulated industries & sectors such as education…
Read More

Private Enterprise GPT on Any Cloud with Inference APIs

folder_openAI Infrastructure
turned_in_notAI as a Service, AI Middleware, AWS, Azure, GenAI, Generative AI, LibreChat, LiteLLM, Open Source AI, Privacy Protection, Retrieval Augmented Generation, Self Hosted AI
Are your employees using the consumer versions of ChatGPT or Copilot (formerly Bing Chat) without your knowledge? Especially with hybrid work arrangements, this could be surreptitiously happening on employees’ mobile phones or personal laptops – even if company devices are…
Read More

Open WebUI + Ollama with Azure Kubernetes Service & Ingress TLS

folder_openAI Infrastructure
turned_in_notAzure, ChatGPT Alternative, CloudFlare, Container Orchestration, Kubernetes, Load Balancing, Locally Hosted AI, Ollama, Open Source AI, Private AI, SSL Certificates
Open WebUI is a fork of LibreChat, an open source AI chat platform that we have extensively discussed on our blog and integrated on behalf of clients. Where LibreChat integrates with any well-known remote or local AI service on the…
Read More

AI Document Data Pipelines with S3 or Azure Blob Storage

folder_openAI Infrastructure
turned_in_notAirbyte, AWS, Azure, BionicGPT, Data Pipelines, Generative AI, NextCloud, Object Storage, Open Source AI, Retrieval Augmented Generation, Vector Databases
Document data pipelines allow for the creation of automated workflows where an embedding model extracts text from documents added to a share and converts them into vector values that AI/ML applications can use for semantic search and as context for…
Read More

RAG with any AI Model using Postgres pgVector + LibreChat

folder_openAI Infrastructure
turned_in_notAnthropic, Azure, Generative AI, LibreChat, LiteLLM, Ollama, OpenAI Alternative, pgVector, PostgreSQL, Retrieval Augmented Generation, Vector Databases
The addition of the RAG API microservice to LibreChat in version 0.7.0, the most rapidly trending open source ChatGPT clone, swings the door open to chatting with PDFs and documents using any supported AI model, in a private, self-hosted environment.…
Read More

Serverless Deployment of AI Middleware, LiteLLM, with Google Cloud Run

folder_openAI Infrastructure
turned_in_notAI Middleware, AI Proxy, Azure, Cloud Run, Generative AI, Google Cloud, LiteLLM, Microservices, Open Source AI, PostgreSQL, Serverless
AI middleware is an emerging term for the layer of the technology stack that facilitates the interfacing of AI end user applications with the Large Language Models and GPU-accelerated machines that drive them. Here are the major sub-categories of this…
Read More

Integrating Azure OpenAI with Search & Retrieval Plugins for RAG

folder_openAI Infrastructure
turned_in_notAzure, Azure AI Search, Cognitive Search, Generative AI, LangChain, LibreChat, OpenAI Compatible API, Retrieval Augmented Generation
If you have ever used ChatGPT Plus, OpenAI’s SaaS GenAI offering, you are likely familiar with the Browsing extension which retrieves current information from the Internet using Bing search to inform the GPT model’s response to the user’s prompts. One…
Read More