Open Source AI

Nextcloud Context Chat is a retrieval augmented generation (RAG) based feature of Assistant, grounding a large language model’s responses to users’ prompts with the documents & data that they already store in Nextcloud. From Context Chat in the Nextcloud Assistant…

Integrating Nextcloud AI Assistant with Inference Engines & APIs

AI Infrastructure

AI as a Service, AI Assistant, AI Middleware, AI Proxy, ChatGPT Alternative, Generative AI, Locally Hosted AI, NextCloud, Open Source AI

Nextcloud Assistant, featured in the latest versions of Nextcloud Hub, extends the cloud storage & collaboration suite with a range of AI-powered capabilities, including GPT-style chat, text generation, and speech-to-text transcription. With the Smart Picker, you can use these features…

AI Data Loss Prevention (DLP) with Microsoft Presidio

AI Infrastructure

AI Middleware, Azure, GenAI, Generative AI, LibreChat, LiteLLM, Open Source AI, Privacy Protection, Retrieval Augmented Generation, Self Hosted AI

Even if you have deployed an enterprise GPT platform as a dedicated workspace for your organization, it remains best practice to avoid storing unnecessary PII in your AI data infrastructure. In fact, many regulated industries & sectors such as education…

Private Enterprise GPT on Any Cloud with Inference APIs

AI Infrastructure

AI as a Service, AI Middleware, AWS, Azure, GenAI, Generative AI, LibreChat, LiteLLM, Open Source AI, Privacy Protection, Retrieval Augmented Generation, Self Hosted AI

Are your employees using the consumer versions of ChatGPT or Copilot (formerly Bing Chat) without your knowledge? Especially with hybrid work arrangements, this could be surreptitiously happening on employees’ mobile phones or personal laptops – even if company devices are…

Deploy n8n with Docker Compose for Automating AI Workflows

AI Infrastructure

AI as a Service, Container Orchestration, Data Pipelines, Docker, Locally Hosted AI, n8n, Open Source AI, Retrieval Augmented Generation, Self Hosted AI, Vector Databases

n8n is a data integration & workflow automation tool that can be self hosted on your own infrastructure. Compared to cloud-based automation platforms such as Zapier, Integromat, Make, or the cloud version of n8n, self hosting has two major benefits.…

Open WebUI + Ollama with Azure Kubernetes Service & Ingress TLS

AI Infrastructure

Azure, ChatGPT Alternative, CloudFlare, Container Orchestration, Kubernetes, Load Balancing, Locally Hosted AI, Ollama, Open Source AI, Private AI, SSL Certificates

Open WebUI is a fork of LibreChat, an open source AI chat platform that we have extensively discussed on our blog and integrated on behalf of clients. Where LibreChat integrates with any well-known remote or local AI service on the…

AI Document Data Pipelines with S3 or Azure Blob Storage

AI Infrastructure

Airbyte, AWS, Azure, BionicGPT, Data Pipelines, Generative AI, NextCloud, Object Storage, Open Source AI, Retrieval Augmented Generation, Vector Databases

Document data pipelines allow for the creation of automated workflows where an embedding model extracts text from documents added to a share and converts them into vector values that AI/ML applications can use for semantic search and as context for…

ELT Data Pipelines with Airbyte & BionicGPT for AI RAG

AI Infrastructure

BionicGPT, Data Pipelines, Generative AI, Kubernetes, Open Source AI, PostgreSQL, RabbitMQ, Retrieval Augmented Generation, Vector Databases

BionicGPT is an open source AI chat platform with features for teams to upload and share datasets for retrieval augmented generation using large language models. With role based access control, it is designed with a hierarchical user structure where team…

Local Embeddings with Hugging Face Text Embedding Inference

AI Infrastructure

Embeddings Models, Generative AI, LibreChat, Open Source AI, pgVector, Retrieval Augmented Generation, Vector Databases

Embeddings models convert data into numerical representations that can be stored in a vector database, and retrieved by a large language model through a framework such as LangChain for retrieval augmented generation. A common use case is embedding unstructured data,…

Serverless Deployment of AI Middleware, LiteLLM, with Google Cloud Run

AI Infrastructure

AI Middleware, AI Proxy, Azure, Cloud Run, Generative AI, Google Cloud, LiteLLM, Microservices, Open Source AI, PostgreSQL, Serverless

AI middleware is an emerging term for the layer of the technology stack that facilitates the interfacing of AI end user applications with the Large Language Models and GPU-accelerated machines that drive them. Here are the major sub-categories of this…

AI Retrieval Augmented Generation in the (Virtual) Private Cloud

AI Infrastructure

ChatGPT Alternative, GenAI, Generative AI, Open LLM Models, Open Source AI, Private AI, Retrieval Augmented Generation

Retrieval Augmented Generation (RAG) is an AI technique for getting more tailored responses from a foundation model, without the need for training or fine-tuning a model from scratch. Large Language Models, such as Meta’s LLaMA 2, provide high quality responses…

Run Open AI Models for Enterprise with a ChatGPT “Clone”

AI Infrastructure

BionicGPT, ChatGPT Alternative, GenAI, Generative AI, LibreChat, Open AI Models, Open LLM Models, Open Source AI, OpenAI Compatible API, Self-Hosted Apps

Are you looking for an alternative to ChatGPT Enterprise with no minimum number of seats or annual contract, with enterprise features such as single-sign on (SSO) through Google Workspace, OpenID, or Microsoft Entra ID? It is worth considering running an…