Locally Hosted AI

Technical Deep Dive Into Nextcloud Context Chat

folder_openAI Infrastructure
turned_in_notAI as a Service, AI Assistant, AI Middleware, AI Proxy, ChatGPT Alternative, Generative AI, Locally Hosted AI, NextCloud, Open Source AI
Nextcloud Context Chat is a retrieval augmented generation (RAG) based feature of Assistant, grounding a large language model’s responses to users’ prompts with the documents & data that they already store in Nextcloud. From Context Chat in the Nextcloud Assistant…
Read More

Integrating Nextcloud AI Assistant with Inference Engines & APIs

folder_openAI Infrastructure
turned_in_notAI as a Service, AI Assistant, AI Middleware, AI Proxy, ChatGPT Alternative, Generative AI, Locally Hosted AI, NextCloud, Open Source AI
Nextcloud Assistant, featured in the latest versions of Nextcloud Hub, extends the cloud storage & collaboration suite with a range of AI-powered capabilities, including GPT-style chat, text generation, and speech-to-text transcription. With the Smart Picker, you can use these features…
Read More

Deploy n8n with Docker Compose for Automating AI Workflows

folder_openAI Infrastructure
turned_in_notAI as a Service, Container Orchestration, Data Pipelines, Docker, Locally Hosted AI, n8n, Open Source AI, Retrieval Augmented Generation, Self Hosted AI, Vector Databases
n8n is a data integration & workflow automation tool that can be self hosted on your own infrastructure. Compared to cloud-based automation platforms such as Zapier, Integromat, Make, or the cloud version of n8n, self hosting has two major benefits.…
Read More

Open WebUI + Ollama with Azure Kubernetes Service & Ingress TLS

folder_openAI Infrastructure
turned_in_notAzure, ChatGPT Alternative, CloudFlare, Container Orchestration, Kubernetes, Load Balancing, Locally Hosted AI, Ollama, Open Source AI, Private AI, SSL Certificates
Open WebUI is a fork of LibreChat, an open source AI chat platform that we have extensively discussed on our blog and integrated on behalf of clients. Where LibreChat integrates with any well-known remote or local AI service on the…
Read More

Proxies & Load Balancers for AI LLM Models (AI Middleware)

folder_openAI Infrastructure
turned_in_notAI Middleware, Docker, GenAI, Generative AI, HAProxy, LiteLLM, LLaMA 2, Locally Hosted AI, Ollama, Open LLM Models, OpenAI Compatible API
The Cambrianesque explosion of capable, open Large Language AI Models represents an opportunity to extend virtually any application with AI capabilities, but a strategy for managing multiple AI endpoints is clearly needed. Hosting open models in your own environment requires…
Read More