AI Infrastructure

Automate Document Workflows with Nextcloud, Paperless-NGX & AI

AI-Powered OCR, Document AI, Document Management Systems, Document Workflows, Gemini AI, GPT Document Analysis, NextCloud, Paperless-NGX, Retrieval Augmented Generation

The large context sizes reaching 1 million tokens (2,500 to 3,000 pages), and powerful vision capabilities of the newest, state-of-the-art large language models (LLMs) such as Google Gemini 2.5 Flash and Llama 4 Maverick make them increasingly relevant for automated…

Technical Deep Dive Into Nextcloud Context Chat

AI Infrastructure

AI as a Service, AI Assistant, AI Middleware, AI Proxy, ChatGPT Alternative, Generative AI, Locally Hosted AI, NextCloud, Open Source AI

Nextcloud Context Chat is a retrieval augmented generation (RAG) based feature of Assistant, grounding a large language model’s responses to users’ prompts with the documents & data that they already store in Nextcloud. From Context Chat in the Nextcloud Assistant…

Integrating Nextcloud AI Assistant with Inference Engines & APIs

AI Infrastructure

AI as a Service, AI Assistant, AI Middleware, AI Proxy, ChatGPT Alternative, Generative AI, Locally Hosted AI, NextCloud, Open Source AI

Nextcloud Assistant, featured in the latest versions of Nextcloud Hub, extends the cloud storage & collaboration suite with a range of AI-powered capabilities, including GPT-style chat, text generation, and speech-to-text transcription. With the Smart Picker, you can use these features…

AI Data Loss Prevention (DLP) with Microsoft Presidio

AI Infrastructure

AI Middleware, Azure, GenAI, Generative AI, LibreChat, LiteLLM, Open Source AI, Privacy Protection, Retrieval Augmented Generation, Self Hosted AI

Even if you have deployed an enterprise GPT platform as a dedicated workspace for your organization, it remains best practice to avoid storing unnecessary PII in your AI data infrastructure. In fact, many regulated industries & sectors such as education…

Private Enterprise GPT on Any Cloud with Inference APIs

AI Infrastructure

AI as a Service, AI Middleware, AWS, Azure, GenAI, Generative AI, LibreChat, LiteLLM, Open Source AI, Privacy Protection, Retrieval Augmented Generation, Self Hosted AI

Are your employees using the consumer versions of ChatGPT or Copilot (formerly Bing Chat) without your knowledge? Especially with hybrid work arrangements, this could be surreptitiously happening on employees’ mobile phones or personal laptops – even if company devices are…

OctoAI Acquired by NVIDIA (Shuts Down) – Predictions & Alternatives

AI Infrastructure

AI as a Service, AI Middleware, AI Proxy, Amazon Bedrock, GenAI, Generative AI, LiteLLM, Vertex AI

Since meeting their team virtually at DockerCon 2023, we have seen OctoAI as among the most developer-friendly AIaaS platforms for AI inference and media generation in the market. Their platform treated open models, such as LLaMA and Stable Diffusion as…

Deploy n8n with Docker Compose for Automating AI Workflows

AI Infrastructure

AI as a Service, Container Orchestration, Data Pipelines, Docker, Locally Hosted AI, n8n, Open Source AI, Retrieval Augmented Generation, Self Hosted AI, Vector Databases

n8n is a data integration & workflow automation tool that can be self hosted on your own infrastructure. Compared to cloud-based automation platforms such as Zapier, Integromat, Make, or the cloud version of n8n, self hosting has two major benefits.…

Open WebUI + Ollama with Azure Kubernetes Service & Ingress TLS

AI Infrastructure

Azure, ChatGPT Alternative, CloudFlare, Container Orchestration, Kubernetes, Load Balancing, Locally Hosted AI, Ollama, Open Source AI, Private AI, SSL Certificates

Open WebUI is a fork of LibreChat, an open source AI chat platform that we have extensively discussed on our blog and integrated on behalf of clients. Where LibreChat integrates with any well-known remote or local AI service on the…

AI Document Data Pipelines with S3 or Azure Blob Storage

AI Infrastructure

Airbyte, AWS, Azure, BionicGPT, Data Pipelines, Generative AI, NextCloud, Object Storage, Open Source AI, Retrieval Augmented Generation, Vector Databases

Document data pipelines allow for the creation of automated workflows where an embedding model extracts text from documents added to a share and converts them into vector values that AI/ML applications can use for semantic search and as context for…

ELT Data Pipelines with Airbyte & BionicGPT for AI RAG

AI Infrastructure

BionicGPT, Data Pipelines, Generative AI, Kubernetes, Open Source AI, PostgreSQL, RabbitMQ, Retrieval Augmented Generation, Vector Databases

BionicGPT is an open source AI chat platform with features for teams to upload and share datasets for retrieval augmented generation using large language models. With role based access control, it is designed with a hierarchical user structure where team…

Nextcloud Assistant 2.0 – AI Text Gen with Phi-3 & Transcription with Whisper

AI Infrastructure

AI Assistant, , Generative AI, Microsoft Phi-3, NextCloud, Online Office Suite, Self-Hosted Apps, Small Language Models, Whisper

Nextcloud Assistant 2.0 is the self-hosted file sync & share and groupware suite’s answer to Microsoft 365 Copilot and Gemini for Google Workspace. Compared to Copilot and Gemini from its Big Tech brethren, Nextcloud Assistant has a number of unmatched…

AlloyDB Vector Database for Retrieval Augmented Generation

AI Infrastructure

AlloyDB, Embeddings Models, Generative AI, Google Cloud, LibreChat, PostgreSQL, Retrieval Augmented Generation, Vector Databases

AlloyDB is a fork of PostgreSQL on Google Cloud, optimized for high performance with vector embedding & retrieval workloads. As a PostgreSQL-compatible database, AlloyDB can be used as a drop-in replacement for any application that relies on a Postgres backend.…