Self-hosted AI Platform with GitOps and ArgoCD

Helm charts for deploying a self-hosted AI platform (LibreChat, model serving, MCP) via ArgoCD.

Self-Hosted AI Platform with GitOps and ArgoCD

This repository provides Helm charts for deploying a comprehensive, self-hosted AI platform. Designed for developers and organizations prioritizing control and customization, this solution integrates key AI components with robust GitOps principles and ArgoCD for automated deployment and management. It enables the creation of a private, scalable AI infrastructure directly within your own environment.

What it Does

The core function of this project is to simplify the deployment of a self-hosted AI ecosystem. It bundles essential tools like LibreChat for conversational AI interfaces, model serving capabilities for deploying custom or open-source AI models, and MCP (Multi-Cloud Platform) components for managing these resources. By leveraging Helm charts and ArgoCD, it automates the entire deployment process, ensuring consistency and reproducibility across your infrastructure.

Key Features

Self-Hosted Control: Maintain full ownership and control over your AI data and infrastructure.
GitOps Workflow: Manage your AI platform's deployment and configuration through Git, enabling version control, collaboration, and automated rollbacks.
ArgoCD Integration: Utilize ArgoCD for continuous delivery, automatically synchronizing your desired state in Git with your Kubernetes cluster.
Modular Deployment: Deploy LibreChat for user-facing AI interactions, model serving for inference, and MCP for platform management.
Helm Charts: Pre-packaged, customizable Helm charts streamline the installation and configuration of each component.
Open Source Components: Built upon well-established open-source AI and DevOps tools.

Who it's For

This solution is ideal for AI developers , MLOps engineers , and DevOps teams who require a secure, customizable, and self-managed AI platform. It's particularly suited for organizations with strict data privacy requirements, those looking to avoid vendor lock-in, or teams aiming to build and deploy AI models in a controlled, reproducible manner. If you are familiar with Kubernetes, Helm, and GitOps, this platform offers a powerful foundation for your AI initiatives.