<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Machine Learning on Intellectual Guides</title><link>https://ckw19810413.github.io/en/tags/machine-learning/</link><description>Recent content in Machine Learning on Intellectual Guides</description><generator>Hugo -- gohugo.io</generator><language>en</language><lastBuildDate>Mon, 27 Jul 2026 00:00:00 +0000</lastBuildDate><atom:link href="https://ckw19810413.github.io/en/tags/machine-learning/index.xml" rel="self" type="application/rss+xml"/><item><title>Local AI Infrastructure Setup Guide: From Zero to vLLM + ComfyUI</title><link>https://ckw19810413.github.io/en/blog/local-ai-infrastructure-guide/</link><pubDate>Mon, 27 Jul 2026 00:00:00 +0000</pubDate><guid>https://ckw19810413.github.io/en/blog/local-ai-infrastructure-guide/</guid><description>&lt;h2 id="why-build-local-ai-infrastructure"&gt;Why Build Local AI Infrastructure?
&lt;/h2&gt;&lt;p&gt;In 2026, AI tools have become essential infrastructure for developers, creators, and enterprises. But most people still rely on cloud APIs — paying per call, risking data privacy, and hitting rate limits.&lt;/p&gt;
&lt;p&gt;Local AI infrastructure gives you three things: &lt;strong&gt;full control, unlimited usage, and zero marginal cost&lt;/strong&gt;.&lt;/p&gt;
&lt;p&gt;Once set up, you can:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Use LLMs without limits, no API fees&lt;/li&gt;
&lt;li&gt;Process sensitive data without leaving your machine&lt;/li&gt;
&lt;li&gt;Run multiple services simultaneously, no rate limits&lt;/li&gt;
&lt;li&gt;Integrate with frameworks like Cowork MCP for true multi-agent systems&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;This guide assumes you have a machine with a GPU (DGX GB10, RTX 4090, or better recommended). I&amp;rsquo;ll walk you through building a complete local AI environment from scratch.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;What you&amp;rsquo;ll learn:&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Install and configure local LLM serving (vLLM)&lt;/li&gt;
&lt;li&gt;Deploy ComfyUI for image generation&lt;/li&gt;
&lt;li&gt;Manage GPU memory and service startup order&lt;/li&gt;
&lt;li&gt;Automate service management (systemd)&lt;/li&gt;
&lt;li&gt;Integrate with Cowork MCP for multi-agent AI teams&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Let&amp;rsquo;s get started.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="prerequisites"&gt;Prerequisites
&lt;/h2&gt;&lt;p&gt;Before we begin, make sure you have:&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Item&lt;/th&gt;
&lt;th&gt;Version&lt;/th&gt;
&lt;th&gt;Check Command&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Linux&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;Ubuntu 22.04+ or Arch&lt;/td&gt;
&lt;td&gt;&lt;code&gt;uname -a&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;GPU&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;NVIDIA RTX 3090+/4090/GB10&lt;/td&gt;
&lt;td&gt;&lt;code&gt;nvidia-smi&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;CUDA&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;≥ 12.4&lt;/td&gt;
&lt;td&gt;&lt;code&gt;nvcc --version&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Docker&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;≥ 24.0&lt;/td&gt;
&lt;td&gt;&lt;code&gt;docker --version&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Node.js&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;≥ 20&lt;/td&gt;
&lt;td&gt;&lt;code&gt;node --version&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Python&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;≥ 3.10&lt;/td&gt;
&lt;td&gt;&lt;code&gt;python3 --version&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;p&gt;If your GPU has less than 24GB memory, consider closing unnecessary GUI apps or services before starting.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="step-1-install-docker-and-nvidia-container-toolkit"&gt;Step 1: Install Docker and NVIDIA Container Toolkit
&lt;/h2&gt;&lt;p&gt;Docker is the recommended way to deploy local AI services because it isolates dependencies, avoids version conflicts, and prevents system pollution.&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Install Docker&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo apt update
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo apt install -y docker.io docker-compose-v2
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Install NVIDIA Container Toolkit (enables GPU access in Docker)&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;distribution&lt;span style="color:#f92672"&gt;=&lt;/span&gt;&lt;span style="color:#66d9ef"&gt;$(&lt;/span&gt;. /etc/os-release;echo $ID$VERSION_ID&lt;span style="color:#66d9ef"&gt;)&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;curl -s -L https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | sed &lt;span style="color:#e6db74"&gt;&amp;#39;s#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g&amp;#39;&lt;/span&gt; | sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo apt update
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo apt install -y nvidia-container-toolkit
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo nvidia-ctk runtime configure --runtime&lt;span style="color:#f92672"&gt;=&lt;/span&gt;docker
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo systemctl restart docker
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Verify GPU availability:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;docker run --rm --gpus all nvidia/cuda:12.4.0-base-ubuntu22.04 nvidia-smi
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;If you see GPU info and memory usage, your environment is correctly configured.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="step-2-deploy-vllm-local-language-model"&gt;Step 2: Deploy vLLM Local Language Model
&lt;/h2&gt;&lt;p&gt;vLLM is currently the most efficient local LLM inference framework, supporting multiple model formats (GGUF, GPTQ, AWQ).&lt;/p&gt;
&lt;h3 id="21-deploy-with-docker"&gt;2.1 Deploy with Docker
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;docker run -d &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; --name vllm-server &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; --gpus all &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; -p 8000:8000 &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; -v ~/.cache/huggingface:/root/.cache/huggingface &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; vllm/vllm-openai:latest &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; --model &lt;span style="color:#e6db74"&gt;&amp;#34;nvidia/Llama-3.1-Nemotron-70B-Instruct&amp;#34;&lt;/span&gt; &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; --gpu-memory-utilization 0.9 &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; --max-model-len &lt;span style="color:#ae81ff"&gt;8192&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;&lt;strong&gt;Parameter explanation:&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;code&gt;--model&lt;/code&gt;: The model to deploy (replace with any HuggingFace model)&lt;/li&gt;
&lt;li&gt;&lt;code&gt;--gpu-memory-utilization&lt;/code&gt;: Ratio of GPU memory to use (0.9 means 90%)&lt;/li&gt;
&lt;li&gt;&lt;code&gt;--max-model-len&lt;/code&gt;: Maximum context length&lt;/li&gt;
&lt;/ul&gt;
&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Note:&lt;/strong&gt; If your GPU has less than 80GB memory, start with smaller models (7B or 13B) before trying larger ones.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;h3 id="22-test-the-api-endpoint"&gt;2.2 Test the API Endpoint
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;curl -X POST http://localhost:8000/v1/completions &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; -H &lt;span style="color:#e6db74"&gt;&amp;#34;Content-Type: application/json&amp;#34;&lt;/span&gt; &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; -d &lt;span style="color:#e6db74"&gt;&amp;#39;{
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt; &amp;#34;model&amp;#34;: &amp;#34;nvidia/Llama-3.1-Nemotron-70B-Instruct&amp;#34;,
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt; &amp;#34;prompt&amp;#34;: &amp;#34;Explain what a multi-agent AI system is&amp;#34;,
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt; &amp;#34;max_tokens&amp;#34;: 200
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt; }&amp;#39;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;If you receive a response, vLLM is successfully deployed.&lt;/p&gt;
&lt;h3 id="23-setup-as-system-service-auto-start"&gt;2.3 Setup as System Service (Auto-start)
&lt;/h3&gt;&lt;p&gt;Create a systemd service file:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo tee /etc/systemd/system/vllm.service &lt;span style="color:#e6db74"&gt;&amp;lt;&amp;lt; &amp;#39;EOF&amp;#39;
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;[Unit]
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;Description=vLLM Local LLM Server
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;After=docker.service
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;Requires=docker.service
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;[Service]
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;Type=oneshot
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;RemainAfterExit=yes
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;ExecStart=/usr/bin/docker start vllm-server
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;ExecStop=/usr/bin/docker stop vllm-server
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;[Install]
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;WantedBy=multi-user.target
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#e6db74"&gt;EOF&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Enable and start the service:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo systemctl daemon-reload
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo systemctl enable vllm.service
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo systemctl start vllm.service
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;hr&gt;
&lt;h2 id="step-3-deploy-comfyui-image-generation"&gt;Step 3: Deploy ComfyUI Image Generation
&lt;/h2&gt;&lt;p&gt;ComfyUI is the most powerful local image generation tool, supporting Flux, Stable Diffusion, LTX, and various other models.&lt;/p&gt;
&lt;h3 id="31-deploy-with-docker"&gt;3.1 Deploy with Docker
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;docker run -d &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; --name comfyui &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; --gpus all &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; -p 8188:8188 &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; -v ~/.cache/huggingface:/root/.cache/huggingface &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; -v ~/comfyui-output:/output &lt;span style="color:#ae81ff"&gt;\
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; ghcr.io/ai-forest/comfyui:latest
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;This starts ComfyUI at &lt;code&gt;http://localhost:8188&lt;/code&gt;.&lt;/p&gt;
&lt;h3 id="32-manual-installation-advanced-option"&gt;3.2 Manual Installation (Advanced Option)
&lt;/h3&gt;&lt;p&gt;If you need more control, you can install manually:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Clone ComfyUI repository&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;cd ~/comfyui
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;git clone https://github.com/comfyanonymous/ComfyUI.git
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;cd ComfyUI
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Install dependencies&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;pip install -r requirements.txt
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Install custom nodes (optional)&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;git clone https://github.com/Fannovel16/ComfyUI-Frame-Interpolation.git custom_nodes/
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;git clone https://github.com/laksjdjoy/deforum-comfy.git custom_nodes/
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Start the service&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;python main.py --listen 0.0.0.0 --port &lt;span style="color:#ae81ff"&gt;8188&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="33-download-common-models"&gt;3.3 Download Common Models
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Use HuggingFace CLI to download models&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;pip install huggingface_hub
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;huggingface-cli download stabilityai/stable-diffusion-xl-base-1.0 --local-dir ~/models/sdxl
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;huggingface-cli download stabilityai/stable-diffusion-3.5-large --local-dir ~/models/sd3.5
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;hr&gt;
&lt;h2 id="step-4-gpu-memory-management-strategies"&gt;Step 4: GPU Memory Management Strategies
&lt;/h2&gt;&lt;p&gt;When running AI services locally, GPU memory is the biggest bottleneck. Here are some battle-tested practices:&lt;/p&gt;
&lt;h3 id="41-check-available-memory"&gt;4.1 Check Available Memory
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;free -h
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;nvidia-smi --query-gpu&lt;span style="color:#f92672"&gt;=&lt;/span&gt;memory.used,memory.free,temperature.gpu --format&lt;span style="color:#f92672"&gt;=&lt;/span&gt;csv
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="42-recommended-service-startup-order"&gt;4.2 Recommended Service Startup Order
&lt;/h3&gt;&lt;ol&gt;
&lt;li&gt;&lt;strong&gt;Start vLLM first&lt;/strong&gt; (language models typically have fixed memory requirements)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Start ComfyUI second&lt;/strong&gt; (image generation can adjust memory usage dynamically)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Close unnecessary GUI apps&lt;/strong&gt; (browsers, Discord, etc.)&lt;/li&gt;
&lt;/ol&gt;
&lt;h3 id="43-memory-monitoring-script"&gt;4.3 Memory Monitoring Script
&lt;/h3&gt;&lt;p&gt;Create a simple monitoring script:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;#!/bin/bash
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# monitor-gpu.sh&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#66d9ef"&gt;while&lt;/span&gt; true; &lt;span style="color:#66d9ef"&gt;do&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; echo &lt;span style="color:#e6db74"&gt;&amp;#34;=== &lt;/span&gt;&lt;span style="color:#66d9ef"&gt;$(&lt;/span&gt;date&lt;span style="color:#66d9ef"&gt;)&lt;/span&gt;&lt;span style="color:#e6db74"&gt; ===&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; nvidia-smi --query-gpu&lt;span style="color:#f92672"&gt;=&lt;/span&gt;memory.used,memory.free,temperature.gpu --format&lt;span style="color:#f92672"&gt;=&lt;/span&gt;csv
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; docker ps --filter &lt;span style="color:#e6db74"&gt;&amp;#34;name=vllm\|name=comfyui&amp;#34;&lt;/span&gt; --format &lt;span style="color:#e6db74"&gt;&amp;#34;table {{.Names}}\t{{.Status}}&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; sleep &lt;span style="color:#ae81ff"&gt;30&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#66d9ef"&gt;done&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;hr&gt;
&lt;h2 id="step-5-integrate-cowork-mcp-multi-agent-framework"&gt;Step 5: Integrate Cowork MCP Multi-Agent Framework
&lt;/h2&gt;&lt;p&gt;Once your local AI infrastructure is ready, connect it to Cowork MCP to build multi-agent systems.&lt;/p&gt;
&lt;h3 id="51-register-vllm-as-a-brain"&gt;5.1 Register vLLM as a Brain
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# If using Hermes Agent&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;hermes register-cowork
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Or manually set up MCP endpoints&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# In your Agent config file:&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#f92672"&gt;{&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#e6db74"&gt;&amp;#34;mcpServers&amp;#34;&lt;/span&gt;: &lt;span style="color:#f92672"&gt;{&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#e6db74"&gt;&amp;#34;cowork&amp;#34;&lt;/span&gt;: &lt;span style="color:#f92672"&gt;{&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#e6db74"&gt;&amp;#34;url&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;http://localhost:6868/mcp&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#e6db74"&gt;&amp;#34;transport&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;streamable-http&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;}&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#e6db74"&gt;&amp;#34;vllm&amp;#34;&lt;/span&gt;: &lt;span style="color:#f92672"&gt;{&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#e6db74"&gt;&amp;#34;url&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;http://localhost:8000/v1&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#e6db74"&gt;&amp;#34;transport&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;streamable-http&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;}&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;}&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#f92672"&gt;}&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="52-real-application-local-ai-content-pipeline"&gt;5.2 Real Application: Local AI Content Pipeline
&lt;/h3&gt;&lt;pre tabindex="0"&gt;&lt;code&gt;Local vLLM (Content Generation) → ComfyUI (Image Generation) → ffmpeg (Post-processing)
&lt;/code&gt;&lt;/pre&gt;&lt;p&gt;Every step of this pipeline can be coordinated by different AI agents:&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;&lt;strong&gt;Research Agent&lt;/strong&gt;: Use vLLM to generate content outlines&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Writing Agent&lt;/strong&gt;: Use vLLM to expand into full articles&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Image Agent&lt;/strong&gt;: Use ComfyUI to generate corresponding illustrations&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Integration Agent&lt;/strong&gt;: Combine content and images into final output&lt;/li&gt;
&lt;/ol&gt;
&lt;hr&gt;
&lt;h2 id="step-6-automation-and-backup"&gt;Step 6: Automation and Backup
&lt;/h2&gt;&lt;h3 id="61-container-backup"&gt;6.1 Container Backup
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Backup ComfyUI container state&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;docker commit comfyui comfyui-backup:&lt;span style="color:#66d9ef"&gt;$(&lt;/span&gt;date +%Y%m%d&lt;span style="color:#66d9ef"&gt;)&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Export image&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;docker save comfyui:latest | gzip &amp;gt; ~/backups/comfyui-&lt;span style="color:#66d9ef"&gt;$(&lt;/span&gt;date +%Y%m%d&lt;span style="color:#66d9ef"&gt;)&lt;/span&gt;.tar.gz
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="62-model-backup"&gt;6.2 Model Backup
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Regularly backup HuggingFace cache&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;rsync -avh ~/.cache/huggingface ~/backups/huggingface-cache/
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Or use rclone to backup to cloud&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;rclone sync ~/.cache/huggingface remote:backup-huggingface --progress
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="63-health-check-script"&gt;6.3 Health Check Script
&lt;/h3&gt;&lt;p&gt;Create health check cron jobs:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Check service status every 5 minutes&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;*/5 * * * * curl -f http://localhost:8000/v1/models &lt;span style="color:#f92672"&gt;||&lt;/span&gt; echo &lt;span style="color:#e6db74"&gt;&amp;#34;vLLM is down at &lt;/span&gt;&lt;span style="color:#66d9ef"&gt;$(&lt;/span&gt;date&lt;span style="color:#66d9ef"&gt;)&lt;/span&gt;&lt;span style="color:#e6db74"&gt;&amp;#34;&lt;/span&gt; | mail -s &lt;span style="color:#e6db74"&gt;&amp;#34;vLLM Alert&amp;#34;&lt;/span&gt; admin@example.com
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;hr&gt;
&lt;h2 id="troubleshooting"&gt;Troubleshooting
&lt;/h2&gt;&lt;h3 id="q1-docker-cannot-use-gpu"&gt;Q1: Docker Cannot Use GPU
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Check if NVIDIA Container Toolkit is installed&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;nvidia-ctk runtime verify
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Restart Docker service&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo systemctl restart docker
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="q2-gpu-memory-insufficient"&gt;Q2: GPU Memory Insufficient
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Reduce vLLM memory utilization&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Add to docker run command:&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;--gpu-memory-utilization 0.7
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Or stop unnecessary services&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;sudo systemctl stop bluetooth
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="q3-comfyui-fails-to-start"&gt;Q3: ComfyUI Fails to Start
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Check Docker logs&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;docker logs comfyui
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Try restarting&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;docker restart comfyui
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;h3 id="q4-slow-model-downloads"&gt;Q4: Slow Model Downloads
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;&lt;span style="color:#75715e"&gt;# Use HuggingFace mirror (for users in mainland China)&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;export HF_ENDPOINT&lt;span style="color:#f92672"&gt;=&lt;/span&gt;https://hf-mirror.com
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;hr&gt;
&lt;h2 id="whats-next"&gt;What&amp;rsquo;s Next
&lt;/h2&gt;&lt;p&gt;You now have a complete local AI infrastructure:&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Today:&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Confirm vLLM and ComfyUI are running&lt;/li&gt;
&lt;li&gt;Test API endpoints to verify content and image generation work&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;strong&gt;This Week:&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Set up systemd services for auto-start on boot&lt;/li&gt;
&lt;li&gt;Create backup and monitoring mechanisms&lt;/li&gt;
&lt;li&gt;Connect at least one LLM backend to Cowork MCP&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;strong&gt;This Month:&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Explore the &lt;a class="link" href="https://github.com/slashman413/cowork" target="_blank" rel="noopener"
&gt;Cowork MCP framework&lt;/a&gt; for more AI agent teams&lt;/li&gt;
&lt;li&gt;Experiment with different models to find the best configuration for your needs&lt;/li&gt;
&lt;li&gt;Build your own AI content production pipeline&lt;/li&gt;
&lt;/ul&gt;
&lt;hr&gt;
&lt;h2 id="faq"&gt;FAQ
&lt;/h2&gt;&lt;p&gt;&lt;strong&gt;Q: What level of GPU do I need to run these services?&lt;/strong&gt;
A: At least 24GB memory recommended (RTX 3090/4090). If memory is smaller, you can run smaller models (7B-13B) or use Docker memory limits.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Q: Can I run this on a machine without GPU?&lt;/strong&gt;
A: Yes, but it will be slow. CPU inference is possible, but not practical for large models (70B+).&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Q: How do I update models?&lt;/strong&gt;
A: Use HuggingFace CLI: &lt;code&gt;huggingface-cli download &amp;lt;model-name&amp;gt; --local-dir &amp;lt;path&amp;gt;&lt;/code&gt;. Docker containers will automatically use updated local models.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Q: What&amp;rsquo;s the difference between vLLM and Ollama?&lt;/strong&gt;
A: vLLM is optimized for high-throughput inference and supports more model formats and advanced features. Ollama is more lightweight and easier to use but has fewer features. For local AI infrastructure, vLLM is recommended.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Q: How does ComfyUI differ from Automatic1111?&lt;/strong&gt;
A: ComfyUI uses a node-based workflow, making it more flexible and efficient. Automatic1111 has a GUI that&amp;rsquo;s more beginner-friendly. Both work well, but ComfyUI is more popular in production environments.&lt;/p&gt;
&lt;hr&gt;
&lt;p&gt;&lt;em&gt;Read time: ~15 minutes | Published: 2026-07-27&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;&lt;em&gt;Find this guide helpful? Explore more guides on &lt;a class="link" href="https://ckw19810413.github.io/en/" &gt;Slashman Tools&lt;/a&gt; or check out our &lt;a class="link" href="https://ckw19810413.github.io/enhttps://gumroad.com/l/diwoc" &gt;AI Toolchain Template Library&lt;/a&gt; for ready-to-use configurations.&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;[&lt;a class="link" href="https://ckw19810413.github.io/en/" &gt;- Back to Home&lt;/a&gt;]&lt;/p&gt;</description></item><item><title>Multi-Agent AI Orchestration: The Complete Guide to Building AI Agent Teams with Cowork MCP Framework</title><link>https://ckw19810413.github.io/en/blog/multi-agent-coworking-platform/</link><pubDate>Sun, 26 Jul 2026 00:00:00 +0000</pubDate><guid>https://ckw19810413.github.io/en/blog/multi-agent-coworking-platform/</guid><description>&lt;h2 id="why-multi-agent-ai-is-the-future-and-why-2026-is-the-year-to-jump-in"&gt;Why Multi-Agent AI Is the Future (And Why 2026 Is the Year to Jump In)
&lt;/h2&gt;&lt;p&gt;If you&amp;rsquo;re reading this in 2026, you&amp;rsquo;ve probably already experienced the frustration of a single AI assistant hitting its limits. You ask Claude to write a complex Python script, optimize a landing page, and draft a marketing email — and it does all three, but none of them are &lt;em&gt;great&lt;/em&gt;. It&amp;rsquo;s the digital equivalent of hiring one person to do three jobs.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;That&amp;rsquo;s where multi-agent AI orchestration changes everything.&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;Multi-agent AI systems deploy multiple specialized AI agents — each with their own expertise, instructions, and capabilities — working together as a coordinated team. Instead of one model juggling multiple tasks poorly, you get a team of experts, each doing what they do best.&lt;/p&gt;
&lt;p&gt;And in 2026, this isn&amp;rsquo;t science fiction. It&amp;rsquo;s a practical, open-source technology stack that&amp;rsquo;s already being used by companies, creators, and individual developers to solve problems that were impossible with a single AI model.&lt;/p&gt;
&lt;p&gt;In this comprehensive guide, I&amp;rsquo;ll walk you through exactly how multi-agent AI orchestration works, why the Cowork MCP framework is becoming the standard for building AI agent teams, and how you can get started today — whether you&amp;rsquo;re a seasoned engineer or a complete beginner.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="what-is-multi-agent-ai-orchestration"&gt;What Is Multi-Agent AI Orchestration?
&lt;/h2&gt;&lt;p&gt;At its core, &lt;strong&gt;multi-agent AI orchestration&lt;/strong&gt; is the practice of coordinating multiple AI agents to accomplish complex tasks that exceed the capability of any single model. Each agent has:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;A specific role&lt;/strong&gt; (e.g., &amp;ldquo;Code Reviewer,&amp;rdquo; &amp;ldquo;Marketing Strategist,&amp;rdquo; &amp;ldquo;Data Analyst&amp;rdquo;)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Tailored instructions&lt;/strong&gt; (a system prompt designed for that specific role)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Platform-specific execution&lt;/strong&gt; (running on Claude, GPT, Gemini, or any compatible LLM)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Communication protocols&lt;/strong&gt; (standardized ways to pass results between agents — the MCP, Model Context Protocol, has become the industry standard in 2026)&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Think of it like an agency. A startup needs a landing page? You don&amp;rsquo;t hire one generalist who dabbles in copy, design, and SEO. You hire a copywriter, a designer, and an SEO specialist. Each focuses on their expertise, and a project manager coordinates them. Multi-agent AI works the same way.&lt;/p&gt;
&lt;h3 id="the-key-components-of-any-multi-agent-system"&gt;The Key Components of Any Multi-Agent System
&lt;/h3&gt;&lt;ol&gt;
&lt;li&gt;&lt;strong&gt;Agent Roster&lt;/strong&gt; — A catalog of available agents with their roles, skills, and capabilities&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Orchestrator&lt;/strong&gt; — The intelligence that routes tasks to the right agent (or sequence of agents)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Communication Layer&lt;/strong&gt; — A standard protocol for agents to exchange information (the MCP — Model Context Protocol — has become the industry standard in 2026)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Execution Environment&lt;/strong&gt; — Where the agents actually run (your machine, a server, cloud instances)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Dashboard &amp;amp; Monitoring&lt;/strong&gt; — A way to see what agents are doing, track progress, and review outputs&lt;/li&gt;
&lt;/ol&gt;
&lt;hr&gt;
&lt;h2 id="enter-cowork-the-open-source-multi-agent-mcp-framework"&gt;Enter Cowork: The Open-Source Multi-Agent MCP Framework
&lt;/h2&gt;&lt;p&gt;&lt;a class="link" href="https://github.com/slashman413/cowork" target="_blank" rel="noopener"
&gt;Cowork&lt;/a&gt; is a filesystem-based MCP server and Web UI dashboard that I built because I was frustrated with the fragmented state of multi-agent AI tools. Existing solutions were either too locked-in to specific platforms, required complex cloud configurations, or simply didn&amp;rsquo;t scale to the number of agents real work demands.&lt;/p&gt;
&lt;p&gt;Cowork solves all three problems with a clean, modular architecture that supports &lt;strong&gt;285+ expert agents across 19 divisions&lt;/strong&gt; while running on your own infrastructure.&lt;/p&gt;
&lt;h3 id="why-cowork-stands-out"&gt;Why Cowork Stands Out
&lt;/h3&gt;&lt;p&gt;&lt;strong&gt;1. Multi-Platform Agent Support&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;Cowork isn&amp;rsquo;t limited to one LLM provider. It integrates with:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Claude Code&lt;/strong&gt; (~285 agents via &lt;code&gt;.md&lt;/code&gt; files with YAML frontmatter)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Hermes Agent&lt;/strong&gt; (39+ skills via &lt;code&gt;SKILL.md&lt;/code&gt;)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Antigravity (AGY)&lt;/strong&gt; (built-in agents plus custom skills)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Gemini CLI&lt;/strong&gt;, &lt;strong&gt;GitHub Copilot&lt;/strong&gt;, &lt;strong&gt;Codex&lt;/strong&gt;, &lt;strong&gt;Cursor&lt;/strong&gt; (+7 more platforms)&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;This means your AI agent team can use the best model for each specific task. Code review? Use Claude. Creative writing? Use GPT. Data analysis? Use Gemini. Cowork handles the routing automatically.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;2. Two-Stage Agent Routing&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;When a task comes in, Cowork&amp;rsquo;s orchestrator performs a two-stage selection:&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;&lt;strong&gt;Division Routing&lt;/strong&gt; — The classifier brain identifies which of 19 divisions the task belongs to (e.g., &amp;ldquo;engineering,&amp;rdquo; &amp;ldquo;marketing,&amp;rdquo; &amp;ldquo;testing&amp;rdquo;)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Agent Selection&lt;/strong&gt; — Within that division, it picks the most suitable agent from the roster based on the agent&amp;rsquo;s expertise description&lt;/li&gt;
&lt;/ol&gt;
&lt;p&gt;This means you can define a task like &amp;ldquo;Create a technical audit for my GitHub repository&amp;rdquo; and Cowork automatically routes it to the right developer agents without you manually configuring anything.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;3. Filesystem-First Architecture&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;Here&amp;rsquo;s the elegant part: agent definitions live as plain &lt;code&gt;.md&lt;/code&gt; files on your filesystem. No database, no proprietary format, no vendor lock-in. You can read, edit, share, and version-control your agent roster using git.&lt;/p&gt;
&lt;p&gt;The server reads these files at runtime, and changes take effect immediately — no restart needed.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;4. Web UI Dashboard&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;Cowork ships with a built-in dashboard at &lt;code&gt;http://localhost:6868/&lt;/code&gt; that lets you:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;View all registered agents and their capabilities&lt;/li&gt;
&lt;li&gt;Dispatch tasks manually or via API&lt;/li&gt;
&lt;li&gt;Monitor task execution in real-time&lt;/li&gt;
&lt;li&gt;View task results and generated reports&lt;/li&gt;
&lt;li&gt;Register remote &amp;ldquo;brains&amp;rdquo; (LLM instances from other machines)&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;strong&gt;5. API-First with MCP Protocol&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;Cowork exposes a standard MCP endpoint at &lt;code&gt;/mcp&lt;/code&gt; over Streamable HTTP. Any MCP-compatible client — Claude Code, Cursor, VS Code with MCP extensions — can connect and dispatch tasks programmatically.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="how-multi-agent-ai-comparison-the-three-approaches"&gt;How Multi-Agent AI Comparison: The Three Approaches
&lt;/h2&gt;&lt;p&gt;Before we dive deeper into how Cowork works, it&amp;rsquo;s worth understanding the landscape. In 2026, there are three primary approaches to building AI agent teams:&lt;/p&gt;
&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Approach&lt;/th&gt;
&lt;th&gt;Examples&lt;/th&gt;
&lt;th&gt;Pros&lt;/th&gt;
&lt;th&gt;Cons&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Custom Scripting&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;Python + LangChain agents&lt;/td&gt;
&lt;td&gt;Full control&lt;/td&gt;
&lt;td&gt;Requires significant coding knowledge; hard to scale&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Cloud Platforms&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;AutoGPT, LangChain Cloud, OpenAI Assistants API&lt;/td&gt;
&lt;td&gt;Easy to start&lt;/td&gt;
&lt;td&gt;Vendor lock-in; costs scale quickly; limited customization&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Open-Source MCP Frameworks&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;Cowork, CrewAI, AutoGen&lt;/td&gt;
&lt;td&gt;Flexible, transparent, self-hostable&lt;/td&gt;
&lt;td&gt;Requires setup; you manage your own infrastructure&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;p&gt;&lt;strong&gt;Where Cowork fits&lt;/strong&gt;: Cowork occupies the open-source space but differentiates itself through its multi-platform agent support, the two-stage routing system, and its filesystem-first design. Unlike CrewAI (which focuses on sequential agent chains) or AutoGen (which emphasizes conversational multi-agent patterns), Cowork&amp;rsquo;s strength is its breadth — a curated roster of 285+ role-specific agents, ready to be dispatched for virtually any professional task.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="step-by-step-how-to-build-an-ai-agent-team-with-cowork"&gt;Step-by-Step: How to Build an AI Agent Team with Cowork
&lt;/h2&gt;&lt;p&gt;Let&amp;rsquo;s walk through the process of getting Cowork running and dispatching your first multi-agent task.&lt;/p&gt;
&lt;h3 id="prerequisites"&gt;Prerequisites
&lt;/h3&gt;&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Node.js&lt;/strong&gt; ≥ 20 (tested with v22)&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;npm&lt;/strong&gt; ≥ 10&lt;/li&gt;
&lt;li&gt;Access to at least one LLM backend (Claude, GPT, Gemini, or any MCP-compatible model)&lt;/li&gt;
&lt;/ul&gt;
&lt;h3 id="step-1-clone-and-install"&gt;Step 1: Clone and Install
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;git clone --recurse-submodules https://github.com/slashman413/cowork
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;cd cowork/server
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;npm install
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;The &lt;code&gt;--recurse-submodules&lt;/code&gt; flag pulls in the &lt;code&gt;agency-agents&lt;/code&gt; repository, which contains the 285-agent roster — each agent defined as a &lt;code&gt;.md&lt;/code&gt; file with YAML frontmatter containing role description, skills, and execution parameters.&lt;/p&gt;
&lt;h3 id="step-2-configure"&gt;Step 2: Configure
&lt;/h3&gt;&lt;p&gt;On first run, Cowork copies its configuration template to &lt;code&gt;~/.cowork/config.json&lt;/code&gt;. This is your actual configuration — changes here persist across deployments:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-json" data-lang="json"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;{
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;server&amp;#34;&lt;/span&gt;: {
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;port&amp;#34;&lt;/span&gt;: &lt;span style="color:#ae81ff"&gt;6868&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;host&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;0.0.0.0&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;name&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;cowork-mcp&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;version&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;1.0.0&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;apiKey&amp;#34;&lt;/span&gt;: &lt;span style="color:#66d9ef"&gt;null&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; },
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;paths&amp;#34;&lt;/span&gt;: {
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;agencyAgents&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;./agency-agents&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;inbox&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;./inbox&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;reports&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;./reports&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;status&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;./.status&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;decisions&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;./decisions&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; }
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;}
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;You can also set &lt;code&gt;COWORK_CONFIG&lt;/code&gt; environment variable to override the config location.&lt;/p&gt;
&lt;h3 id="step-3-start-the-server"&gt;Step 3: Start the Server
&lt;/h3&gt;&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-bash" data-lang="bash"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;npm run dev
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;You should see output like:&lt;/p&gt;
&lt;pre tabindex="0"&gt;&lt;code&gt;🤝 Cowork MCP Server running at http://0.0.0.0:6868
MCP endpoint: http://0.0.0.0:6868/mcp
Web Dashboard: http://0.0.0.0:6868/
REST API: http://0.0.0.0:6868/api/
Roster loaded: 285 agents across 19 divisions
&lt;/code&gt;&lt;/pre&gt;&lt;h3 id="step-4-connect-an-agent-platform"&gt;Step 4: Connect an Agent Platform
&lt;/h3&gt;&lt;p&gt;To actually execute tasks, you need to connect at least one AI platform. Here&amp;rsquo;s the Claude Code configuration:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-json" data-lang="json"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;{
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;mcpServers&amp;#34;&lt;/span&gt;: {
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;cowork&amp;#34;&lt;/span&gt;: {
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;url&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;http://localhost:6868/mcp&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;transport&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;streamable-http&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; }
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; }
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;}
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Add this to your Claude Code MCP configuration (&lt;code&gt;~/.claude.json&lt;/code&gt; or project-level config). Once connected, Claude can dispatch tasks to Cowork agents using the standard MCP tools (&lt;code&gt;register_agent&lt;/code&gt;, &lt;code&gt;create_task&lt;/code&gt;, &lt;code&gt;get_roster&lt;/code&gt;, etc.).&lt;/p&gt;
&lt;h3 id="step-5-dispatch-your-first-task"&gt;Step 5: Dispatch Your First Task
&lt;/h3&gt;&lt;p&gt;From any connected client (or directly from the dashboard), you can create a task:&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"&gt;&lt;code class="language-json" data-lang="json"&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;{
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;title&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;Code Review&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;description&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;Review the changes in this PR for security issues and performance.&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;skill&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;security&amp;#34;&lt;/span&gt;,
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt; &lt;span style="color:#f92672"&gt;&amp;#34;to_agent&amp;#34;&lt;/span&gt;: &lt;span style="color:#e6db74"&gt;&amp;#34;code-reviewer&amp;#34;&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span style="display:flex;"&gt;&lt;span&gt;}
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Cowork&amp;rsquo;s orchestrator will:&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;Classify the task (division: &amp;ldquo;security&amp;rdquo;)&lt;/li&gt;
&lt;li&gt;Select the best agent (e.g., &amp;ldquo;Penetration Tester&amp;rdquo;)&lt;/li&gt;
&lt;li&gt;Dispatch the task with that agent&amp;rsquo;s persona as the system prompt&lt;/li&gt;
&lt;li&gt;Run the agent on your configured LLM backend&lt;/li&gt;
&lt;li&gt;File the output as a report&lt;/li&gt;
&lt;/ol&gt;
&lt;hr&gt;
&lt;h2 id="real-world-use-cases-where-multi-agent-ai-shines"&gt;Real-World Use Cases: Where Multi-Agent AI Shines
&lt;/h2&gt;&lt;p&gt;Theory is great, but let&amp;rsquo;s talk about actual scenarios where Cowork&amp;rsquo;s multi-agent approach delivers results that a single AI model simply cannot match.&lt;/p&gt;
&lt;h3 id="use-case-1-multi-agent-code-audit"&gt;Use Case 1: Multi-Agent Code Audit
&lt;/h3&gt;&lt;p&gt;Imagine you need to audit a GitHub repository. A single AI assistant might give you a surface-level review. With Cowork, you can dispatch a parallel 3-agent audit:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Tech Lead Agent&lt;/strong&gt;: Deep code quality analysis, architecture review, design pattern evaluation&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Growth Hacker Agent&lt;/strong&gt;: Website UX audit, SEO analysis, conversion optimization recommendations&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Product Manager Agent&lt;/strong&gt;: Prioritization framework, action roadmap, impact estimation&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Each agent operates independently with its own expertise. Results are consolidated into a structured report. This would take one person days; Cowork does it in minutes.&lt;/p&gt;
&lt;h3 id="use-case-2-product-launch-campaign"&gt;Use Case 2: Product Launch Campaign
&lt;/h3&gt;&lt;p&gt;Launching a digital product requires coordination across multiple disciplines. Cowork can orchestrate:&lt;/p&gt;
&lt;ol&gt;
&lt;li&gt;&lt;strong&gt;Market Research Agent&lt;/strong&gt;: Analyzes competitors, identifies market gaps, generates competitive intelligence&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Content Strategist&lt;/strong&gt;: Plans the content calendar, writes landing page copy, creates promotional materials&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Technical Specialist&lt;/strong&gt;: Handles deployment, analytics setup, email automation configuration&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Project Manager&lt;/strong&gt;: Integrates all agent outputs into a timeline with milestones&lt;/li&gt;
&lt;/ol&gt;
&lt;p&gt;This kind of multi-disciplinary planning is exactly where multi-agent AI excels — because it mirrors how human organizations actually work.&lt;/p&gt;
&lt;h3 id="use-case-3-content-production-pipeline"&gt;Use Case 3: Content Production Pipeline
&lt;/h3&gt;&lt;p&gt;For content creators, Cowork can automate an entire workflow:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Research agent gathers trending topics and competitive analysis&lt;/li&gt;
&lt;li&gt;Writing agent drafts the content based on research and style guidelines&lt;/li&gt;
&lt;li&gt;SEO agent optimizes for target keywords and search intent&lt;/li&gt;
&lt;li&gt;Social media agent generates platform-specific promotion posts&lt;/li&gt;
&lt;li&gt;Design agent creates accompanying visuals (via ComfyUI integration)&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;All agents coordinate through the MCP protocol, passing contextual information from one stage to the next. The result is a production pipeline that would normally require a team of five people.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="how-to-get-started-your-first-month-plan"&gt;How to Get Started: Your First Month Plan
&lt;/h2&gt;&lt;p&gt;Ready to build your own AI agent team? Here&amp;rsquo;s a practical 30-day roadmap:&lt;/p&gt;
&lt;h3 id="week-1-setup--familiarization"&gt;Week 1: Setup &amp;amp; Familiarization
&lt;/h3&gt;&lt;ul&gt;
&lt;li&gt;Install Cowork locally (or on a VPS)&lt;/li&gt;
&lt;li&gt;Explore the agent roster in the dashboard&lt;/li&gt;
&lt;li&gt;Connect one LLM platform (start with Claude Code or Hermes Agent)&lt;/li&gt;
&lt;li&gt;Dispatch 5-10 simple tasks and observe the execution flow&lt;/li&gt;
&lt;/ul&gt;
&lt;h3 id="week-2-integration"&gt;Week 2: Integration
&lt;/h3&gt;&lt;ul&gt;
&lt;li&gt;Connect your first MCP-compatible tool (VS Code, Cursor, or your own script)&lt;/li&gt;
&lt;li&gt;Create a custom agent definition (write your own &lt;code&gt;.md&lt;/code&gt; file with YAML frontmatter)&lt;/li&gt;
&lt;li&gt;Set up the dashboard for continuous monitoring&lt;/li&gt;
&lt;li&gt;Experiment with task chaining (where one agent&amp;rsquo;s output feeds another&amp;rsquo;s input)&lt;/li&gt;
&lt;/ul&gt;
&lt;h3 id="week-3-scaling"&gt;Week 3: Scaling
&lt;/h3&gt;&lt;ul&gt;
&lt;li&gt;Add more LLM backends to your configuration&lt;/li&gt;
&lt;li&gt;Explore the 19 divisions and find agents you hadn&amp;rsquo;t discovered yet&lt;/li&gt;
&lt;li&gt;Set up automated task routing for recurring workflows&lt;/li&gt;
&lt;li&gt;Integrate Cowork with your existing tools (GitHub, Slack, Notion, etc.)&lt;/li&gt;
&lt;/ul&gt;
&lt;h3 id="week-4-optimization"&gt;Week 4: Optimization
&lt;/h3&gt;&lt;ul&gt;
&lt;li&gt;Review task execution patterns and refine agent routing&lt;/li&gt;
&lt;li&gt;Build custom agent rosters for your specific domain&lt;/li&gt;
&lt;li&gt;Document your successful multi-agent workflows&lt;/li&gt;
&lt;li&gt;Explore advanced features: remote brain registration, custom executors, API automation&lt;/li&gt;
&lt;/ul&gt;
&lt;hr&gt;
&lt;h2 id="seo--technical-considerations-for-your-ai-agent-platform"&gt;SEO &amp;amp; Technical Considerations for Your AI Agent Platform
&lt;/h2&gt;&lt;p&gt;If you&amp;rsquo;re evaluating Cowork not just as a tool but as a platform to share with the world (hosting documentation, tutorials, or a productized version), here are some SEO fundamentals to keep in mind:&lt;/p&gt;
&lt;h3 id="content-strategy-for-multi-agent-ai"&gt;Content Strategy for Multi-Agent AI
&lt;/h3&gt;&lt;p&gt;The keyword landscape around &amp;ldquo;multi-agent AI orchestration&amp;rdquo; is competitive but growing fast. In 2026, the most effective content strategy targets:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Informational intent&lt;/strong&gt;: &amp;ldquo;what is multi-agent AI&amp;rdquo;, &amp;ldquo;multi-agent vs single-agent AI&amp;rdquo;, &amp;ldquo;how to build AI agent teams&amp;rdquo;&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Commercial intent&lt;/strong&gt;: &amp;ldquo;Cowork vs CrewAI comparison&amp;rdquo;, &amp;ldquo;best open-source AI orchestration framework&amp;rdquo;&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Transactional intent&lt;/strong&gt;: &amp;ldquo;Cowork MCP framework setup guide&amp;rdquo;, &amp;ldquo;how to deploy Cowork production&amp;rdquo;&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;strong&gt;Internal linking strategy&lt;/strong&gt;: Link between tutorial content (beginner-friendly setup guides) and deep-dive content (architecture explanations, advanced agent authoring). This builds topical authority around the &amp;ldquo;AI agent orchestration&amp;rdquo; cluster.&lt;/p&gt;
&lt;h3 id="technical-seo-essentials"&gt;Technical SEO Essentials
&lt;/h3&gt;&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Structured data&lt;/strong&gt;: Use Article schema with proper authorship, date published, and canonical URLs&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Core Web Vitals&lt;/strong&gt;: LCP under 2.5s, INP under 200ms, CLS under 0.1 — especially critical for tutorial pages with code blocks&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Mobile optimization&lt;/strong&gt;: Many developers read technical content on mobile during commutes — ensure code examples are readable on small screens&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Multilingual support&lt;/strong&gt;: If targeting global audiences, translate content using a consistent approach (Hugo&amp;rsquo;s language configuration supports zh-cn, en, ja, es natively)&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;If you want a deeper dive into SEO for technical content, check out my &lt;a class="link" href="https://ckw19810413.github.io/etf-ai-dashboard/" &gt;AI Dashboard Guide&lt;/a&gt; and &lt;a class="link" href="https://ckw19810413.github.io/feishu-templates/" &gt;Feishu Templates Guide&lt;/a&gt; for examples of how I structure technical articles for search visibility.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="the-future-of-multi-agent-ai-in-2026-and-beyond"&gt;The Future of Multi-Agent AI in 2026 and Beyond
&lt;/h2&gt;&lt;p&gt;The landscape is moving fast. Here&amp;rsquo;s what I&amp;rsquo;m watching closely:&lt;/p&gt;
&lt;h3 id="agent-to-agent-communication-standards"&gt;Agent-to-Agent Communication Standards
&lt;/h3&gt;&lt;p&gt;MCP (Model Context Protocol) is becoming the universal language for agent communication. As more platforms adopt it, the interoperability between different agent ecosystems will improve dramatically. Cowork&amp;rsquo;s commitment to MCP means it&amp;rsquo;s future-proofed for this convergence.&lt;/p&gt;
&lt;h3 id="specialized-agent-markets"&gt;Specialized Agent Markets
&lt;/h3&gt;&lt;p&gt;We&amp;rsquo;re moving toward a world where agent rosters are curated marketplaces — similar to how app stores work today. You&amp;rsquo;ll be able to browse, install, and review agents for specific tasks (a &amp;ldquo;financial analyst&amp;rdquo; agent, a &amp;ldquo;legal compliance&amp;rdquo; agent, a &amp;ldquo;data visualization&amp;rdquo; agent) from anyone in the community.&lt;/p&gt;
&lt;h3 id="autonomous-multi-agent-workflows"&gt;Autonomous Multi-Agent Workflows
&lt;/h3&gt;&lt;p&gt;The next frontier is agents that can plan, execute, and self-correct without human intervention. Imagine telling your agent team &amp;ldquo;Launch a new Gumroad product&amp;rdquo; and having them autonomously: research the market, create the product page, generate marketing content, set up analytics, and optimize based on early performance data — all coordinated through Cowork&amp;rsquo;s orchestration layer.&lt;/p&gt;
&lt;p&gt;This isn&amp;rsquo;t distant future speculation. The building blocks are already here.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="should-you-adopt-multi-agent-ai-heres-my-honest-assessment"&gt;Should You Adopt Multi-Agent AI? Here&amp;rsquo;s My Honest Assessment
&lt;/h2&gt;&lt;p&gt;&lt;strong&gt;Yes, absolutely — if you:&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Regularly perform tasks that require multiple skills (write, analyze, design, code)&lt;/li&gt;
&lt;li&gt;Feel overwhelmed by trying to manage multiple AI tools manually&lt;/li&gt;
&lt;li&gt;Want to build automated workflows that don&amp;rsquo;t depend on a single model provider&lt;/li&gt;
&lt;li&gt;Are comfortable with command-line tools or want a clean Web UI&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;strong&gt;Maybe not yet, if:&lt;/strong&gt;&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;You only need basic AI assistance (a single model works fine for simple queries)&lt;/li&gt;
&lt;li&gt;You&amp;rsquo;re not comfortable with technical setup (though Cowork&amp;rsquo;s &lt;code&gt;npm install&lt;/code&gt; flow is designed to be straightforward)&lt;/li&gt;
&lt;li&gt;You&amp;rsquo;re in a highly regulated environment where data must stay within specific boundaries (self-hosting Cowork actually &lt;em&gt;helps&lt;/em&gt; with this — your agents run on your infrastructure)&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;strong&gt;My recommendation&lt;/strong&gt;: Start small. Install Cowork on your local machine, connect one LLM backend, and dispatch three tasks. Within an hour, you&amp;rsquo;ll have a working multi-agent system. The question isn&amp;rsquo;t whether to adopt multi-agent AI — it&amp;rsquo;s how quickly you can start.&lt;/p&gt;
&lt;hr&gt;
&lt;h2 id="whats-next"&gt;What&amp;rsquo;s Next
&lt;/h2&gt;&lt;p&gt;I&amp;rsquo;ve been running Cowork in production for months, coordinating agent teams for code reviews, content production, market research, and automated reporting. The framework has evolved from a personal tool into a robust platform that supports multi-platform agent coordination with a clean Web UI.&lt;/p&gt;
&lt;p&gt;If you&amp;rsquo;re interested in building AI agent teams for your own projects, the &lt;a class="link" href="https://github.com/slashman413/cowork" target="_blank" rel="noopener"
&gt;Cowork repository&lt;/a&gt; is open source and ready to clone. The documentation in the README will walk you through setup in under 10 minutes.&lt;/p&gt;
&lt;p&gt;I also run the &lt;a class="link" href="https://ckw19810413.github.io/" &gt;Slashman Tools blog&lt;/a&gt; where I publish regular guides on AI tools, automation workflows, and digital product creation. Feel free to explore — and let me know if you have questions about getting started with multi-agent AI.&lt;/p&gt;
&lt;hr&gt;
&lt;p&gt;&lt;em&gt;Reading time: 15 minutes | Published: July 26, 2026 | Last updated: July 26, 2026&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;[&lt;a class="link" href="https://ckw19810413.github.io/" &gt;Back to Home&lt;/a&gt;]&lt;/p&gt;</description></item></channel></rss>