Comfyui Mcp Server

A lightweight Python-based MCP (Model Context Protocol) server that interfaces with a local ComfyUI instance to generate images programmatically via AI agent requests.

Overview

This project enables AI agents to send image generation requests to ComfyUI using the MCP protocol over WebSocket. It supports:

Flexible workflow selection (e.g., basic_api_test.json).
Dynamic parameters: prompt, width, height, and model.
Returns image URLs served by ComfyUI.

Prerequisites

Python 3.10+
ComfyUI: Installed and running locally (e.g., on localhost:8188).
Dependencies: requests, websockets, mcp (install via pip).

Setup

Clone the Repository: git clone cd comfyui-mcp-server
Install Dependencies:

pip install requests websockets mcp
Start ComfyUI:

Install ComfyUI (see ComfyUI docs).

Run it on port 8188:

cd <ComfyUI_dir>
python main.py --port 8188

Prepare Workflows:

Place API-format workflow files (e.g., basic_api_test.json) in the workflows/ directory.
Export workflows from ComfyUI’s UI with “Save (API Format)” (enable dev mode in settings).

Usage

Run the MCP Server: python server.py

Listens on ws://localhost:9000.

Test with the Client: python client.py

Sends a sample request: "a dog wearing sunglasses" with 512x512 using sd_xl_base_1.0.safetensors.

Output example:

Response from server:
{
  "image_url": "http://localhost:8188/view?filename=ComfyUI_00001_.png&subfolder=&type=output"
}

Custom Requests:

Modify client.py’s payload to change prompt, width, height, workflow_id, or model.

Example:

"params": json.dumps({
    "prompt": "a cat in space",
    "width": 768,
    "height": 768,
    "workflow_id": "basic_api_test",
    "model": "v1-5-pruned-emaonly.ckpt"
})

Project Structure

server.py: MCP server with WebSocket transport and lifecycle support.
comfyui_client.py: Interfaces with ComfyUI’s API, handles workflow queuing.
client.py: Test client for sending MCP requests.
workflows/: Directory for API-format workflow JSON files.

Notes

Ensure your chosen model (e.g., v1-5-pruned-emaonly.ckpt) exists in <ComfyUI_dir>/models/checkpoints/.
The MCP SDK lacks native WebSocket transport; this uses a custom implementation.
For custom workflows, adjust node IDs in comfyui_client.py’s DEFAULT_MAPPING if needed.