cosmic-mcp

All servers

Ollama / vLLM Bridge

io.github.setheerwagen/mcp-ollama-vllm ยท version 1.0.6

Community listing. Not installed or verified by cosmic-mcp. Read the source and its permissions before you run it.

Call your local Ollama or vLLM model over MCP with schema-validated JSON output

https://github.com/setheerwagen/local-ai-mcp-servers

Quick facts

  • Listing: Community
  • Published Oct 22, 14:27 UTC
  • Transport: stdio
  • Package: pypi mcp-ollama-vllm 1.0.6
  • Listed by cosmic-mcp: Nov 9, 04:27 UTC

AI and LLMs

Setup snippets

Generated from the registry entry. cosmic-mcp has not run or reviewed this server; values in angle brackets are yours to fill in.

Run it locally (pypi)

uvx 'mcp-ollama-vllm==1.0.6'

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "args": [
        "mcp-ollama-vllm==1.0.6"
      ],
      "command": "uvx",
      "env": {
        "LOCAL_API_KEY": "<your local api key>",
        "LOCAL_BACKEND": "<your local backend>",
        "LOCAL_EMBED_MODEL": "<your local embed model>",
        "LOCAL_EMBED_PATH": "<your local embed path>",
        "LOCAL_HOST": "<your local host>",
        "LOCAL_SCHEMA_MODE": "<your local schema mode>",
        "LOCAL_TIMEOUT": "<your local timeout>"
      }
    }
  }
}

Claude Code

claude mcp add 'mcp-ollama-vllm' -- uvx 'mcp-ollama-vllm==1.0.6'

Cursor (.cursor/mcp.json)

{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "args": [
        "mcp-ollama-vllm==1.0.6"
      ],
      "command": "uvx",
      "env": {
        "LOCAL_API_KEY": "<your local api key>",
        "LOCAL_BACKEND": "<your local backend>",
        "LOCAL_EMBED_MODEL": "<your local embed model>",
        "LOCAL_EMBED_PATH": "<your local embed path>",
        "LOCAL_HOST": "<your local host>",
        "LOCAL_SCHEMA_MODE": "<your local schema mode>",
        "LOCAL_TIMEOUT": "<your local timeout>"
      }
    }
  }
}

VS Code (.vscode/mcp.json)

{
  "servers": {
    "mcp-ollama-vllm": {
      "args": [
        "mcp-ollama-vllm==1.0.6"
      ],
      "command": "uvx",
      "env": {
        "LOCAL_API_KEY": "<your local api key>",
        "LOCAL_BACKEND": "<your local backend>",
        "LOCAL_EMBED_MODEL": "<your local embed model>",
        "LOCAL_EMBED_PATH": "<your local embed path>",
        "LOCAL_HOST": "<your local host>",
        "LOCAL_SCHEMA_MODE": "<your local schema mode>",
        "LOCAL_TIMEOUT": "<your local timeout>"
      },
      "type": "stdio"
    }
  }
}

Related servers

  • Harness Verified domain
    Start Claude Code and Codex agents the person can watch, wait for them and read their answers.
  • docs-mcp Verified domain
    Remote MCP server for Tandem docs, install guides, SDKs, workflows, and agent setup help.
  • spotdb Verified domain
    Ephemeral data sandbox for AI workflows with guardrails and security
  • Adako: ad ops for AI assistants Verified domain
    Google, Meta, LinkedIn and ChatGPT Ads for AI assistants. Every change needs your approval.
  • Aidoo for Odoo Verified domain
    Query and update your Odoo ERP in plain language, under your own Odoo access rules.
  • EXTREMELY agency Verified domain
    Your agency of AI agents in your AI app: what agents did, approvals, requests, jobs and reports.