cosmic-mcp

All servers

mcp-eval-runner

io.github.dbsectrainer/mcp-eval-runner ยท version 1.0.1

Community listing. Not installed or verified by cosmic-mcp. Read the source and its permissions before you run it.

A standardized testing harness for MCP servers and agent workflows

https://github.com/dbsectrainer/mcp-eval-runner

Quick facts

  • Listing: Community
  • Published Nov 4, 02:20 UTC
  • Transport: stdio
  • Package: npm mcp-eval-runner 1.0.1
  • Listed by cosmic-mcp: Nov 8, 18:59 UTC

Workflow automation Testing and QA

Setup snippets

Generated from the registry entry. cosmic-mcp has not run or reviewed this server; values in angle brackets are yours to fill in.

Run it locally (npm)

npx -y '[email protected]'

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "mcp-eval-runner": {
      "args": [
        "-y",
        "[email protected]"
      ],
      "command": "npx",
      "env": {
        "YOUR_API_KEY": "<your your api key>"
      }
    }
  }
}

Claude Code

claude mcp add 'mcp-eval-runner' -- npx -y '[email protected]'

Cursor (.cursor/mcp.json)

{
  "mcpServers": {
    "mcp-eval-runner": {
      "args": [
        "-y",
        "[email protected]"
      ],
      "command": "npx",
      "env": {
        "YOUR_API_KEY": "<your your api key>"
      }
    }
  }
}

VS Code (.vscode/mcp.json)

{
  "servers": {
    "mcp-eval-runner": {
      "args": [
        "-y",
        "[email protected]"
      ],
      "command": "npx",
      "env": {
        "YOUR_API_KEY": "<your your api key>"
      },
      "type": "stdio"
    }
  }
}

Related servers

  • docs-mcp Verified domain
    Remote MCP server for Tandem docs, install guides, SDKs, workflows, and agent setup help.
  • EXTREMELY agency Verified domain
    Your agency of AI agents in your AI app: what agents did, approvals, requests, jobs and reports.
  • A1 Lane Verified domain
    Draft, schedule and publish social posts and videos, with a read-back receipt for every post.
  • .NET MCP Server
    AI assistant access to .NET SDK for projects, packages, building, testing, and development tools.
  • 0pi
    Free, 2hr expiry agent storage to cache contexts, bridge workflows, or dump data.
  • 0s and 1s CIS calculators Verified domain
    Free UK CIS calculators: deductions, deadlines, late penalties, gross payment test, verification.