cosmic-mcp

All servers

Atalaya AI crawler check

com.atalaya-ai/ai-crawler-check · version 1.1.0

Community listing. Not installed or verified by cosmic-mcp. Read the source and its permissions before you run it.

Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.

https://atalaya-ai.com/mcp-server/

Quick facts

  • Listing: Verified domain
  • Published Nov 3, 20:55 UTC
  • Transport: streamable-http
  • Listed by cosmic-mcp: Nov 9, 04:24 UTC

Web scraping and crawling

Setup snippets

Generated from the registry entry. cosmic-mcp has not run or reviewed this server; values in angle brackets are yours to fill in.

Remote MCP URL (Claude and ChatGPT custom connectors)

https://atalaya-ai.com/mcp

Claude Code

claude mcp add --transport http 'ai-crawler-check' 'https://atalaya-ai.com/mcp'

Cursor (.cursor/mcp.json)

{
  "mcpServers": {
    "ai-crawler-check": {
      "url": "https://atalaya-ai.com/mcp"
    }
  }
}

VS Code (.vscode/mcp.json)

{
  "servers": {
    "ai-crawler-check": {
      "type": "http",
      "url": "https://atalaya-ai.com/mcp"
    }
  }
}

Related servers

  • 1Claw Vault
    HSM-backed vault secrets for AI agents (JIT fetch) plus prompt-injection and threat scanning.
  • 222wcnm-bilistalkermcp Verified domain
    Track Bilibili creators and get the latest updates on videos, dynamics, and articles. Fetch user p…
  • 3d-texture-toolkit
    Extract embedded PBR texture maps from local GLB files.
  • 402registry Verified domain
    Does an AI crawler see your site? Free registry lookup, x402 pricing; checks paid in USDC on Base.
  • 4fetch
    Fetch a URL and get clean Markdown with metadata. No API key required; rate-limited per IP.
  • AEO Auditor — AI Search & Agent Readiness Engine Verified domain
    Live AEO, GEO, JSON-LD Schema, robots.txt AI crawler, and Agent Readiness diagnostic auditor.