cosmic-mcp

All servers

AI Crawler Access Checker

io.github.Nero-Engine/ai-crawler-access-checker · version 0.1.0

Community listing. Not installed or verified by cosmic-mcp. Read the source and its permissions before you run it.

Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.

https://apify.com/nerolabs/ai-crawler-access-checker

Quick facts

  • Listing: Community
  • Published Nov 1, 14:46 UTC
  • Listed by cosmic-mcp: Nov 9, 04:25 UTC

Web scraping and crawling

Setup snippets

Generated from the registry entry. cosmic-mcp has not run or reviewed this server; values in angle brackets are yours to fill in.

Install details unavailable: the registry entry has no package or remote endpoint that passes our safety checks. Follow the source's own instructions.

Related servers

  • 1Claw Vault
    HSM-backed vault secrets for AI agents (JIT fetch) plus prompt-injection and threat scanning.
  • 222wcnm-bilistalkermcp Verified domain
    Track Bilibili creators and get the latest updates on videos, dynamics, and articles. Fetch user p…
  • 3d-texture-toolkit
    Extract embedded PBR texture maps from local GLB files.
  • 402registry Verified domain
    Does an AI crawler see your site? Free registry lookup, x402 pricing; checks paid in USDC on Base.
  • 4fetch
    Fetch a URL and get clean Markdown with metadata. No API key required; rate-limited per IP.
  • AEO Auditor — AI Search & Agent Readiness Engine Verified domain
    Live AEO, GEO, JSON-LD Schema, robots.txt AI crawler, and Agent Readiness diagnostic auditor.