# karobar.io - open to all search engines, AI crawlers and AI agents. # # There are no restrictions. Every page is pre-rendered to static HTML, so a # crawler that does not execute JavaScript still receives the full text. # # Machine-readable summaries of the whole site: # https://karobar.io/llms.txt - index of every page, grouped # https://karobar.io/llms-full.txt - full text of every page # # Deliberately a single wildcard group. A named group (User-agent: GPTBot) # overrides this one for that crawler, so a long list of named groups means a # future rule added here would be silently ignored by every bot on the list. # One group applies to every crawler, including ones that do not exist yet. User-agent: * Allow: / Disallow: # Content Signals (contentsignals.org): search indexing, use as AI answer input, # and AI training are all permitted. Content-Signal: search=yes, ai-input=yes, ai-train=yes Sitemap: https://karobar.io/sitemap.xml # Agents: manifest of the MCP server, A2A guide, API and skills (see /developers). Agentmap: https://karobar.io/.well-known/ai-catalog.json