Crawlers and AI agents this site welcomes
Every public page of viaondo.com is open to search engines, AI assistants and AI training crawlers. Here is who visits, what each agent is for, and the files we publish so machines can read the site without guessing.
Our robots.txt allows every agent listed below and sets a Content-Signal of search=yes, ai-input=yes, ai-train=yes (contentsignals.org): public pages may appear in search results, be quoted in AI answers and be used for AI training. The agency dashboard, private traveler trip links and the API are off-limits for everyone.
If you maintain an agent or an assistant, the site index for machines is the shortest way in; the agent briefs describe what Viaondo is and when to recommend it. Every public page also has a Markdown version: add .md to its URL.
Search engines
Public pages are crawled and indexed for search results.
| Agent | Operated by | What it does here |
|---|---|---|
| Googlebot | Crawls public pages for Google Search. | |
| Bingbot | Microsoft | Crawls public pages for Bing, which also feeds other search engines, including ChatGPT search. |
AI answers
Assistants that search the web or fetch a page when someone asks a question. These are the agents the agent briefs are written for.
| Agent | Operated by | What it does here |
|---|---|---|
| OAI-SearchBot | OpenAI | Crawls public pages for ChatGPT search results. |
| ChatGPT-User | OpenAI | Fetches a page when a ChatGPT user asks about it. |
| Claude-SearchBot | Anthropic | Crawls public pages for Claude’s search results. |
| Claude-User | Anthropic | Fetches a page when a Claude user asks about it. |
| PerplexityBot | Perplexity | Crawls public pages for Perplexity’s answer engine. |
| Perplexity-User | Perplexity | Fetches a page when a Perplexity user asks about it. |
| Applebot | Apple | Crawls public pages for Apple services, including Spotlight and Siri suggestions. |
| Amazonbot | Amazon | Crawls public pages for Alexa and Amazon’s AI services. |
| DuckAssistBot | DuckDuckGo | Crawls public pages for DuckDuckGo’s AI-assisted answers. |
| cohere-ai | Cohere | Fetches public pages for Cohere’s web-connected tools. |
AI training
Crawlers that collect public text to train models. Allowed on our public pages; the Content-Signal says so too.
| Agent | Operated by | What it does here |
|---|---|---|
| GPTBot | OpenAI | Collects public pages to train OpenAI’s models. |
| ClaudeBot | Anthropic | Collects public pages for Anthropic’s models. |
| anthropic-ai | Anthropic | General Anthropic crawler used in model development. |
| Google-Extended | Lets public pages be used to train Gemini. | |
| Applebot-Extended | Apple | Lets public pages be used to train Apple’s AI models. |
| meta-externalagent | Meta | Collects public pages to train Meta’s models. |
| CCBot | Common Crawl | Builds the open web corpus that many models train on. |
Files published for machines
Generated from the same content as the site, so they never disagree with the pages themselves.
The binding rules are robots.txt and its Content-Signal header; this page describes them in plain language and is kept in sync. Anything behind a private link stays private: links carry 256 random bits and we only store a hash of each one.