LinkBot

LinkBot is the web crawler of Link (linkco.ai). It identifies itself as:

LinkBot/<version> (+https://linkco.ai/bot)

Why it reads your site

For two reasons only. Someone entered your site’s address in the live test on linkco.ai, so that Link can describe what the business sells and to whom. Or Link is looking for companies likely to buy from one of its users, and reads the home page (sometimes also the about page) of the companies it considers.

What it reads

Public text only: your robots.txt file, your home page and, for a tested site, up to 30 other pages of the same domain and the sitemap your robots.txt names. It reads over https only, runs no JavaScript, fills in no forms and follows no links to other domains.

How often

Rarely. One website is read at most a few times a day, and each test reads at most 31 pages. LinkBot reads at most 4 pages at a time from one site and honours Crawl-delay.

How to block it

LinkBot follows robots.txt (RFC 9309). To keep it off your whole site:

User-agent: LinkBot
Disallow: /

If your robots.txt does not answer (a server error), LinkBot reads nothing.