Some websites use user agent sniffing and return a 403
(Forbidden) status code a given agent. This demonstration page will
return a 403 if the user agent includes the text BAD-AGENT.
The user agent used to request this page was:
CCBot/2.0 (https://commoncrawl.org/faq/)