HTTP Status Codes

This page indexes HTTP status codes that generally have a special meaning during a crawl, such as redirecting to another resource, prompting for credentials, or handling some form of failure.

As the 4xx and 5xx series of codes deal with errors, the hyper-links to these pages are using onclick events instead of a standard href to prevent them from being detected by current versions of WebCopy (which do not process JavaScript). This allows an "out of the box" crawl to complete without displaying errors or password prompts etc. and without requiring any changes to the default crawl configuration. WebCopy integration tests access the relevant URI directly in order to test the feature. Future versions of WebCopy are expected to include limited JavaScript processing.