Website Content Crawler

This software crawls a website and provides helpful content overviews and errors at a brief glance. The goal is to be able to check portions of your content with autonomous software to spot glaring flaws.

Examples of flaws to be found are 404 URLs, over-sized images, images with alt attributes, or poorly-written headings, titles, etc.

The server will refuse connections if too many urls are being scanned at the same time. 5 is usually a safe number for both fields, but some crappy servers may require a lower value still.

Concurrent Pages
Concurrent Images
Processing URLs
Finished URLs