HEADMaster SEO is a small desktop program for PC and Mac that can quickly check URLs in bulk for status code, redirect details, response time, response headers and HTTP header fields (X-Robots-Tag, Link, Vary). You can analyze, filter and sort the results in real-time and export to CSV. https://headmasterseo.com/download
Use HEADMaster SEO 100% free to check up to 500 URL domains or purchase a license ($99.00) to check bigger URL lists.
Blazing fast URL checker
The tool can use HEAD requests to fetch only the server headers without the response body for faster speed and lower bandwidth consumption. With up to 200 simultaneous URL requests, HEADMasterSEO can check URLs at the maximum available speed.
Check URL lists of any size
HEADMasterSEO is a small and light link checker app that is optimized to run fast and use as little memory as possible. The SEO tool can reliably check 2 to 6 million URLs at a time on a modest machine / instance with 4GB to 8GB RAM and up to 30 million links on machines with 32GB.
Bulk check URL status and response time
Get the URL status code and response time of every link in your URL list. Find dead links (status code – 404 Not Found, 410 Gone), redirects (301, 302, 3XX), server errors (5XX http status codes) and slow pages.
Bulk check 301 and 302 redirects, redirect chains and loops
Check details about every URL redirection in your list. Visualize the complete redirection path and follow up to 9 redirects in redirect chains. Filter results to get redirect chains / redirect loops / 301 permanent redirects / 302 temporary redirects / 3XX HTTP status code redirects. Export redirects to CSV reports. HEADMasterSEO is the best redirect checker for testing large lists of link redirections.
Import URL lists
Import single or multiple URLs from plain text files, CSV files, XML sitemap files, the Clipboard or enter URL addresses manually. Import links from multiple files.
Request headers / User agents
Set custom HTTP request headers. Set the User Agent from a list of 20 pre-built agents (search engine bots, mobile devices, and browsers). Completely customize the User Agents at any time.
Rewrite URLs on the fly (for example to the staging environment of a website migration).
Set a proxy for all URL status checks. Use password-protected proxies.
Use HEAD or GET requests
The software can use HEAD or GET requests. HEAD requests are faster and save time on huge URL lists, but not all servers allow them. Use HEAD requests when checking large lists of URLs from a domain/website that supports them. Use GET requests when checking large lists of domains.
Filter and sort URL results in real-time
Audit results as they come in by filtering and sorting. Here’s the list of supported URL filters:
- “All URLs”
- “All URLs [In Import Order]”
- “HTTP URLs”
- “HTTPs URLs”
- “2XX – Success”
- “3XX – Redirects”
- “301 Redirects”
- “302 Redirects”
- “Redirect Chains”
- “Redirect Loops”
- “4XX Client Errors”
- “Page Not Found”
- “5XX Server Errors”
- “Slow Pages”
- “No Response / Timeout”
Sort the data for millions of URLs (more than the 1 million row limit that Excel can sort).
Export data to CSV
Export all data from URL checks or filtered subsets into different CSV reports (sorted or unsorted). Export URL results in the same order as the URLs were imported.
Save and reload data from URL checks
Save the results from your URL checks into .HEAD files and reload them later to filter, sort, analyze and export.
View HTTP headers
Audit the HTTP response headers of imported and redirected URLs. Export the response headers to CSV.
Audit all links in the HTTP response headers
The Link http header fields in your response headers carry important links and link parameters for your technical SEO setup (canonical, prev/next, alternate, hreflang). HEADMasterSEO visualizes all links from the response headers into an easy to examine grid and you can CSV export them for further analysis.
The URL checker can also import all extra links found only in the http response headers and check their status code, response headers and response time.
Bulk Check HTTP headers for X-Robots-Tag and Vary fields
The X-Robots-Tag “noindex, nofollow” directives in response headers can deindex pages and cause large drops in organic traffic. HEADMasterSEO extracts the X-Robots-Tag and Vary header fields into separate grid columns so that you can easily check and export them.
Check XML sitemaps for errors
Validate and check XML sitemaps for errors (non-200 status code links, dead links, internal server errors, redirects). Audit every link in image and video sitemaps.
Run the URL checker on cheap instances in “Low Memory Mode”
The program can check an unlimited amount of URLs in a special Low Memory Mode. In this mode, the tool imports the URLs in small batches and immediately exports the received results to CSV. Almost no data is kept in the memory. The tool can check huge lists of URLs on cheap VMs with very little memory (you only need disk space for the CSV results).
Redirect tester + URL mapping rules = Even more time saved
HEADMasterSEO can take a list of URLs and a list of URL mapping rules and test if every link in your list redirects to the proper destination URL using a single 301 redirect. Write URL mapping rules once and run the redirect tester as many times as needed.
Test canonical URL redirects setup
Run the built-in canonical URL redirect tester to find if your (http <-> https and www <-> non-www) canonical redirects are setup correctly.
Test URLs for secure cookies and HSTS header fields
The bulk URL tester can make sure that all your URLs return proper HSTS headers (Strict-Transport-Security) and there are no insecure cookies set.