If you don’t know what Screaming Frog is, (then where have you been!?) It’s a tool that lets you crawl an entire site on demand. But that’s not all it’s good for...I was recently working on a clients site and I found myself turning to the tool more and more for tasks other than the standard crawl feature. I thought it might be useful to put together a list of other ways to use Screaming Frog.
1 - Verifying Google Webmaster Tools Crawl Errors
I recently wrote a post on how to do a site audit using Webmaster Tools. I’m a big fan of its features, but I find that the GWT doesn’t update the crawl errors frequently enough. This means there are often things like 404s reported when they’ve actually already been fixed. I’ve been using Screaming Frog to solve this problem. Below is my new process for 404s and other common errors.
- Crawl the entire site and put all 404s into a spreadsheet.