![]() ![]() Identify URLs that are not in sitemaps.Identify your URLs returning non-200 status codes.Here’s a screenshot of Screaming Frog’s UI at the beginning of a crawl:Īs it goes deeper, you can do very useful things like: But if you are looking for graphs that you can present to your executive suite, Screaming Frog is not the tool for that. ![]() ![]() Screaming Frog is by SEOs for SEOs, and it works great in those circumstances. Screaming Frog’s main drawbacks, IMO, are that it doesn’t scale to large sites and it only provides you the raw data. This can be great for auditing and creating lists of URLs that need certain fixes or have issues. Screaming Frog is great for the SEOs and marketers who need all the data and then want to manipulate it in Excel or another tool. Understanding at a high level how well utilized the main meta elements are for pages and templates on sites.Crawling lists of URLs to gather their meta information.This feature is extremely valuable, and when coupled with their other tools like XML sitemap building and various specific exports like Insecure Content (for checking HTTPS), canonical errors, and orphaned pages, Screaming Frog is a very real contender for the best crawler out there. Once I tried this feature, I was able to crawl a 147,000 page website relatively quickly without rendering my machine useless. In the past Screaming Frog had trouble with large sites, though in recent years they created a way to optimize it to crawl large sites using database storage. I rarely use Screaming Frog for a full website crawl because I mostly am working on websites with six or seven figures of pages in the search index. I use Screaming Frog for a few major tasks and in a few specific circumstances. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |