Log File Analyser

A complete SEO toolkit should include both a website crawler and a data analyzer, and that is why the developers of Screaming Frog SEO Spider released the suggestively called Log File Analyser. This application is meant to provide a more broad overview of the search engine's behaviour over time, which will surely help you take the best decisions when it comes to improving the ranking of your website.

As its name implies, Log File Analyser can analyze data inside loaded log files and provide useful information regarding the crawled URLs and what the search engine bots have experienced. It automatically generates graphs to graphically capture the evolution of events, URLs and response codes in a given time period.

You can catch a glimpse at the analysis statistics, which contains the number of unique URLs, total events, average transferred bytes, found errors, redirections, client and server errors.

Drag and drop actions are supported so adding new files for analysis is very easy once a new project is created. By default, the application compiles and processes data for Googlebot, Bingbot, Yandex, and Baidu, but you can easily select the desired bot and thus filter the information.

Log File Analyser makes it possible for all website owners and SEO experts to access a list of URLs that have been crawled by search engines and check the access frequency.

Response codes show you the responses querying search engines have received, highlighting inconsistencies and errors, if any. Furthermore,  by monitoring the number of downloaded bytes and the time it took for search engines to receive a response, it is easy to find pages that experience performance problems.

There is more to discover about Log File Analyser, a utility that, with further improvements, might earn its place in the toolkit of an SEO expert. Its goal is to gather data in your SEO log files and display them in such a manner that users find it easier to analyze large amounts of data for SEO-related purposes.