Read more about Search Engine Optimization by clicking on SEO Fundamentals.
Screaming Frog Interface
The Screaming Frog Interface [fig 1.0] is made up of 1) Screaming Frog SEO Spider Menu 2) Crawl Bar 3) Tab Bar with Menu at top 4) Side Bar Scroll and menu at top 5) Main Window with Slider 6) Detailed Window with Menu at bottom 7) Graph
Crawl a Website
First, in the Filter drop-down select ‘HTML’ [refer fig 1.0]. Next, in the screaming frog SEO spider menu bar, go to ‘Mode’ and from the drop-down select ‘Spider’. Enter the URL in the crawl bar located at the top of the screen and click ‘Start’. All the crawled URLs get displayed in the Main Window. Click on any of the URL in the Main Window and go the Menu located at the bottom of the Detailed Window and click on ‘Inlinks’. All the details pertaining to that URL gets displayed in the Detailed Window. Find out which pages show a 404 error that needs to be addressed and these details can be exported in a CSV file.
To crawl a list of URLs go to Mode and select List. From the Upload drop-down located in the crawl bar, upload a list of URLs from a file or enter manually by pasting in the displayed box.
Side Bar Tab
The Side Bar Scroll gives you a summary of URLs crawled. Details of all the SEO elements are available by scrolling down in the sidebar. Connect [fig2.0] to Google Analytics, Google Search Console, Majestic, Ahrefs & Mozscape for external link audits available only in the paid version.
Tabs: Overview> Site Structure> Response Times> API.
Under response time you can find how fast your pages are loading. The response times shown in the [fig2.1] is 0.25 seconds which is as per the standard norms.
Screaming Frog Tab Bar
Tab Bar: Internal> External> Protocol> Response Codes> URI> Page Titles> Meta Description> Meta Keywords> H1> H2> Images> Canonicals> Pagination> Directives> Hreflang> AJAX> AMP> Sitemaps> Custom> Analytics> Search Console> Link Metrics.
To be concise some of the main tabs, in the above is considered as per below.
Scroll along the bar and check to optimize column wise. Tabs: Address> Content> Status Code> Status [HTTP response code]> Indexability [URLs are indexable or not]> Indexability Status> Title 1> Title 1 Length> Title 1 Pixel Width [can be upto 50-60 characters or 512 pixels]> Meta Description 1> Meta Description 1 Length [under 158 characters]> Meta Description 1 Pixel Width> Meta Keyword 1> Meta Keywords 1 Length> H1-1> H1-1 length> H2-1> H2-1 length> Meta Robots 1> Meta Refresh 1> Canonical Link Element 1 (tells search engine which URL is the master copy]> rel=”next”1> rel=”prev”1> Size> Word Count [at least 350 words]> Text Ratio> Crawl Depth [upto 3 is acceptable but level 4 and 5 are considered bad]> Link Score> Inlinks [check each page lowest number/ highest number]> Unique Inlinks> % of Total> Outlinks [check each page lowest number/ highest number]> Unique Outlinks> Unique External Outlinks> Hash> Response time [0.25 second]> Last Modified> Redirect URI [301, 302 etc]> redirect Type> URL Encoded Address.
The external tab [fig 3.1] gives information about external URIs.
Tabs: Address> Content> Status Code> Crawl Depth> Inlinks>
Screaming Frog Protocol
The protocol tab [fig 3.2] gives data HTTP Vs HTTPS from internal and external URIs.
Tabs: Address> Content> Status Code> Status> Indexability> Indexability Status> Canonical Link Element1> Meta Robots1> X-Robots-Tag 1.
Screaming Frog Response Codes
The response code tab [fig 3.3] gives response information from internal and external URIs. To find redirects go to bulk exports and select response codes and click on redirection (3xx) in-links. The redirection_(3xx)_inlinks.csv file saved on your computer shows a table where the redirects are on that need to be changed to the actual redirects.
Tabs: Address> Status Code> Status> Indexability> Indexability Status> Inlinks> Response Times> Redirect URI> Redirect Type.
The URI tab [fig 3.4] includes data related to the URLs requested which is displayed in the main box.
Tabs: Address> Content> Status Code> Status> Indexability> Indexability Status> Hash> Length> Canonical Link element 1> URL Encoded Address.
Go to page title tab. Export the report and get information about length and character/length and pixels of the title. Should the title be long, it will get truncated in Google search results. Check your titles to spot similarities so that you can merge such similar pages into one.
Tabs: Address> Occurrences> Title 1 Length> Title 1 Pixel Length> Title 1 Pixel Width> Indexability> Indexability Staus.
Keep meta description between 120 to 158 characters. Google’s meta description length is up to 920 pixels.
Tabs: Address> Occurrences> Meta Description 1> Meta Description 1 Length> Meta Description 1 Pixel> Indexability> Indexability Status.
Ignore the Meta Keywords tag as Google doesn’t use the “keywords” meta tag in web search ranking.
Each of your pages should have a single H1 heading. Check if anything is marked zero.
Tabs: Address> Occurrences> H1-1> H1-1 Length> Indexability> Indexability Status.
Every page is not required to have an H2 heading. Check if any page that is not having an H2.
Tabs: Address> Occurrences> H2-1> H2-2> H2-2 length> Indexability> Indexability Status.
The image tab includes data pertaining to any images crawled. The Image has to be under 100 KB for it to load faster on web pages. Check for missing or long text alt tags.
Tabs: Address> Content> Size> IMG Inlinks> Indexability> Indexability Status.
Tabs: Address> Status Code> Title 1.
Connect Screaming Frog with Ahrefs, Majestic etc. These Link Profilers scan websites and databases to determine the authority of websites for these links from where they come. Backlinks are the Off-page SEO that is outside the scope of normal SEO Audits.