How pages are counted

How Insites counts a page can be deceptively complex. This page explains the finer details.

Mobile and desktop pages

Insites attempts to test a website completely in both mobile and desktop devices. If a website is limited to say 100 pages, Insites will test up to 100 desktop pages  and 100 mobile pages.

This is usually what you would expect. It does mean that Insites does, by one interpretation, download 200 pages to test 100 pages. This is because it has downloaded each page twice, in both mobile and desktop.

Duplicate pages

Insites automatically detects and ignores pages with identical content to another page. Insites always considers the page with the shorter web address the ‘original’ version of the page, and tests only that.

For example, many websites might have pages like example.com and example.com/home which are identical. Insites would detect this, and only test the example.com page.

You can see a list of duplicate pages in the Duplicate content test. Duplicate content is a basic SEO issue and should be avoided where possible.

Frames and iframes

Insites downloads frames and iframes, but considers each frame to be a separate page.

Download limits

Insites attempts to find the number of unique pages it has been limited to. Some badly behaved websites can produce an infinite amount of duplicate pages, or redirections, or non-functioning URLs which would keep Insites searching forever.

To prevent this, Insites limits itself to 4 downloads per desired page. This means if you are testing up to 1,000 pages, that Insites will make up to 4,000 downloads before stopping automatically.

If your download limit is being reached, and not all of your desired pages are being found, you should consider defining rules to exclude specific URLs. If you are able to exclude sections of the site that are infinite, you should be able to stay within your download limit and find all of your real pages.