Skip to main content

Troubleshoot indexing issues

If you notice that some search results are missing, the first thing to check is whether the missing URLs are indexed.

Go to Search Studio > Index > Content List to look up any URL and check if it was indexed.

Content List

If a page is missing from the index and you use Sitemap Indexing, you will need to make sure the missing URL is included in your sitemap.

If you are crawling your website, you can try re-indexing the missing page manually.

You might get an error that will tell you why the page is not indexable. It could be because:

  • the page points to a different domain than your root URL(s),
  • a noindex robots meta tag tells the crawler not to index the page,
  • or because you have set up some blacklisting, whitelisting, or noindex rules that are preventing the URL from being indexed. (Learn more.)

When you fix these issues and can index the single URL successfully, recrawl your entire site and check again for the missing page(s).

The crawler does not go to external websites including Facebook, Twitter, LinkedIn, etc.