Index multiple sites

You can set up your crawler to index all these sites and create a single search index that includes content from all of them.

Follow the steps below to index content spread across multiple sites, such as:

• a blog at http://blog.mysite.com/
• your main page at http://mysite.com/
• and additional content on a separate domain at http://myothersite.com/

Method 1: Create a combined sitemap

• Create a sitemap that includes URLs from all the sites you want to index.
• Go to Search Studio > Data Sources > Sitemap indexing.
• Submit the sitemap to the crawler. You can also submit multiple sitemaps, one per line, by clicking "Add sitemap URL".
• Hit "Save".

Method 2: Provide multiple root URLs

• Go to Search Studio > Website crawling.
• Enter multiple root URLs from where the crawler should start by clicking "Add root URL". For example, you can add http://blog.mysite.com/, http://mysite.com/, and http://myothersite.com/.
• Hit "Save".

Method 3: Use the API to add pages

• Go to Search Studio > Account and copy your API key. (Contact Support if you need assistance.)
• Add pages via the API. You can either provide URLs or send a JSON object with the indexable content.