How to scan specific pages using morningscore_whitelist.xml
How to scan specific pages using morningscore_whitelist.xml
If you cannot edit your robots.txt, you can upload a whitelist file instead. Morningscore reads it at the start of every Health scan and includes the listed pages automatically.
1. Create the file
Create a file named exactly morningscore_whitelist.xml with one <loc> entry per page:
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://www.yoursite.com/page-one/</loc>
</url>
<url>
<loc>https://www.yoursite.com/page-two/</loc>
</url>
</urlset>
Use the full URL including https:// and your exact domain. There is no limit on how many pages you can list.
2. Upload it to your website root
The file must be reachable at https://www.yoursite.com/morningscore_whitelist.xml. Open that URL in your browser to verify it shows raw XML and not an error page.
3. Want to scan ONLY those pages?
By default Morningscore will still scan the rest of your site on top of the listed pages. To restrict the scan to only the whitelist, also add this to your robots.txt:
User-agent: Morningscore Bot
Disallow: /
The whitelist overrides this block, so listed pages are still scanned. The two work together: robots.txt restricts the crawl, the whitelist carves out the exceptions.
Need help? Reach out to us on the chat.
Updated on: 18/05/2026
