Sitemap and Robots.txt Guide for WordPress & Blogger

1. Creating & Submitting Your XML Sitemap

A Sitemap acts as a blueprint for search engines, helping Googlebot discover your latest content efficiently.

For WordPress Users

The most effective way is using SEO plugins like Rank Math or Yoast SEO. These tools automatically generate your sitemap at:

yourdomain.com/sitemap_index.xml

For Blogger Users

Blogger provides a built-in sitemap. You can access it by adding the following suffix to your URL:

yourdomain.com/sitemap.xml

How to Submit to Google Search Console

1. Log in to your Google Search Console.
2. On the left sidebar, click on Sitemaps.
3. Under “Add a new sitemap,” enter: sitemap_index.xml (for WordPress) or sitemap.xml (for Blogger).
4. Click Submit.

2. The Best Robots.txt Configuration

The Robots.txt file tells search engines which parts of your site they should (or shouldn’t) crawl. Use these optimized snippets:

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Allow: /wp-content/uploads/

Sitemap: https://yourdomain.com/sitemap_index.xml

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

Sitemap: https://yourdomain.com/sitemap.xml

Summary for Better Ranking

Properly configuring these files is a pillar of Technical SEO. While the Sitemap ensures discovery, Robots.txt manages your crawl budget wisely.

• Sitemap: Facilitates content discovery.
• Robots.txt: Directs crawler behavior and protects sensitive directories.