User-Agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /private/ # Allow specific files in disallowed directories Allow: /wp-admin/admin-ajax.php User-agent: facebookexternalhit Disallow: Sitemap: https://magazif.com/sitemap_index.xml