Disallow Robots from Crawling All Html Pages
Is the code below correct to disallow all robots from crawling all html pages within my site: User-agent: * Disallow: /.html Allow: /wp-admin/admin-ajax.php Sitemap: (mydomain)/sitemap.xml Thanks in advance