3 {{ upvoteCount | shortNum }}
3 {{ upvoteCount | shortNum }}

¿Stop 404 in minify url pages when you refresh cache?

by 0laquease
2 replies
  • SEO
    • |
Hi,

When I have checked the server logs with Screaming Frog Log Analyzer, I saw that appears several 404 in minify pages. This issue happens becouse minify url are changing when you refresh the cache of website (I'm talking about WP site...)

Minify pages are too crawled by Google Bot (and other crawlers) so I want to figure out the way to solve this issue.

Do you know if exist some minify plugin without this issue?

Best Regards
#¿stop #404 #cache #minify #pages #refresh #url
  • Profile picture of the author jemee
    You can use Robots.txt file to disallow crawling and indexing your minify URL.
    Here is a sample robots.txt example for disallowing crawling and indexing.

    # robots.txt for example.com website

    User-agent: *
    Disallow: /cyberworld/map/ # This is an infinite virtual URL space
    Disallow: /tmp/ # these will soon disappear
    Disallow: /foo.html
    You can simply disallow link by link or the full minified folder once. I think blocking the minify folder is the best option to do it.
    If the minified URL already indexed into Google Search Engine then you should make a list of all the index links and submit to Google Webmaster "disavow links" option.
    Signature

    Wizard of WordPress, SEO and Marketing @ jeweltheme.com.

    {{ DiscussionBoard.errors[11102549].message }}
    • Profile picture of the author 0laquease
      Hi @jemee

      AFAIK it is not a good idea to disallow css/js minify files. Google (and all crawlers) need these files to "understand" better the website. Definetly it has not sense to disallow the minify URL...
      {{ DiscussionBoard.errors[11102613].message }}

Trending Topics