Creating A Script That Creates Millions Of Pages

by 12 replies
14
I need to find a programmer who can create a script that creates millions of pages on a site it is installed on.

Where do I find such a programmer and how much should I pay a programmer in the Philippines or India for such a script?

Are they hard to create? I am looking for information without giving away too much information about what I am trying to accomplish.

What strategies can I use to find such a programmer at the lowest price?
#programming #creates #creating #millions #pages #script
  • The following script will create a million pages...

    <?php
    $i=0;
    while ($i < 1000000) {

    exec('touch ' . $i . '.html');

    $i++;
    }
    ?>

    That's easy to do. So I guess the answer to "Are they hard to create?" depends on the complexity of the pages you want to create.
    • [1] reply
    • Millions of pages? I don't know what your hosting setup is, but attempting to run a script like the one above on a shared server would get your hosting account shut down instantly. You'd probably need quite a few dedicated servers for that sort of volume (as a point of reference, Wikipedia has ~5 million articles, and they have hundreds of servers).

      You'd also need to set both 'set_time_limit' and 'max_execution_time' to "0" in your php.ini file, so that the script doesn't time out (creating millions of files via PHP will take a looooooooong time). And you'll need to make sure that all of the directories that will be written to have the proper 'write' permissions. Error handling / logging would be a good idea too.

      As per how difficult it would be to write the script? As mojojuju said... it all depends on what kind of content you want to put on each page. It could be anything from "super simple" ($) to "super complex" ($$$$). No way to give you a better answer than that without knowing more details. Either way, it sounds like your hosting costs will be a lot more expensive than the script development.
      • [1] reply
  • You can easily create millions of pages. You can do this even using descent CMS like wordpress. But the question is: what will the pages will contain? from SEO POV, they will all contain duplicate content probably, or will not have any value to the user.

    Most of the websites that contain millions of pages have some unique content in them. Also as someone has already told you, your hosting provider will not tolerate this (if it's shared hosting), you will probably need an expensive dedicated server.

    In short: I'm not sure what exactly you are trying to achieve in the big picture, but it's seems like a step in the wrong direction.
  • These scripts are already out there and are very common in the BH community. I have tested them myself and are only any good for very targeted local websites.
  • That is easy. Don't physically create the pages. Let them be generated "on the fly".

    Create a .htaccess file and insert this
    Code:
    RewriteEngine on
RewriteBase /
RewriteCond %{http_host} !^www.yourdomain.com$ [nc]
RewriteRule ^(.*) [r=301,nc,L] 
RewriteRule ^(.+).html$ /index.php?page=$1 [QSA]
    Next create your index.php

    Code:
     <?
   $page = $_GET['page'];
   if (!empty($page)) {
      echo $page;
   } else {
      echo "Empty page";
   }
 ?>
    Warning: Make sure to use something like htmlawed to remove any injected code to $_GET['page'];

    Now you just created unlimited pages:




    Hope this helps.

    Michael
  • What's the point in doing that? There are already too much junk on internet. You won't rank anywhere with junk content. You won't make a cent doing that.
    • [1] reply
    • If you are just creating millions of pages with crap content, then your statement is absolutely true.... but if you are generating "quality" pages (= what the visitor is searching for), then it can - in fact - be very effective.
Join the discussion

Next Topics on Trending Feed