Social Bot Is Spidering My site..BUT!

by 8 replies
10
The site is a comparison site, and it's got over 25,000 pages. Social Bot hasn't made a dent in the number of pages to spider yet, and the problem is that tomorrow (Saturday) an engineer is going to check out the internet and will interupt the process.

Question, will Social Bot pick up where it left off, or will it start all over again?

Thanks in advance.

Brian
#main internet marketing discussion forum #bot #sitebut #social #spidering #web 2.0
  • Hi,

    From what I know, it starts all over again. What I do when I have to cancel in the middle for some reason, I look at what site it was last doing, and then when I get ready to start it up again, I make a new profile for sites to send to, and exclude all the ones it has already been to. This way I don't go back spamming those sites.

    Hope that helps,
    Steve
  • Just curious why do you need to spider 25,000 pages to begin with ???

    James
    • [1] reply
    • I'm not familiar with Social Bot James, so when I ran it successfully for the first time, this site is one I wanted to promote using Social Bot. I didn't realise that being a mobile phone site it would have so many pages. I wasn't aware that there could be so many.

      Regarding 25,000 pages, I want to bookmark as many pages* as possible within reason for the back links. Unless I'm doing something wrong?

      Brian
      *For all of my websites.
      • [1] reply
  • Brian,

    just to confirm: I have SocialBot...spidering does NOT submit
    them...it just loads the pages into the program to get them
    ready to submit    .
  • Banned
    [DELETED]
Join the discussion

Next Topics on Trending Feed

  • 10

    Social Bot Is Spidering My site..BUT!

    The site is a comparison site, and it's got over 25,000 pages. Social Bot hasn't made a dent in the number of pages to spider yet, and the problem is that tomorrow (Saturday) an engineer is going to check out the internet and will interupt the process. Question, will Social Bot pick up where it left off, or will it start all over again?