khtm

Has anyone had a problem like this with SocialBot?

I'm new to SocialBot so I'm not sure if I'm doing something wrong, although I've read the use manual and I don't think I overlooked anything.

When I "Spider" one of my sites which was built with Joomla, the Pending field keeps growing until it contains > 9000 entries (at which point I stopped the process), and the Completed field keeps expanding but obviously at a slower rate. It had almost 1000 entries when I stopped it.

The problem is, my site has < 100 pages which are easily found by my sitemap generator and by search engines like Google every time they crawl it.

It seems almost like the SocialBot logic is doing this (just a made-up example):
- Side bar menu has 5 links that appear on every page
- If there's 10 pages, then the spider logic thinks those are actually 50 (10 * 5) pages because the menu has these links that appear everywhere

Or maybe it's getting stuck in a recursive loop as every page can lead to every other page through the link chain.

Any ideas?

I've emailed Mike but no response yet and I'm getting anxious to start submitting - was getting sick of SocialMarker.com

Loren Woirhaye

Just pick 5 or less PAGES to submit every day - you
would do well to ignore the spidering feature for
your whole site, because it's giving you the wrong
idea about what the tool is for... and not only will
you get your ass BANNED for submitting every single
spidered result, most are irrelevant anyway.

Just grab the URLs off the top of individual pages
that are of interest and submit those pages as
if you cared about bookmarking relevant content.

khtm

Thanks Loren - that makes sense.