SocialBot 4.1 - Spider issue with CMS (Joomla)?

by khtm
2 replies
Has anyone had a problem like this with SocialBot?

I'm new to SocialBot so I'm not sure if I'm doing something wrong, although I've read the use manual and I don't think I overlooked anything.

When I "Spider" one of my sites which was built with Joomla, the Pending field keeps growing until it contains > 9000 entries (at which point I stopped the process), and the Completed field keeps expanding but obviously at a slower rate. It had almost 1000 entries when I stopped it.

The problem is, my site has < 100 pages which are easily found by my sitemap generator and by search engines like Google every time they crawl it.

It seems almost like the SocialBot logic is doing this (just a made-up example):
- Side bar menu has 5 links that appear on every page
- If there's 10 pages, then the spider logic thinks those are actually 50 (10 * 5) pages because the menu has these links that appear everywhere

Or maybe it's getting stuck in a recursive loop as every page can lead to every other page through the link chain.

Any ideas? :confused:

I've emailed Mike but no response yet and I'm getting anxious to start submitting - was getting sick of SocialMarker.com
#cms #issue #joomla #socialbot #spider

Trending Topics