Building a keyword research app... a couple questions on fetching results
 

Hi everyone,

I'm currently working with a programmer on a custom keyword research app and I have a couple questions on how the app should fetch certain data. Any help would be appreciated!

If I type in a keyword, I'd like the app to display
1) the top 50-100 search results on Google.com
2) the PageRank and
3) the domain age for each result.

Our current approach is to use Google's search API, but it seems that it only returns 8 search results with each query and we would have to loop it 4 times just to get 30 results. As for PR, we're using Free pagerank api which also only returns 1 result for each query and we need to loop it 30 times for 30 results. Same thing with the domain age service that we found. This means that the app would have to make 60+ queries just to generate one datatable of results for a single search term...

Could anyone offer any suggestions for how we could better fetch our results?? This app isn't intended for mass scraping (the max number of results we'll need for any term is probably 100-200) so I think it could be done on the client-side computer and not have their IP banned. Any suggestions would be helpful!

Thanks :)
Peter

PS. also, how do the likes of Keyword Elite or Market Samurai do it??

Re: Building a keyword research app... a couple questions on fetching results
 

Could anyone help? thanks! :)

Re: Building a keyword research app... a couple questions on fetching results
 

Hi,

You can make 6 concurrent queries using Ajax, and update them simultaneously in the display area. Not the best thing to do, but you can manage the invocation and control the keywords too (suppose you get a keyword 2 times, you can execute the script once more). The profit to do it asynchronously will be that all 6 instances will run parallel and independent of each other.

Hope it helps.

Mohit