Freelancer.com

Go Back   Warrior Forum - The #1 Internet Marketing Forum & Marketplace > Warrior Support Forums > Programming
Register Blogs Social Groups CalendarHelp Desk

Reply
LinkBack Thread Tools
Unread 19th October 2011, 04:13 PM   #1
HyperActive Warrior
War Room Member
 
xctang's Avatar
 
Join Date: 2005
Location: London, Ontario, Canada
Posts: 212
Thanks: 2
Thanked 14 Times in 8 Posts
Default Building a keyword research app... a couple questions on fetching results

Hi everyone,

I'm currently working with a programmer on a custom keyword research app and I have a couple questions on how the app should fetch certain data. Any help would be appreciated!

If I type in a keyword, I'd like the app to display
1) the top 50-100 search results on Google.com
2) the PageRank and
3) the domain age for each result.

Our current approach is to use Google's search API, but it seems that it only returns 8 search results with each query and we would have to loop it 4 times just to get 30 results. As for PR, we're using Free pagerank api which also only returns 1 result for each query and we need to loop it 30 times for 30 results. Same thing with the domain age service that we found. This means that the app would have to make 60+ queries just to generate one datatable of results for a single search term...

Could anyone offer any suggestions for how we could better fetch our results?? This app isn't intended for mass scraping (the max number of results we'll need for any term is probably 100-200) so I think it could be done on the client-side computer and not have their IP banned. Any suggestions would be helpful!

Thanks
Peter

PS. also, how do the likes of Keyword Elite or Market Samurai do it??
xctang is offline   Reply With Quote
Unread 20th October 2011, 01:55 PM   #2
HyperActive Warrior
War Room Member
 
xctang's Avatar
 
Join Date: 2005
Location: London, Ontario, Canada
Posts: 212
Thanks: 2
Thanked 14 Times in 8 Posts
Default Re: Building a keyword research app... a couple questions on fetching results

Could anyone help? thanks!
xctang is offline   Reply With Quote
Unread 20th October 2011, 05:48 PM   #3
Hypothetical Paradox
War Room Member
 
eminc's Avatar
 
Join Date: 2011
Location: India
Posts: 79
Thanks: 13
Thanked 20 Times in 19 Posts
Default Re: Building a keyword research app... a couple questions on fetching results

Hi,

You can make 6 concurrent queries using Ajax, and update them simultaneously in the display area. Not the best thing to do, but you can manage the invocation and control the keywords too (suppose you get a keyword 2 times, you can execute the script once more). The profit to do it asynchronously will be that all 6 instances will run parallel and independent of each other.

Hope it helps.

Mohit

The best way to predict future is to create it ― Abraham Lincoln
eminc is offline   Reply With Quote
Reply

  Warrior Forum - The #1 Internet Marketing Forum & Marketplace > Warrior Support Forums > Programming

Bookmarks

Tags
app, building, couple, fetching, keyword, questions, research, results

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off




All times are GMT -6. The time now is 03:12 AM.