Any programmers familiar with keyword tools out there?

Ryan Gabriel · 09-07-2008, 11:19 PM

Hey everyone,

I'm looking for a programmer who has a working knowledge of how to extract keyword data from various search engines.

I need to know how to assess whether or not I would be able to extract keyword data from specific search engines- not Google, Yahoo, MSN, etc.

These search engines are niche specific, not broad internet search engines.

Can anyone let me know what to look for?

If, after given some information in this thread, I determine I can develop a keyword tool for the engines I have in mind, I would be happy to pay someone to actually do most of the dirty work.

Thanks!

rwil02 · 09-08-2008, 03:56 AM

It depends on the search engine somewhat.
Google has a nice API you can query, which gives clean results.

Others may have, you you might have to screen scrape.

If they are like Google, then by screen scraping, you are in violation of the Terms of Use by doing so, and they can sue you for it. And don't think it's hard to figure out unless you are using many different client IPs.

But generally, it's not hard.

Take a look at ClickBank Digital Product Search which I wrote.
It takes the ClickBank data feed file, and queries each of the destination pages for their HTML. Then strips the HTML out, to get the plain text, and allows the user to search it.

There are plenty of spider appliction out there, including source code. It's really just a matter of what information you want to extract.

09-07-2008, 11:19 PM	#1
Ryan Gabriel Sleep = Cousin of Death War Room Member Join Date: May 2008 Location: Illinois, USA Posts: 166 Thanks: 9 Thanked 3 Times in 3 Posts Contact Info	Any programmers familiar with keyword tools out there? Hey everyone, I'm looking for a programmer who has a working knowledge of how to extract keyword data from various search engines. I need to know how to assess whether or not I would be able to extract keyword data from specific search engines- not Google, Yahoo, MSN, etc. These search engines are niche specific, not broad internet search engines. Can anyone let me know what to look for? If, after given some information in this thread, I determine I can develop a keyword tool for the engines I have in mind, I would be happy to pay someone to actually do most of the dirty work. Thanks!

09-08-2008, 03:56 AM	#2
rwil02 HyperActive Warrior War Room Member Join Date: May 2005 Location: Auckland, New Zealand. Posts: 241 Thanks: 0 Thanked 13 Times in 12 Posts Social Networking	Re: Any programmers familiar with keyword tools out there? It depends on the search engine somewhat. Google has a nice API you can query, which gives clean results. Others may have, you you might have to screen scrape. If they are like Google, then by screen scraping, you are in violation of the Terms of Use by doing so, and they can sue you for it. And don't think it's hard to figure out unless you are using many different client IPs. But generally, it's not hard. Take a look at ClickBank Digital Product Search which I wrote. It takes the ClickBank data feed file, and queries each of the destination pages for their HTML. Then strips the HTML out, to get the plain text, and allows the user to search it. There are plenty of spider appliction out there, including source code. It's really just a matter of what information you want to extract.
	Roger Willcocks L-Space Design Win Free Help With Your Software Design - CONTEST