Allintitle:''keyword'' search - any software?

by 93 replies
113
I'm looking for software that can perform a search in google using the allintitle: ''keyword'' parameter from a big list of keywords ( txt or csv ) and output the results or save them.

Can somebody recommend me something?
#search engine optimization #allintitlekeyword #search #software
  • Please, share how you are doing the Allintitle:''keyword'' research. Manually it takes a lot of time, especially when you are working with thousands of keywords.
  • Scrapebox does this..the software is used for blogs so it will mostly look for those BUT you can still scrape all of google with the Allintitle, allinurl etc method.
    • [ 1 ] Thanks
    • [1] reply
    • So i can paste a list 100 keywords in scrapebox and it will search for them in google using the Allintitle: ''keyword'' parameter and display the numerical results?
      • [1] reply
  • I am curious... would you be willing to pay for such a program? Like maybe $10?

    I was looking for the exact same thing yesterday and did not find it.

    I was considering writing the program that would simply returns the number of sites for each keyword. So you paste in a big list and get back the count for each. It would probably have to support proxies to keep from getting banned.
    • [1] reply
    • A few hours work and this was born!

      [Screen shot would have been here if I had 15 posts - I will after this one so look for the screen shot in the next comment]

      It took about 25 seconds to process 50 keywords. I will probably drop the words "About" and "Results" so that you can then sort by the "All in Title" Column.

      As I thought, I did get a temporary ban from G after running these 50. Actually I got 49 results back and then they must have banned my IP.

      So if I want to make this into a usable tool I will have to add the ability to harvest and use proxies. Probably also add an option to slow down the time between requests.

      I can add import/export capabilities. To import keywords from file instead of copy/paste. To export results to text file or excel.

      Thoughts on if I should continue? It would be really easy at this point to also include a column for "All In Anchor" next to the "All In Title" column.

      I was thinking about a $10 price tag if I released it. If I get enough people interested I will work on finishing the project.
      • [2] replies
  • I think market samurai does that too
  • Micro Niche Finder does it too.

    But are you saying ScrapeBox can do it faster?
    • [1] reply
    • I do not own Market Samurai. I do have Micro Niche Finder but it is so slow now after the Google changes that I can't bear using it until they make it faster... if they even can or will. I also have Scrapebox but cannot figure out how to get just the All In Title counts. I don't think you can... but I could be wrong.

      I think I will still move forward on this software. I think it would be a quick and easy way to spot niches that are easy to rank for and I have a pretty good start on it so far.
  • Any more suggestions? Maybe someone know software that can do that?
  • This is the most interesting forum I have seen today. I hope the project is completed, it sounds great!
  • Sounds like threading may be a solution too. Throw each proxy captcha request in a thread. That gets tricky though. I use threading to find all the anchor text in the yahoo backlinks.

    LOL we are writing the bones of scrapebox here
    • [ 1 ] Thanks
    • [1] reply
    • I have not implemented threading yet. I have done it in other apps I have created and it is tricky like you said. I planned to do that before taking it public. I think now is the time to give it a shot.

      Very true about scrapebox. I have it and love it but it does not produce the results exactly like I am trying to do here. At least I could figure out how to get it. I would not want to try and reproduce everything that it does though... way too much work. I will stick to the simpler single task jobs like this one. LOL
      • [1] reply
  • you can try senuke! It has this feature.
    • [1] reply
    • FINALLY! Got the captcha licked! Now I can move on and finish up this project. I guess I need to check into how to cancel my freelancer gig.

      It turns out that I was only displaying the image once. The initial httpwebresponse does not actually hit the image as it only gets the html code. I was setting the picture box to the image url directly. This was my mistake. I spotted in Fiddler that when you do it in the web browser that the cookie was passed when downloading the image. So I set up another httpwebrequest/httpwebresponse to download the image using the cookie and then set that image to my picture box. It works every time and as long as I keep the cookie container I don't have to keep entering the captcha on each keyword.

      So I just have to put the finishing touches into this and add some threading and we will hopefully have a very cool and simple tool that does one thing and does it well!
      • [1] reply
  • This tool is exactly what I'm looking for right now. Now, if as you say, Micro Niche Finder only offers this under circumstances where you have to click every keyword one at a time, I'm just wandering if perhaps you've found a gap in the market here.

    I've not used MNF or Market Samurai, actually I'm still on Traffic Travis for the time being, which doesn't offer this. TT is too simple, as you probably know.

    However TT does offer a very well laid out analysis tool of the top 20 results for any search term for page backlinks, site backlinks, PR, whether or not the keyword is in the title, meta description, H1 tags. It even checks yahoo and DMOZ listing status.

    The point is that it's very convenient because it offers a lot of the data I need in one place for immediate comparison. Now considering that the top 10, or top 20 results analysis is one major section of all good keyword research, have you thought about gradually broadening your tool to cover as much as possible of what isn't included in this task? So then, just like the TT results page, I'd have a lot of useful information in one place that can be directly compared to save me time.

    What would be ideal is if you added a Google phrase match results column as well.

    And you've got the edge of having the presumably unique status of using proxy rotation for all in title and all in url searches to avoid temporary bans, as have been giving me headaches recently.

    Anyway, it looks really good so far and I'll buy it as soon as it's ready.
    • [2] replies
    • How is the speed of it so far? That is the only thing I wish I could speed up in Slick Niche Finder.
      • [1] reply
    • In my testing that I am doing I am pulling my keyword lists from Google Adwords Keyword Tool and I keep finding myself jumping back and forth to see what the exact local and global counts are. So yes I can see how having all this info in one place would be a convenient time saver.

      Thanks for all the suggestions. I will take them all into consideration and see what I can do.
  • These time frames are clearly a significant improvement on what I'm able to get right now.

    With Keyword Corral, I can only avoid the G automated queries problems by settings the delay to 30 to 60 seconds, twice for every keyword, for AIT and AIU competition. I have a lot of keywords to check, and right now, for example, I'm in the process of checking 220, which is going to take a few hours at this rate, it's a real problem.

    I really think that as long as you specifically delineate the problem that you're fixing in your sales pitch, you should be able to do well with this product.
    • [1] reply
    • Thanks. I will definitely stress the amount of time that can be saved. I have never done a WSO before or released a software program so this is all new to me. All my programs have always been for personal use or for use by my current employer which is not Internet Marketing related.

      I know I mentioned a price point of around $10 but after the amount of work I have put into and still need to do on this project I am thinking a $27 price point for warriors is going to be more likely. I would hope to eventually release it publicly maybe using Clickbank for a higher price point.

      You guys have inspired me to get back on this a little sooner then I planned.

      Once the program is ready I will be hand picking a few people that have really helped me with the development of this product by participating in this thread. Those people will be getting the software for 100% free with lifetime updates. Of course it would be nice if you would then provide a honest review of the product in return once I start up the WSO. Thanks for everyone that has helped me so far!
  • Hey any one can explain how this things actually woks .....
    • [1] reply
    • Can you be more specific as to what you don't understand? So that I can help you.
  • Well although I've not helped you make this tool, if you let me test it out, I'll happily write you an honest review of reasonable length in an articulate way, pointing out exactly the problems I was having before that the tool solves.
    • [1] reply
    • You have been more then helpful and will let you know when I am ready for some testing.
  • While allintitle is a good starting parameter, I find that you then need to run an "allinanchor" search to see what the competition is from other SEOers trying to rank for that keyword. Allintitle alone can give you a somewhat false/small picture sometimes.

    Would it be very difficult to add the "allinchor" search capability as well. If so you'd have some kick arse software my friend
    • [1] reply
    • I had a column for allinanchor but removed it before doing the screen shot. If you look the data grid is much wider then it needs to be. That is because I planned to include allinanchor but I didn't have it running yet so I took it out.

      Adding it in is not a problem but getting those results would double the time it takes. So I am thinking I would just make it so that you can run one at a time. That way if you only want on you can do that and it would take half the time.

      Thanks for the suggestion and definitely look for that in the finished product.
  • Market Samuari can do this, but if your used to Scrapebox, then you can easily use Scrapebox to do it as well. It depends on the size of your keyword list, if you just want the intitle results, then scrapebox is faster, but if its for say, competition analysis across 100 keywords, market samuari would take, well quite a lot longer, but would provide you with all of the information you'd need to complie a competition analysis report easily.
    • [1] reply
    • I do have Scrapebox and for the life of me can't figure out how to make it do this. If you know please spill the beans. I can run an allintitle search on a keyword list but it returns lists of harvested websites from that... not a total number of allintitle results from each keyword.

      I don't own Market Samurai but have asked many times for someone to provide me a screen shot where it shows Allintitle results for a list of keywords. If it does do it I might consider adding it to my collection of tools.

      I bought Micro Niche Finder and loved it but now it is pretty bad since Google shutdown the one API. The speed is terrible with MNF to the point where I refuse to use it. So I dont want to run out and get Market Samurai until I know it does what I want for sure. From the videos on their site it does not look like it does.
      • [1] reply
  • Hi Wordpressseo

    Whats happened
    There is no news at all on this
    Was following this thread regular but had to rush off outside the country and back again now only to see no news at all

    Heenal
    • [1] reply
    • I just updated everyone last night. It is a work in progress and I want to be sure it offers substantial features and works well before releasing. You will continue to see several weekly or even daily post from me on the status of the program. I am hoping to see a release in very early January if all goes well.

      Thanks for following!
  • Hi Wordpress_seo.
    I`m interested in this software too and I also recomend you setup a wso. I would help you in promoting it on my signature for free!

    Just PM me when you are ready.
    NB: I was also wondering if you wouldnt give any free copies to some of us here to get reviews.

    Hamzat
    • [1] reply
    • Thanks for your support. I have decided that this will be a WSO offering when it is ready. Yes I will be reaching out to a few people at sometime in the future to help me do some testing and hopefully get some reviews.

      Thanks!
  • Hi wordpress seo,

    I have read the above thread and i will be interested as well to do some beta testing or comments about your project...hopefully it will be out soon.

    med
    • [1] reply
    • Thanks and I will let you know when the time comes if I have an opening for testing.
  • Hi Guys

    Just thought I would share this with anyone who might not of heard about it, this site you can get fresh Proxys when needed here it is. > Elite Proxies

    Lee
    • [ 1 ] Thanks
    • [1] reply
    • Nice! Thanks Lee! That is very easy to copy and paste into my program.
      • [ 1 ] Thanks
      • [1] reply
  • Banned
    [DELETED]
  • Dude...I am totally in on this tool. For $10 this would save me hours on the backend!
    • [1] reply
    • I know it is going to save people so much time! I am so excited about releasing this tool.

      Too much blood, sweat and tears went into this so far for me to hold to the $10 price point I mentioned early on. I mentioned it before but when it is released in January I will be looking at $27 for a Warriors pre-release and then later $47 maybe through Clickbank.

      I should have an update and a new screen shot later tonight.
      • [1] reply

  • I am looking into this tool as well
  • What a fantastic job. Amazing difference since the initial screenshot. Great job! I am interested in the tool as well. Looking forward to the completed design!
    • [1] reply
    • Thanks Amy! It has definitely evolved over the past month. I am very excited with the way it is turning out and can't wait to get it finished. Thanks for following along!
  • Hi Wordpress_seo

    More power to your work and hope it will be usable tool in building up a laser target sites.

    Happy New Year!

    med
    • [1] reply

    • Thanks Med!

      I have added an advanced proxy check option that actually checks the proxies to see if they will work with "allin's" and also returns if each proxy will require a captcha or not. This will eliminate getting a bunch of proxys that work for web browsing but banned without captcha for "allin" searches.

      The cool thing is that the advanced check takes really no longer then the simple check. The only extra requirement is that you load up the keyword list before running the advanced check. The advanced check uses random keywords from your keyword list to perform the "allin" proxy testing.
  • When I research a keyword I put the search term in quotes and then go to the last page of Google. You will the see a message that says:

    In order to show you the most relevant results, we have omitted some entries very similar to the 804 already displayed.

    The number above is the key. If the number is under 300 I can usually rank on the first page. 300+ - 600 is a bit tougher and over 600 is really tough.

    Is there anyway to have your software to pull that number. I have been looking for software to do this for a long time.
    • [1] reply
    • Ok you have really got me interested in this one. How did you come up with this system? What would you call that number if you were to label it? How long have you been working from this number? Are you sure it works and how many sites have you setup based on this number?

      I did some research and found a way to go straight to the last page for any search in Google. So to answer your question... yes I could very easily add this to my program.

      Now having said that I am not sure that it is a good fit for this program. I need to know more about this number and why Google does not always display 1000 searches (their max per keyword) when the initial results are always way more.

      Lets talk about it more then. Maybe it would be better to do a separate product. I have never heard of other people using this number and if we could put together a quick product with an ebook or case study to go along with it I think that would be pretty successful. It almost sounds to me like you found a magic number. LOL.
      • [1] reply
  • Sorry for the delay! We are getting real close to launching All In Scraper. I am still shooting for this month. I guess it all depends on how long it takes to get a WSO setup and approved. I have to fix a few minor bugs in the program that some of my beta testers have found. I am also working on my sales page as we speak. Then I want to make 1 video of how the program works and then we should be looking at a launch.

    Thanks everyone for your help along the way!
  • I'm just creating a quick video for some software that I use. I don't think it's very expensive.

    As soon as it's done the allintitle keywords I will post the video

    Brian

    Here's the video - Sorry for the strange noises, I was eating a sweet.

    YouTube - allintitlevideo
    This is what I use, a combination to find keywords and then the competition.

    PM me for details if you want to?
  • Thanks for everyone's help in this thread. I wanted to post this video for you guys since this was the ultimate outcome of this thread.

    YouTube - All In Scraper Quick Overview
    • [1] reply
    • @wordpress_seo

      I just downloaded your allinscraper program just to find out that it's a .msi file.
      And I'm using a Mac..... -_-
      • [1] reply

Next Topics on Trending Feed