Best lanuage for making seo automation tools

15 replies
To all the programmers out there, what would be the best language to write an automation tool like senuke, xrumer, scrapebox and such.

I am learning python right now as my first language but I don't know if that language would be a good fit...

Any suggestions?

Thanks.
#automation #lanuage #making #seo #tools
  • Profile picture of the author K Meier
    python is definitely a good start to get into it. Main problem with python is that it's a high level programming language (which is not a good thing in your case). Meaning that if you program something that is heavy on your CPU, you are very limited on optimizing CPU performance.

    C++, C# on the other hand are low level programming languages, which means you have full access to lower level of the system and can therefor optimize the CPU usage to your needs. Downside is, it's a good bit more complicated and can be very overwhelming to start of with since you can do anything with it.

    But then again, as a beginner who only wants to create one program, go for python, or try Java. Good thing about Java is that is cross platform compatible. Windows, Mac, Linux and even web based. You'll attract more users in the end
    {{ DiscussionBoard.errors[4066696].message }}
  • Profile picture of the author wayfarer
    Just because something is high-level doesn't make it automatically "bad". Performance is only relative to the weakest link in your system anyway, which in the case of a web scraper is the time required to actually make an HTTP call to gather information across the network which is the web. Since the actual time it takes to process the resulting information is so tiny compared to the call time, performance on the processor level is not critical. Since it is much faster to write code in a high level language than a lower level one, it is often the better choice.

    Google's spider is written in Python. Their indexer is written in C++.
    Signature
    I build web things, server things. I help build the startup Veenome. | Remote Programming Jobs
    {{ DiscussionBoard.errors[4066735].message }}
  • Profile picture of the author K Meier
    I didn't say it's a bad thing in general. I personally prefer high level languages. But from the looks of those tools he mentioned, where you scrape and ping 1000s of websites in a short time, its definitely a CPU heavy tool, or to be more exact, you're gonna use lots of Threads for a tool like that.
    {{ DiscussionBoard.errors[4066813].message }}
  • Profile picture of the author zone117x
    C# for desktop, PHP for server.
    {{ DiscussionBoard.errors[4068612].message }}
    • Profile picture of the author K Meier
      Originally Posted by zone117x View Post

      C# for desktop, PHP for server.
      I'm sorry, but what? Did you even read the OPs question? Or did you just post to get your post count up?
      {{ DiscussionBoard.errors[4068650].message }}
      • Profile picture of the author zone117x
        Originally Posted by Londrag View Post

        I'm sorry, but what? Did you even read the OPs question? Or did you just post to get your post count up?
        >_>

        If making tool to run on a server, use php. If making the tool to run on desktop, use C#.
        {{ DiscussionBoard.errors[4106929].message }}
  • Profile picture of the author stufftheme
    i will always prefer php for this
    as it is easy to learn
    {{ DiscussionBoard.errors[4068810].message }}
    • Profile picture of the author HostingWarrior
      Originally Posted by stufftheme View Post

      i will always prefer php for this
      as it is easy to learn
      But i don't think php will help for desktop software.
      {{ DiscussionBoard.errors[4072561].message }}
  • Profile picture of the author wayfarer
    My recommendation, is that since you're learning Python, stick with that until you learn as much as possible. Once you're confident at programming in general, you'll be better qualified to judge for yourself. One nice thing about Python, is that it has a very large standard library, and can handle complex networking tasks out of the box. It also supports true multithreading, which can be very helpful.

    Python is a great general-purpose programming language, though it does take a bit of a performance hit vs C++, C#, and Java, as mentioned. It's about in the same class as Perl, and is generally much faster than a scripting language like PHP.
    Signature
    I build web things, server things. I help build the startup Veenome. | Remote Programming Jobs
    {{ DiscussionBoard.errors[4069064].message }}
  • Profile picture of the author mologic
    i use c# and am happy with it ,, not a big fan of java

    visual studio vs eclipse

    nuff said
    Signature
    WTB PR5+ Blog Posts -- Bulk Orders -- PM Me
    {{ DiscussionBoard.errors[4108076].message }}
  • Profile picture of the author jminkler
    HTMLUnit
    cUrl
    {{ DiscussionBoard.errors[4110303].message }}
  • Profile picture of the author drewcur02
    I would suggest PHP from a Linux terminal (very stable).

    You need to know:

    - some PHP
    - cURL
    - Regular Expressions
    - maybe MySQL

    It will depend on your requirements.
    {{ DiscussionBoard.errors[4114130].message }}
  • Profile picture of the author Alicia Allen
    PHP an MySQL are the best.
    {{ DiscussionBoard.errors[4115866].message }}
    • Profile picture of the author kenmichaels
      @ the risk of getting flamed here. Anything visual will work well and be pretty easy to pick up on. 1000 's of code snippets and help sites that will basically walk you thru anything you want to do. Visual Basic was designed to do exactly what you want to do.
      Signature

      Selling Ain't for Sissies!
      {{ DiscussionBoard.errors[4116024].message }}
  • Profile picture of the author website design
    Yep visual, C++, C#, Python... all depends on what your most comfortable working with. All are great options but if you were to start from scratch I would go with C#
    Signature
    no sig needed.
    {{ DiscussionBoard.errors[4118097].message }}

Trending Topics