Any ideas how best to build a secure Stats reporting APP/SaaS?

by Joshster 5 replies
Hi guys,

I am wanting to have built something that will scrape some numbers from columns of a secure website. And display the results in various ways, graphical and charts etc.

Nothing too fancy but it will either need to be a SaaS or downloadable App (which will need authentication of some sort).

Any thoughts on the best way to go about getting this done?

To recap:

  • Scrap numbers from a HTTPS site, users login through an IFrame I presume?
  • Display results in real time (hourly updates would be fine) in graphical and charts
  • Have a way to secure or authenticate usage.

Should it be PHP, or what?
And where would you suggest to get this type of thing done?

I've so far been recommended Peopleperhour.com

Thanks!

Ps. It's 100% legit and not related to financial websites or anything sensitive.
Pps, I thought to post this over at HackForums.net bu tthat place is such a warren...not sure where to post!
#programming #app or saas #build #ideas #reporting #secure #stats
Avatar of Unregistered
  • Profile picture of the author jacktackett
    Josh there are web scraping tools that are pretty robust like unit and adobe air that can automate the data collection part. I would feed the data into a simple database and then into a reporting service or plugin. You could of course code it from scratch but I'd recommend checking out the scripting tools and report generators already available.
    Good luck.
    Jack
    Signature
    Let's get Tim the kidney he needs!HELP Tim
    Mega Monster WSO for KimW http://ow.ly/4JdHm


    {{ DiscussionBoard.errors[7733662].message }}
    • Profile picture of the author Joshster
      Jack, thanks for the super useful info. I'm fairly techie but not too much into actual heavy duty coding. A little lightweight stuff is no problem
      Signature
      Looking to form an LLC or C/S Corporation?
      See my review of online co's here http://ji1.org/LLCs
      {{ DiscussionBoard.errors[7736050].message }}
      • Profile picture of the author AppDeveloper
        Joshster,

        Were you able to get this project done? I might be interested. I love doing screen scraping/crawling projects.

        aniel
        {{ DiscussionBoard.errors[7752577].message }}
        • Profile picture of the author Joshster
          Thanks Daniel,

          Sending you a PM later today, just on my way out...

          ~Josh

          Originally Posted by AppDeveloper View Post

          Joshster,

          Were you able to get this project done? I might be interested. I love doing screen scraping/crawling projects.

          aniel
          Signature
          Looking to form an LLC or C/S Corporation?
          See my review of online co's here http://ji1.org/LLCs
          {{ DiscussionBoard.errors[7753640].message }}
          • Profile picture of the author Can Tonic
            I would recommend you to build a Ruby on Rails application for that.
            Authentication and authorization can be handled very well with ruby on rails.
            I have written a similar project where a customer needed to scrape data from a website in the background. we did it with ruby on rails and it worked like a charm PLUS it looked great and the frontend was damn fast.
            {{ DiscussionBoard.errors[7754672].message }}
Avatar of Unregistered

Trending Topics

  • 54 {{ upvoteCount | shortNum }}

    Warriors .... Warriors.... what would you like to LEARN?

    Good Morning awesome Warriors... I'm happy to announce that The Warrior Forum is planning to create our first COURSE. Yes... Powered by Warrior Wisdom... yeah!! Made at home. But before ... [read more]

  • 19 {{ upvoteCount | shortNum }}

    What is the best Way to drive Traffic From Reddit

    Hello everyone Lots of People say that it is a good Way To Get More visitors to Blog posts and get more Email Subscribers Fast. I started using it But ... [read more]

  • 46 {{ upvoteCount | shortNum }}

    How Do Highly Successful People Stay Positive?

    Hi Gang, I just stumbled upon this great article and wanted to share! 6 Ways Highly Successful People Stay Positive So the question begs, how do YOU stay positive? What ... [read more]

  • 5 {{ upvoteCount | shortNum }}

    Expired domains myths

    abrehman in SEO

    I'm going to buy an expired domain which have good metrics, registered in 2008. But i heard before going to buy any expire domain we must check domain by this ... [read more]

  • 1 {{ upvoteCount | shortNum }}

    SSL certificate can help my blog to rank high?

    tryootechamit in SEO

    SSL certificate can help my blog to rank high? Currently I use http but planning to move https is it necessary to move? After moving it will affect my traffic? ... [read more]