Any ideas how best to build a secure Stats reporting APP/SaaS?

by Joshster 5 replies
Hi guys,

I am wanting to have built something that will scrape some numbers from columns of a secure website. And display the results in various ways, graphical and charts etc.

Nothing too fancy but it will either need to be a SaaS or downloadable App (which will need authentication of some sort).

Any thoughts on the best way to go about getting this done?

To recap:

  • Scrap numbers from a HTTPS site, users login through an IFrame I presume?
  • Display results in real time (hourly updates would be fine) in graphical and charts
  • Have a way to secure or authenticate usage.

Should it be PHP, or what?
And where would you suggest to get this type of thing done?

I've so far been recommended Peopleperhour.com

Thanks!

Ps. It's 100% legit and not related to financial websites or anything sensitive.
Pps, I thought to post this over at HackForums.net bu tthat place is such a warren...not sure where to post!
#programming #app or saas #build #ideas #reporting #secure #stats
Avatar of Unregistered
  • Profile picture of the author jacktackett
    Josh there are web scraping tools that are pretty robust like unit and adobe air that can automate the data collection part. I would feed the data into a simple database and then into a reporting service or plugin. You could of course code it from scratch but I'd recommend checking out the scripting tools and report generators already available.
    Good luck.
    Jack
    Signature
    Let's get Tim the kidney he needs!HELP Tim
    Mega Monster WSO for KimW http://ow.ly/4JdHm


    {{ DiscussionBoard.errors[7733662].message }}
    • Profile picture of the author Joshster
      Jack, thanks for the super useful info. I'm fairly techie but not too much into actual heavy duty coding. A little lightweight stuff is no problem
      Signature
      Looking to form an LLC or C/S Corporation?
      See my review of online co's here http://ji1.org/LLCs
      {{ DiscussionBoard.errors[7736050].message }}
      • Profile picture of the author AppDeveloper
        Joshster,

        Were you able to get this project done? I might be interested. I love doing screen scraping/crawling projects.

        aniel
        {{ DiscussionBoard.errors[7752577].message }}
        • Profile picture of the author Joshster
          Thanks Daniel,

          Sending you a PM later today, just on my way out...

          ~Josh

          Originally Posted by AppDeveloper View Post

          Joshster,

          Were you able to get this project done? I might be interested. I love doing screen scraping/crawling projects.

          aniel
          Signature
          Looking to form an LLC or C/S Corporation?
          See my review of online co's here http://ji1.org/LLCs
          {{ DiscussionBoard.errors[7753640].message }}
          • Profile picture of the author Can Tonic
            I would recommend you to build a Ruby on Rails application for that.
            Authentication and authorization can be handled very well with ruby on rails.
            I have written a similar project where a customer needed to scrape data from a website in the background. we did it with ruby on rails and it worked like a charm PLUS it looked great and the frontend was damn fast.
            {{ DiscussionBoard.errors[7754672].message }}
Avatar of Unregistered

Trending Topics