Any ideas how best to build a secure Stats reporting APP/SaaS?

Profile picture of the author Joshster by Joshster Posted: 02/12/2013
Hi guys,

I am wanting to have built something that will scrape some numbers from columns of a secure website. And display the results in various ways, graphical and charts etc.

Nothing too fancy but it will either need to be a SaaS or downloadable App (which will need authentication of some sort).

Any thoughts on the best way to go about getting this done?

To recap:

  • Scrap numbers from a HTTPS site, users login through an IFrame I presume?
  • Display results in real time (hourly updates would be fine) in graphical and charts
  • Have a way to secure or authenticate usage.

Should it be PHP, or what?
And where would you suggest to get this type of thing done?

I've so far been recommended Peopleperhour.com

Thanks!

Ps. It's 100% legit and not related to financial websites or anything sensitive.
Pps, I thought to post this over at HackForums.net bu tthat place is such a warren...not sure where to post!
#app or saas #build #ideas #reporting #secure #stats

  • Profile picture of the author jacktackett
    jacktackett
    Josh there are web scraping tools that are pretty robust like unit and adobe air that can automate the data collection part. I would feed the data into a simple database and then into a reporting service or plugin. You could of course code it from scratch but I'd recommend checking out the scripting tools and report generators already available.
    Good luck.
    Jack
  • Profile picture of the author Joshster
    Joshster
    Jack, thanks for the super useful info. I'm fairly techie but not too much into actual heavy duty coding. A little lightweight stuff is no problem
  • Profile picture of the author AppDeveloper
    AppDeveloper
    Joshster,

    Were you able to get this project done? I might be interested. I love doing screen scraping/crawling projects.

    aniel
  • Profile picture of the author Joshster
    Joshster
    Thanks Daniel,

    Sending you a PM later today, just on my way out...

    ~Josh

    Originally Posted by AppDeveloper View Post
    Joshster,

    Were you able to get this project done? I might be interested. I love doing screen scraping/crawling projects.

    aniel
  • Profile picture of the author Can Tonic
    Can Tonic
    I would recommend you to build a Ruby on Rails application for that.
    Authentication and authorization can be handled very well with ruby on rails.
    I have written a similar project where a customer needed to scrape data from a website in the background. we did it with ruby on rails and it worked like a charm PLUS it looked great and the frontend was damn fast.

Related discussions