Any ideas how best to build a secure Stats reporting APP/SaaS?

by Joshster

Posted: 11 years ago 5 replies

PROGRAMMING

Hi guys,

I am wanting to have built something that will scrape some numbers from columns of a secure website. And display the results in various ways, graphical and charts etc.

Nothing too fancy but it will either need to be a SaaS or downloadable App (which will need authentication of some sort).

Any thoughts on the best way to go about getting this done?

To recap:

Scrap numbers from a HTTPS site, users login through an IFrame I presume?
Display results in real time (hourly updates would be fine) in graphical and charts
Have a way to secure or authenticate usage.

Should it be PHP, or what?
And where would you suggest to get this type of thing done?

I've so far been recommended Peopleperhour.com

Thanks!

Ps. It's 100% legit and not related to financial websites or anything sensitive.
Pps, I thought to post this over at HackForums.net bu tthat place is such a warren...not sure where to post!

#app or saas #build #ideas #reporting #secure #stats

jacktackett 11 years ago

Josh there are web scraping tools that are pretty robust like unit and adobe air that can automate the data collection part. I would feed the data into a simple database and then into a reporting service or plugin. You could of course code it from scratch but I'd recommend checking out the scripting tools and report generators already available.
Good luck.
Jack
- [ 1 ] Thanks
- 1 reply
Signature
Let's get Tim the kidney he needs!HELP Tim
Mega Monster WSO for KimW http://ow.ly/4JdHm
{{ DiscussionBoard.errors[7733662].message }}
- Joshster 11 years ago
  
  Jack, thanks for the super useful info. I'm fairly techie but not too much into actual heavy duty coding. A little lightweight stuff is no problem
  
  [ 1 ] Thanks
  
  1 reply
  
  Signature
  
  Looking to form an LLC or C/S Corporation?
  See my review of online co's here http://ji1.org/LLCs
  
  {{ DiscussionBoard.errors[7736050].message }}
  
  AppDeveloper 11 years ago
  
  Joshster,
  
  Were you able to get this project done? I might be interested. I love doing screen scraping/crawling projects.
  
  aniel
  
  [ 1 ] Thanks
  
  1 reply
  
  {{ DiscussionBoard.errors[7752577].message }}
  
  Joshster 11 years ago
  
  Thanks Daniel,
  
  Sending you a PM later today, just on my way out...
  
  ~Josh
  
  Originally Posted by AppDeveloper
  
  Joshster,
  
  Were you able to get this project done? I might be interested. I love doing screen scraping/crawling projects.
  
  aniel
  
  Thanks
  
  1 reply
  
  Signature
  
  Looking to form an LLC or C/S Corporation?
  See my review of online co's here http://ji1.org/LLCs
  
  {{ DiscussionBoard.errors[7753640].message }}
  
  Can Tonic 11 years ago
  
  I would recommend you to build a Ruby on Rails application for that.
  Authentication and authorization can be handled very well with ruby on rails.
  I have written a similar project where a customer needed to scrape data from a website in the background. we did it with ruby on rails and it worked like a charm PLUS it looked great and the frontend was damn fast.
  
  [ 1 ] Thanks
  
  {{ DiscussionBoard.errors[7754672].message }}